-- Logs begin at Tue 2022-05-03 08:27:13 UTC, end at Tue 2022-05-03 09:39:44 UTC. -- May 03 08:56:49.680723 dv-cinder-840279-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 03 08:56:49.688545 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 03 08:56:49.690550 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 3 08:56:49 2022] *** May 03 08:56:49.690550 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 03 08:56:49.690550 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 03 08:56:49.690550 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: nodename: dv-cinder-840279-1-iscsi May 03 08:56:49.690550 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: machine: x86_64 May 03 08:56:49.690550 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: clock source: unix May 03 08:56:49.690919 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: pcre jit disabled May 03 08:56:49.690919 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: detected number of CPU cores: 4 May 03 08:56:49.690919 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: current working directory: / May 03 08:56:49.690919 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: detected binary path: /usr/bin/uwsgi-core May 03 08:56:49.690919 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: your processes number limit is 47680 May 03 08:56:49.690919 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: your memory page size is 4096 bytes May 03 08:56:49.690919 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: detected max file descriptor number: 2048 May 03 08:56:49.690919 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: lock engine: pthread robust mutexes May 03 08:56:49.690919 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: thunder lock: enabled May 03 08:56:49.690919 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 03 08:56:49.691405 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 03 08:56:49.743131 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: Python main interpreter initialized at 0x558cf20b19c0 May 03 08:56:49.743131 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: python threads support enabled May 03 08:56:49.743131 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: your server socket listen backlog is limited to 100 connections May 03 08:56:49.743131 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: your mercy for graceful operations on workers is 90 seconds May 03 08:56:49.743519 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: mapped 403077 bytes (393 KB) for 2 cores May 03 08:56:49.743596 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: *** Operational MODE: preforking *** May 03 08:56:49.743854 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: *** uWSGI is running in multiple interpreter mode *** May 03 08:56:49.743854 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: spawned uWSGI master process (pid: 79888) May 03 08:56:49.744065 dv-cinder-840279-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 03 08:56:49.744943 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: spawned uWSGI worker 1 (pid: 79901, cores: 1) May 03 08:56:49.744943 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: spawned uWSGI worker 2 (pid: 79902, cores: 1) May 03 08:56:49.746090 dv-cinder-840279-1-iscsi devstack@keystone.service[79888]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 03 08:56:55.434642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:56:55.434642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: from cryptography.utils import int_from_bytes May 03 08:56:55.435408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:56:55.435408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: from cryptography.utils import int_from_bytes May 03 08:56:55.435820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:56:55.435820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: from cryptography.utils import int_from_bytes May 03 08:56:55.435929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 08:56:55.435929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: from cryptography.utils import int_from_bytes May 03 08:56:55.485019 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 08:56:55.485150 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 08:56:55.485213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 08:56:55.485424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] command line args: [] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 08:56:55.485514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 08:56:55.485588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] command line args: [] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 08:56:55.485653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 08:56:55.485802 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ================================================================================ {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 08:56:55.485886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 08:56:55.486015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ================================================================================ {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 08:56:55.486101 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] admin_token = **** {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.486253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] config_dir = [] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.486332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] admin_token = **** {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.486397 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.486456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] config_dir = [] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.486598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] config_source = [] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.486682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.486753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] debug = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.486813 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] config_source = [] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.486959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489189 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] debug = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489189 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489476 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489534 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] list_limit = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] list_limit = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.489965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] log_config_append = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] log_config_append = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490145 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490207 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] log_dir = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] log_dir = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] log_file = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] log_file = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490466 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490712 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490897 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.490958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491148 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491207 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491465 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.491963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.492025 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.492081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.492174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.492240 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.492299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.493015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.493234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.493456 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] publish_errors = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.493656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] publish_errors = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.493826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.494059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.494225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.494417 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.494609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.494809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.495009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.495296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.495526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.495730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.495933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] standard_threads = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.496146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] standard_threads = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.496366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.496565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.496764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.496966 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.497167 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.497333 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.497567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] use_journal = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.497733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] use_journal = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.497936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] use_json = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.498096 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] use_json = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.498260 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] use_stderr = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.498425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] use_stderr = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.498565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] use_syslog = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.498694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] use_syslog = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.498870 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.499004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 08:56:55.499132 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.499266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.499403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.499573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.499742 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.499877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.500007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.500155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.500308 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.500444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.500573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.500713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.500841 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.501044 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.501222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.501362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.501491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.501618 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.501745 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.501884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.502012 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.502146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.502274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.502401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.502534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.502689 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.502820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.502952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.503080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.503209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.503336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.503473 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.503604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.503732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.503865 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.503993 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.504148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.504298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.504438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.504566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.504693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.504820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.504952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.505095 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.505225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.505358 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.505486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.505612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.505739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.505874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.506003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.506140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.506269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.506396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.506523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.506658 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.507096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.507235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.507364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.507492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.507625 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.507833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.507971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.508129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.508275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.508422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.508551 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.509193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.509327 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.509456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.509583 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.509710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.509836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.509971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.510099 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.510238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.510377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.510506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.510652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.510787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.510915 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.511042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.511169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.511296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.511431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.511566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.511695 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.511828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.511956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.512166 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.512319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.512456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.513656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.513866 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.514036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.514036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.514449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.514449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.514793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.514984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.515211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.515380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.515611 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.515611 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.516017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.516017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.516396 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.516591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.516828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.516996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.517189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.517189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.517558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.517749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.517981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.518147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.518341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.518534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.518699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.518873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.519049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.519199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.519330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.519500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.519644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.519775 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.519905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.520043 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.520238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.520376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.520505 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.520634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.520779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.520909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.521048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.521177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.521326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.521587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.521736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.521875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.522015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.522145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.522279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.522414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.522542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.522670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.522817 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.522947 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.523084 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.523219 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.523354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.523491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.523630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.523761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.523889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.524016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.524270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.525017 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.525236 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.525379 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.525510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.525644 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.525774 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.525911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.526041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.526169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.526305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.526434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.526563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.526699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.526829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.526957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.527091 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.527230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.527360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.527496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.527626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.527755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.527883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.528010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.528169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.528317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.528457 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.528599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.528730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.528858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.528986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.529124 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.529254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.529392 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.529523 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.529651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.529780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.529907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.530045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.530183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.530389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.530595 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.530749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.530880 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.531020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.531159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.531296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.531427 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.531556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.531685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.531814 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.531986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] auth.external = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.532286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.532506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.532726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] auth.external = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.532946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.533173 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.533459 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.533720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.533955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] auth.password = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.534186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.534410 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] auth.token = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.534642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] auth.password = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.534862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.535078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] auth.token = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.535309 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.535529 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.535752 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.535974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.536229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.536562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.536787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.536928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.537058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.537188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.537317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.537461 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.537592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] credential.caching = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.537723 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.537853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.537982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] credential.caching = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.538111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.538250 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.538381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.538511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.538652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.538783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.538912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.539051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.539182 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.539332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.539571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.539723 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.539858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.540029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.540220 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.540359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.540506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.540649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.540780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.540919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.541057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.541187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.541322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.541453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.541581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.541718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.541849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.541979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.542108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] federation.caching = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.542108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.542352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.542352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] federation.caching = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.542621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.542759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.542894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.542894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.543140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.543346 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.543481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.543610 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.543747 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.543878 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.544009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.544170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.544305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.544445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.544575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.544705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.544834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.544971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.545103 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.545238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.caching = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.545373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.545502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.545631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.545771 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.545902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.caching = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.546030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.546174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.546303 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.546433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.546571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.546571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.546571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.546571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.546571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.546571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.546571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.546571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.547512 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.547641 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.547777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.547923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.548054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.548217 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.548348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.548477 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.548606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.548747 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.548933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.549064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.549193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.549324 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.549453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.549590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.549732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.549861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.549990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.550119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.550119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.550377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.550513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.550642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.550771 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.550900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.551028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.551164 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.551295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.551425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.551565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.551694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.551822 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.551960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.552124 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.552262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.552392 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.552522 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.552650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.552791 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.552922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.553050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.553179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.553330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.553462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.553600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.553731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.553859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.553988 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.554115 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.554244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.554381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.554512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.554640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.554813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.554946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.555075 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.555222 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.555401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.555557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.555696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.555826 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.555955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.556122 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.556269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.556399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.556535 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.556666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.556795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.556933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.557063 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.557247 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.557383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.557539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.557763 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.557923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.558057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.558186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.558316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.558445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.558573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.558719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.558852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.558981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.559121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.559251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.559381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.559519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.559650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.559780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.559910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.560038 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.560223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.560372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.560508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.560638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.560767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.560897 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.561036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.561175 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.561307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.561436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.561565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.561694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.561823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.561960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.562091 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.562221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.562349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.562478 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.562616 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.562756 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.562886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.563015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.563144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.563273 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.563411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.563541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.563670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.563806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.563936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.564065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.564235 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.564368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.564497 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.564636 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.564766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.564894 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.565033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.565164 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.565293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.565422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.565550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.565678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.565816 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.565947 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.566077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.566206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.566334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.566473 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.566611 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.566742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.566872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.567001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.567130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.567259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.567397 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.567527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.567655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.567783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.567912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] resource.caching = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.568040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.568212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.568346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.568474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.568604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.568732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.568866 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.569074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.569208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.569337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.569466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.569595 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.569723 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.569860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.569990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.570133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.570265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.570403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.570533 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.570671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] role.caching = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.570801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] resource.caching = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.570930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] role.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.571058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.571714 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.571852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.571991 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.572163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.572299 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.572431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.572571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.572700 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.572841 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.572972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.573101 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.573231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.573359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.573489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.573627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.573757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.573886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.574015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] role.caching = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.574143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.574280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] role.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.574418 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.574549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.574677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.574807 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.574935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.575064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.575202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.575332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.575461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.575843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.575973 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.576132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.576271 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.576411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.576543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.576672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.576801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.576939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.577070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.577206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.577337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.577466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.577595 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.577732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.577863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.577992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.578131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.578260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.578390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.578390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.578693 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.578824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.578954 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.579083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.579212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.579350 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.579480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.579609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.579739 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.579878 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.580007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.580169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.580305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.580434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.580563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.580692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] token.caching = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.580826 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.580970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.581101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.581231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.581359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.581491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.581629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.581769 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.581907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.582037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.582165 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.582294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.582422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.582560 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.582690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.582826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.582967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.583104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.583247 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.583384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.583531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.583667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.583803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] token.caching = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.583939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.584110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.584257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.584393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.584480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.584542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.584600 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.584685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.584763 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.584835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.584908 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.584979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.connection = **** {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585122 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585274 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585348 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585421 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585791 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.585935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.586007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.586067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.586146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.586221 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.586293 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.586365 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.586437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.586509 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.586594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.586670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.586743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.connection = **** {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.586871 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.587482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.587564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.587625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.587705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.587780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.587852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.587924 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.587996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588068 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588247 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588463 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 08:56:55.588536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.588536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.589134 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.589134 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 08:56:55.589134 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 08:56:55.601176 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.601408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.601632 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.604403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.604748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.605084 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.610324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.613949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.638618 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.638845 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.640825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.641166 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.691788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.692342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.746660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.746824 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.746824 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.747133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.813541 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.813911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.814020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.814214 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.814421 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.814507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.814648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.814865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.814946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.815082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.815341 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.815659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.839334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.839563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.839795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.839888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.840164 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.840257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.840389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.840607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.840759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.840845 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.841146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.841467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.841783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.842101 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.852051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.852718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.866775 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.866909 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.867178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.867278 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.867357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.867514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.867731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.867825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.867946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.868708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79902) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.868870 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.869183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.869479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.869771 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79901) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 08:56:55.886669 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.886898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 08:56:55.887323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.887419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.887513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 08:56:55.887752 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 08:56:55.887849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.888023 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.888263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.888356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.888555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.888645 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 08:56:55.888936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.889263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.889585 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.889906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.899592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.899869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.900153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.901266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.901389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.901849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.901946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.902298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.910335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.910619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.913649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.913928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.914141 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.914235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.914531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.914637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.914858 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.914970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.915144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.915411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.915500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.915686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.915906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.915997 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.916297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.916636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.916739 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.916919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.917079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.917423 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.917768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.918105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.944015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.945660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.945751 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.945936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.948075 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.948442 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.952004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.952304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.952582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.954306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.954659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.955014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.959862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.960160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.962794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.963151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.964824 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.965111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.965392 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.965672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.965943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.966212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.966478 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.966742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.968506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.968869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.969226 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.969582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.969931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.970277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.970618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.970963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.985431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.985705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.989939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.990292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.990519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.994673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.994961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.995662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:55.999451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.999784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:55.999918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.003492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.005038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.007226 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.007527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.007809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.008121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.008386 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.008680 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.009689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.013538 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.013912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.014272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.014630 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.014981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.015338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.030795 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.031209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.031527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.031868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.034807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.035277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.035621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.036026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.040956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.042701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.042972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.044872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.046048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.046330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.046620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.046893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.047034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.047160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.047358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.050529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.050889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.051258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.051615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.051965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.061127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.061404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.061680 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.061956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.062233 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.062501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.062769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.066599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.066959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.067313 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.067668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.068021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.068385 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.068734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.082018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.085432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.088108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.089105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.090708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.091677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.092368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.092646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.093252 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.095353 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.097077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.098799 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.099154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.099529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.100716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.102310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.106087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.106374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.106659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.106933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.108052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.109761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.113106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.113471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.113828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.114177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.116163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.116438 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.116726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.124323 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.124696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.125052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.125422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79902) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.125699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.125976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.126258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.126536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.126804 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.127075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.127355 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.127621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.127893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.128190 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.128447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.128710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.128978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79902) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.134118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79901) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 08:56:56.134472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.134823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.135186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.135530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.135872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.136237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.136582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.136934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.137272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.137630 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.137960 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.138293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.138629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79901) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 08:56:56.168452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558cf20b19c0 pid: 79902 (default app) May 03 08:56:56.171798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451015e7-b343-4bb1-a054-33e929a55631 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:56:56.172112 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451015e7-b343-4bb1-a054-33e929a55631 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:56:56.172389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451015e7-b343-4bb1-a054-33e929a55631 None None] PATH_INFO: `/v3` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:56:56.179608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Tue May 3 08:56:56 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:56:56.180203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558cf20b19c0 pid: 79901 (default app) May 03 08:57:04.158946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c8bc1-ff30-422c-b0dd-fac6b86e4339 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:04.159503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c8bc1-ff30-422c-b0dd-fac6b86e4339 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:04.159503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c8bc1-ff30-422c-b0dd-fac6b86e4339 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:04.160853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:04.168081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94275652-f311-4e00-a804-7d48d9548ba0 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:04.168498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94275652-f311-4e00-a804-7d48d9548ba0 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:04.168676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94275652-f311-4e00-a804-7d48d9548ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:04.199288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG oslo_db.sqlalchemy.engines [None req-94275652-f311-4e00-a804-7d48d9548ba0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:57:04.395952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG passlib.handlers.bcrypt [None req-94275652-f311-4e00-a804-7d48d9548ba0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79901) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 08:57:04.396409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG passlib.handlers.bcrypt [None req-94275652-f311-4e00-a804-7d48d9548ba0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79901) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 08:57:04.453066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-94275652-f311-4e00-a804-7d48d9548ba0 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:04.454583 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-94275652-f311-4e00-a804-7d48d9548ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:04.578414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 03 08:57:04.726942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c8bc1-ff30-422c-b0dd-fac6b86e4339 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:04.759778 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG oslo_db.sqlalchemy.engines [None req-c99c8bc1-ff30-422c-b0dd-fac6b86e4339 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 08:57:04.882944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c8bc1-ff30-422c-b0dd-fac6b86e4339 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:04.887247 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdf3dd-61e0-4458-a3be-bdefe45fefc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:04.887896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdf3dd-61e0-4458-a3be-bdefe45fefc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:04.888204 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdf3dd-61e0-4458-a3be-bdefe45fefc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:04.888477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdf3dd-61e0-4458-a3be-bdefe45fefc1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:04.896448 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdf3dd-61e0-4458-a3be-bdefe45fefc1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:04.947755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e2bdf3dd-61e0-4458-a3be-bdefe45fefc1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 08:57:04.948095 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdf3dd-61e0-4458-a3be-bdefe45fefc1 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:04.957892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1324 bytes} [Tue May 3 08:57:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 08:57:04.964658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94275652-f311-4e00-a804-7d48d9548ba0 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:04.980272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94275652-f311-4e00-a804-7d48d9548ba0 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:04.984841 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816758-07b4-4dce-a472-07a95a57a46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:04.986190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816758-07b4-4dce-a472-07a95a57a46a admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:04.986473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816758-07b4-4dce-a472-07a95a57a46a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:04.986745 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816758-07b4-4dce-a472-07a95a57a46a admin admin] PATH_INFO: `/v3/projects/25541cb90a5a4ec5b739da2d1d1355bf` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:04.988285 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5816758-07b4-4dce-a472-07a95a57a46a admin admin] RBAC: Authorizing `identity:get_project(project_id=25541cb90a5a4ec5b739da2d1d1355bf)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:05.042016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f5816758-07b4-4dce-a472-07a95a57a46a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 08:57:05.042342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5816758-07b4-4dce-a472-07a95a57a46a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:05.047218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 2/5] 10.222.0.23 () {56 vars in 1207 bytes} [Tue May 3 08:57:04 2022] GET /identity/v3/projects/25541cb90a5a4ec5b739da2d1d1355bf => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:07.268815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725adc6-bab2-4f0b-af46-94a309dec9be None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:07.269328 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725adc6-bab2-4f0b-af46-94a309dec9be None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:07.269422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725adc6-bab2-4f0b-af46-94a309dec9be None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:07.273391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 4/6] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:07.279273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd8991-b884-492a-b64f-7494a97f53eb None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:07.279699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd8991-b884-492a-b64f-7494a97f53eb None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:07.279965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd8991-b884-492a-b64f-7494a97f53eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:07.300328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-cebd8991-b884-492a-b64f-7494a97f53eb None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:07.301836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-cebd8991-b884-492a-b64f-7494a97f53eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:07.309733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 03 08:57:07.331969 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725adc6-bab2-4f0b-af46-94a309dec9be None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:07.344214 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725adc6-bab2-4f0b-af46-94a309dec9be None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:07.348343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062f67b-8176-4f0e-b376-0a89d3499782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:07.348963 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062f67b-8176-4f0e-b376-0a89d3499782 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:07.349241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062f67b-8176-4f0e-b376-0a89d3499782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:07.349511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062f67b-8176-4f0e-b376-0a89d3499782 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:07.357599 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062f67b-8176-4f0e-b376-0a89d3499782 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:07.359352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062f67b-8176-4f0e-b376-0a89d3499782 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:07.367743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1324 bytes} [Tue May 3 08:57:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 08:57:07.373199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd8991-b884-492a-b64f-7494a97f53eb None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:07.382013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd8991-b884-492a-b64f-7494a97f53eb None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:07.386872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e458f-05f5-4d21-a7f2-14ac1d04d316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:07.387732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e458f-05f5-4d21-a7f2-14ac1d04d316 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:07.388014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e458f-05f5-4d21-a7f2-14ac1d04d316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:07.388323 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e458f-05f5-4d21-a7f2-14ac1d04d316 admin admin] PATH_INFO: `/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:07.389708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e458f-05f5-4d21-a7f2-14ac1d04d316 admin admin] RBAC: Authorizing `identity:get_user(user_id=1486f7b27bfb4a6a89f2d831ec8cd6c7)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:07.391507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e458f-05f5-4d21-a7f2-14ac1d04d316 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:07.393086 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 4/9] 10.222.0.23 () {56 vars in 1198 bytes} [Tue May 3 08:57:07 2022] GET /identity/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:09.703238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af4934-237e-4d2a-9e44-8fba2591cead None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:09.703741 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af4934-237e-4d2a-9e44-8fba2591cead None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:09.703843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af4934-237e-4d2a-9e44-8fba2591cead None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:09.705364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:09.710111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970a445-85a2-4e89-9c64-b17d968b5ebb None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:09.710481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970a445-85a2-4e89-9c64-b17d968b5ebb None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:09.710652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970a445-85a2-4e89-9c64-b17d968b5ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:09.824311 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20314425-e4c2-4ab1-b90f-b25ac3cb41db None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:09.824631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20314425-e4c2-4ab1-b90f-b25ac3cb41db None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:09.824869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20314425-e4c2-4ab1-b90f-b25ac3cb41db None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:09.826480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 7/11] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:09.831662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf7d22-29a0-4e5f-82e5-3a201e7be0e8 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:09.831944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf7d22-29a0-4e5f-82e5-3a201e7be0e8 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:09.832313 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf7d22-29a0-4e5f-82e5-3a201e7be0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:09.837974 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-1970a445-85a2-4e89-9c64-b17d968b5ebb None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:09.839170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1970a445-85a2-4e89-9c64-b17d968b5ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:09.870977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG passlib.handlers.bcrypt [None req-0bdf7d22-29a0-4e5f-82e5-3a201e7be0e8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79902) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 08:57:09.871410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG passlib.handlers.bcrypt [None req-0bdf7d22-29a0-4e5f-82e5-3a201e7be0e8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79902) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 08:57:09.916889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 5/12] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:09.918474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-0bdf7d22-29a0-4e5f-82e5-3a201e7be0e8 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:09.920032 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0bdf7d22-29a0-4e5f-82e5-3a201e7be0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:09.939516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970a445-85a2-4e89-9c64-b17d968b5ebb None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:10.023921 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 8/13] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:10.039688 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970a445-85a2-4e89-9c64-b17d968b5ebb None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:10.045820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf7d22-29a0-4e5f-82e5-3a201e7be0e8 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:10.073501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675193d-53b5-4232-b9c4-0bd2ea5f649a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:10.074290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675193d-53b5-4232-b9c4-0bd2ea5f649a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:10.074572 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675193d-53b5-4232-b9c4-0bd2ea5f649a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:10.074997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675193d-53b5-4232-b9c4-0bd2ea5f649a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:10.086187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675193d-53b5-4232-b9c4-0bd2ea5f649a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-1675193d-53b5-4232-b9c4-0bd2ea5f649a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:10.097443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:10.098451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:10.099277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:10.099277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:10.099277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:10.099277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:10.099277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:10.099277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:10.099277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:10.099277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:10.099277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:10.099277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:10.099277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:10.099277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:10.103996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 6/14] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:57:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:10.104834 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675193d-53b5-4232-b9c4-0bd2ea5f649a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:10.145588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf7d22-29a0-4e5f-82e5-3a201e7be0e8 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:10.178821 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2550-97c5-46c3-8597-d11c08e2c8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:10.179720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2550-97c5-46c3-8597-d11c08e2c8bb None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:10.180005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2550-97c5-46c3-8597-d11c08e2c8bb None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:10.180314 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2550-97c5-46c3-8597-d11c08e2c8bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:10.201247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675193d-53b5-4232-b9c4-0bd2ea5f649a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:10.234707 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b36f21-6ac4-4a7c-9cbc-ea2cb12b1c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:10.235498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b36f21-6ac4-4a7c-9cbc-ea2cb12b1c8b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:10.235678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b36f21-6ac4-4a7c-9cbc-ea2cb12b1c8b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:10.235921 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b36f21-6ac4-4a7c-9cbc-ea2cb12b1c8b None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:10.236733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b36f21-6ac4-4a7c-9cbc-ea2cb12b1c8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:10.237038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b36f21-6ac4-4a7c-9cbc-ea2cb12b1c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:10.238485 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b36f21-6ac4-4a7c-9cbc-ea2cb12b1c8b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:10.250633 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 7/15] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:10.251968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2550-97c5-46c3-8597-d11c08e2c8bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:10.253528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2550-97c5-46c3-8597-d11c08e2c8bb None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:10.257019 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b36f21-6ac4-4a7c-9cbc-ea2cb12b1c8b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:10.347877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:57:10.353858 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2550-97c5-46c3-8597-d11c08e2c8bb None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:10.357345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b36f21-6ac4-4a7c-9cbc-ea2cb12b1c8b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:10.391026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190621c-b14a-446e-9965-13f48f6a272a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:10.391889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190621c-b14a-446e-9965-13f48f6a272a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:10.392194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190621c-b14a-446e-9965-13f48f6a272a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:10.392472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190621c-b14a-446e-9965-13f48f6a272a None admin] PATH_INFO: `/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:10.393684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190621c-b14a-446e-9965-13f48f6a272a None admin] RBAC: Authorizing `identity:get_user(user_id=1486f7b27bfb4a6a89f2d831ec8cd6c7)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:10.395142 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190621c-b14a-446e-9965-13f48f6a272a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:10.396771 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 8/17] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:10 2022] GET /identity/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:10.402471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190621c-b14a-446e-9965-13f48f6a272a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:10.452371 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2550-97c5-46c3-8597-d11c08e2c8bb None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:10.483894 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234f69a-80d7-4fdb-9a0c-df70714570e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:10.484711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234f69a-80d7-4fdb-9a0c-df70714570e4 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:10.484994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234f69a-80d7-4fdb-9a0c-df70714570e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:10.485267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234f69a-80d7-4fdb-9a0c-df70714570e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:10.498297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190621c-b14a-446e-9965-13f48f6a272a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:10.536171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0b0a2-fd74-49f9-8547-a622458810a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:10.536988 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b0a2-fd74-49f9-8547-a622458810a9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:10.537275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b0a2-fd74-49f9-8547-a622458810a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:10.537548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b0a2-fd74-49f9-8547-a622458810a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:10.538833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0b0a2-fd74-49f9-8547-a622458810a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:10.540408 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0b0a2-fd74-49f9-8547-a622458810a9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:10.542305 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:10.547963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0b0a2-fd74-49f9-8547-a622458810a9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:10.610628 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234f69a-80d7-4fdb-9a0c-df70714570e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:10.612012 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234f69a-80d7-4fdb-9a0c-df70714570e4 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-8234f69a-80d7-4fdb-9a0c-df70714570e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:57:10.632435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:10.633303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:10.634606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:57:10.634606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:57:10.634606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:57:10.634606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:10.634606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:10.640742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234f69a-80d7-4fdb-9a0c-df70714570e4 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:10.652696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0b0a2-fd74-49f9-8547-a622458810a9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:10.684809 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e5c25-98fb-469f-afac-044fae7730e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:10.685458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e5c25-98fb-469f-afac-044fae7730e1 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:10.685744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e5c25-98fb-469f-afac-044fae7730e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:10.686022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e5c25-98fb-469f-afac-044fae7730e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:10.686854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e5c25-98fb-469f-afac-044fae7730e1 None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.domain.id=default, user.id=1486f7b27bfb4a6a89f2d831ec8cd6c7) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:10.687169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e5c25-98fb-469f-afac-044fae7730e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:10.688653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e5c25-98fb-469f-afac-044fae7730e1 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:10.695351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1322 bytes} [Tue May 3 08:57:10 2022] GET /identity/v3/role_assignments?user.id=1486f7b27bfb4a6a89f2d831ec8cd6c7&scope.domain.id=default&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:10.738917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234f69a-80d7-4fdb-9a0c-df70714570e4 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:10.774624 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec5f83-5a10-4ddb-b906-81cd7b8fb4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:10.775298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec5f83-5a10-4ddb-b906-81cd7b8fb4c5 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:10.775587 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec5f83-5a10-4ddb-b906-81cd7b8fb4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:10.775844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec5f83-5a10-4ddb-b906-81cd7b8fb4c5 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:10.776614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec5f83-5a10-4ddb-b906-81cd7b8fb4c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:10.776918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec5f83-5a10-4ddb-b906-81cd7b8fb4c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:10.778340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec5f83-5a10-4ddb-b906-81cd7b8fb4c5 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:10.797795 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:13.770506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22911440-9f34-4388-a8e6-fb741af37311 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:13.771012 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22911440-9f34-4388-a8e6-fb741af37311 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:13.771116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22911440-9f34-4388-a8e6-fb741af37311 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:13.772586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:13.778568 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1bb9-98cc-46ea-84be-e21fb61761ac None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:13.778961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1bb9-98cc-46ea-84be-e21fb61761ac None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:13.779122 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1bb9-98cc-46ea-84be-e21fb61761ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:13.813241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f9aa1bb9-98cc-46ea-84be-e21fb61761ac None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:13.814441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f9aa1bb9-98cc-46ea-84be-e21fb61761ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:13.901159 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:13.935838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22911440-9f34-4388-a8e6-fb741af37311 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:14.021902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5fd4d-a702-4e8a-a953-a7bbaefbf585 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:14.022397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5fd4d-a702-4e8a-a953-a7bbaefbf585 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:14.022815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5fd4d-a702-4e8a-a953-a7bbaefbf585 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:14.032234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:14.036892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec273c0f-5e31-4af9-a273-dc6c438b9d93 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:14.037383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec273c0f-5e31-4af9-a273-dc6c438b9d93 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:14.037822 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec273c0f-5e31-4af9-a273-dc6c438b9d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:14.054360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22911440-9f34-4388-a8e6-fb741af37311 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:14.072941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ec273c0f-5e31-4af9-a273-dc6c438b9d93 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:14.074152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ec273c0f-5e31-4af9-a273-dc6c438b9d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:14.127838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf2b4d-3e31-4d2a-94a3-e8e9ab8cbd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:14.128657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf2b4d-3e31-4d2a-94a3-e8e9ab8cbd10 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:14.128936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf2b4d-3e31-4d2a-94a3-e8e9ab8cbd10 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:14.129204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf2b4d-3e31-4d2a-94a3-e8e9ab8cbd10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:14.157622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf2b4d-3e31-4d2a-94a3-e8e9ab8cbd10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-e3cf2b4d-3e31-4d2a-94a3-e8e9ab8cbd10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:14.169722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:14.170588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:14.171321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:14.171321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:14.171321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:14.171321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:14.171321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:14.171321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:14.171321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:14.171321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:14.171321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:14.171321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:14.171321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:14.171321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:14.176244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 12/25] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:57:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:14.177117 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf2b4d-3e31-4d2a-94a3-e8e9ab8cbd10 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:14.199569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:14.237585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec273c0f-5e31-4af9-a273-dc6c438b9d93 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:14.359674 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf2b4d-3e31-4d2a-94a3-e8e9ab8cbd10 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:14.378878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec273c0f-5e31-4af9-a273-dc6c438b9d93 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:14.399700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030e387-3b3d-4a68-9862-dadfe4ec4f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:14.400381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030e387-3b3d-4a68-9862-dadfe4ec4f43 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:14.400662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030e387-3b3d-4a68-9862-dadfe4ec4f43 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:14.400933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030e387-3b3d-4a68-9862-dadfe4ec4f43 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:14.401687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030e387-3b3d-4a68-9862-dadfe4ec4f43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:14.401990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030e387-3b3d-4a68-9862-dadfe4ec4f43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:14.403380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030e387-3b3d-4a68-9862-dadfe4ec4f43 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:14.419172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9c10f-900e-45f0-8110-3f7784befcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:14.419777 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 13/27] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:14.420740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c10f-900e-45f0-8110-3f7784befcc1 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:14.422205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f480c-60ec-4806-928d-2ce51c7ed841 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:14.422634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c10f-900e-45f0-8110-3f7784befcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:14.423054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c10f-900e-45f0-8110-3f7784befcc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:14.424063 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f480c-60ec-4806-928d-2ce51c7ed841 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:14.424511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f480c-60ec-4806-928d-2ce51c7ed841 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:14.426146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 14/28] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:14.428971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f480c-60ec-4806-928d-2ce51c7ed841 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:14.436779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9c10f-900e-45f0-8110-3f7784befcc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:14.438456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9c10f-900e-45f0-8110-3f7784befcc1 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-6af9c10f-900e-45f0-8110-3f7784befcc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:57:14.470057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:14.470902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:14.471788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:57:14.471788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:57:14.471788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:57:14.471788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:14.474180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 15/29] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:14.475820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5497396-0cb2-4d30-8cdb-9393f2127410 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:14.476333 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5497396-0cb2-4d30-8cdb-9393f2127410 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:14.476806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5497396-0cb2-4d30-8cdb-9393f2127410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:14.504209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f5497396-0cb2-4d30-8cdb-9393f2127410 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:14.505743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f5497396-0cb2-4d30-8cdb-9393f2127410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:14.543423 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f480c-60ec-4806-928d-2ce51c7ed841 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:14.596983 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed762fc0-67d5-4064-b4e3-886cb0557d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:14.598953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed762fc0-67d5-4064-b4e3-886cb0557d64 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:14.599592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed762fc0-67d5-4064-b4e3-886cb0557d64 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:14.601191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed762fc0-67d5-4064-b4e3-886cb0557d64 None admin] PATH_INFO: `/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:14.603400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed762fc0-67d5-4064-b4e3-886cb0557d64 None admin] RBAC: Authorizing `identity:get_user(user_id=1486f7b27bfb4a6a89f2d831ec8cd6c7)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:14.607636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed762fc0-67d5-4064-b4e3-886cb0557d64 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:14.609533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:14 2022] GET /identity/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:14.611454 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed762fc0-67d5-4064-b4e3-886cb0557d64 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:14.645833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 16/31] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:14.647177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5497396-0cb2-4d30-8cdb-9393f2127410 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:14.774182 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed762fc0-67d5-4064-b4e3-886cb0557d64 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:14.832663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52038ba0-3002-4a4c-b1de-3e7c1ceb9058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:14.833688 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52038ba0-3002-4a4c-b1de-3e7c1ceb9058 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:14.834184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52038ba0-3002-4a4c-b1de-3e7c1ceb9058 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:14.834669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52038ba0-3002-4a4c-b1de-3e7c1ceb9058 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:14.835611 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52038ba0-3002-4a4c-b1de-3e7c1ceb9058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:14.836145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52038ba0-3002-4a4c-b1de-3e7c1ceb9058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:14.837749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52038ba0-3002-4a4c-b1de-3e7c1ceb9058 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:14.838043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5497396-0cb2-4d30-8cdb-9393f2127410 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:14.869396 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 16/32] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:14.870779 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52038ba0-3002-4a4c-b1de-3e7c1ceb9058 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:14.953357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb9e6d-848e-4567-9174-6a10fc5bf53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:14.954550 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb9e6d-848e-4567-9174-6a10fc5bf53c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:14.955049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb9e6d-848e-4567-9174-6a10fc5bf53c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:14.955536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb9e6d-848e-4567-9174-6a10fc5bf53c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:14.957211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb9e6d-848e-4567-9174-6a10fc5bf53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:14.958857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb9e6d-848e-4567-9174-6a10fc5bf53c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:14.969142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 17/33] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:14.970201 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb9e6d-848e-4567-9174-6a10fc5bf53c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:15.017859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52038ba0-3002-4a4c-b1de-3e7c1ceb9058 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:15.077650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144f947-a6f0-47e1-b485-4e4b6c46d74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:15.078572 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144f947-a6f0-47e1-b485-4e4b6c46d74f None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:15.078997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144f947-a6f0-47e1-b485-4e4b6c46d74f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:15.079439 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144f947-a6f0-47e1-b485-4e4b6c46d74f None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:15.080373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144f947-a6f0-47e1-b485-4e4b6c46d74f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:15.081926 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144f947-a6f0-47e1-b485-4e4b6c46d74f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:15.132193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb9e6d-848e-4567-9174-6a10fc5bf53c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:15.193066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb469e2-5170-4158-b9d8-faf2aa08f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:15.193832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb469e2-5170-4158-b9d8-faf2aa08f49e None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:15.194118 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb469e2-5170-4158-b9d8-faf2aa08f49e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:15.194390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb469e2-5170-4158-b9d8-faf2aa08f49e None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:15.195149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb469e2-5170-4158-b9d8-faf2aa08f49e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:15.196700 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb469e2-5170-4158-b9d8-faf2aa08f49e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:15.284258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 17/34] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 3 08:57:14 2022] POST /identity/v3/roles => generated 219 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:57:15.285495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144f947-a6f0-47e1-b485-4e4b6c46d74f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:15.382407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 18/35] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 08:57:14 2022] POST /identity/v3/projects => generated 301 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:57:15.384041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb91e1-15e6-4f8d-8849-b0cccafa2fb9 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:15.388330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb91e1-15e6-4f8d-8849-b0cccafa2fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:15.388749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb91e1-15e6-4f8d-8849-b0cccafa2fb9 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:15.390239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:15.409360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0186b6-f11c-4d70-a79a-bfcbcf704414 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:15.409971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0186b6-f11c-4d70-a79a-bfcbcf704414 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:15.410448 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0186b6-f11c-4d70-a79a-bfcbcf704414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:15.431945 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144f947-a6f0-47e1-b485-4e4b6c46d74f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:15.444218 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-6a0186b6-f11c-4d70-a79a-bfcbcf704414 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:15.445873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6a0186b6-f11c-4d70-a79a-bfcbcf704414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:15.479046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9989b-4ca7-448c-afc0-bedec55d5771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:15.480241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9989b-4ca7-448c-afc0-bedec55d5771 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:15.480697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9989b-4ca7-448c-afc0-bedec55d5771 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:15.481125 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9989b-4ca7-448c-afc0-bedec55d5771 None admin] PATH_INFO: `/v3/domains/default/users/1486f7b27bfb4a6a89f2d831ec8cd6c7/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:15.483760 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9989b-4ca7-448c-afc0-bedec55d5771 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1486f7b27bfb4a6a89f2d831ec8cd6c7, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:15.485670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9989b-4ca7-448c-afc0-bedec55d5771 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:15.524835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 18/37] 10.222.0.23 () {58 vars in 1361 bytes} [Tue May 3 08:57:15 2022] PUT /identity/v3/domains/default/users/1486f7b27bfb4a6a89f2d831ec8cd6c7/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:57:15.570893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353ba66-a36f-4701-a649-7644e07a690c None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:15.571744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353ba66-a36f-4701-a649-7644e07a690c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:15.572449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353ba66-a36f-4701-a649-7644e07a690c None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:15.574473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 19/38] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:15.582130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3efe4a-2929-4b49-b97e-30221d30d324 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:15.582667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3efe4a-2929-4b49-b97e-30221d30d324 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:15.583090 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3efe4a-2929-4b49-b97e-30221d30d324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:15.593417 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 20/39] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:15.617092 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8c3efe4a-2929-4b49-b97e-30221d30d324 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:15.619007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8c3efe4a-2929-4b49-b97e-30221d30d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:15.657077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0186b6-f11c-4d70-a79a-bfcbcf704414 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:15.745524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 20/40] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:15.779032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3efe4a-2929-4b49-b97e-30221d30d324 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:15.820192 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0186b6-f11c-4d70-a79a-bfcbcf704414 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:15.889503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e4254-86bb-4e47-bccb-79d3208c51e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:15.890923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e4254-86bb-4e47-bccb-79d3208c51e8 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:15.891393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e4254-86bb-4e47-bccb-79d3208c51e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:15.891806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e4254-86bb-4e47-bccb-79d3208c51e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:15.892736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e4254-86bb-4e47-bccb-79d3208c51e8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:15.894381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e4254-86bb-4e47-bccb-79d3208c51e8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:15.905589 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3efe4a-2929-4b49-b97e-30221d30d324 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:15.927494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 3 08:57:15 2022] POST /identity/v3/roles => generated 223 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:57:15.952194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3411de-aac3-4722-b1ae-629727a16973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:15.952194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3411de-aac3-4722-b1ae-629727a16973 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:15.952461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3411de-aac3-4722-b1ae-629727a16973 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:15.952624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3411de-aac3-4722-b1ae-629727a16973 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:15.953403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3411de-aac3-4722-b1ae-629727a16973 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:15.955759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3411de-aac3-4722-b1ae-629727a16973 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:15.980359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 3 08:57:15 2022] POST /identity/v3/roles => generated 225 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:57:16.364117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98bab9-84e3-4dc4-8e71-a690267fbb28 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:16.364476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98bab9-84e3-4dc4-8e71-a690267fbb28 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:16.364701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98bab9-84e3-4dc4-8e71-a690267fbb28 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:16.366179 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 22/43] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:16.371130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38067d45-20e6-48ad-8c08-2e62336e510b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:16.371420 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38067d45-20e6-48ad-8c08-2e62336e510b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:16.371695 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38067d45-20e6-48ad-8c08-2e62336e510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:16.388453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-38067d45-20e6-48ad-8c08-2e62336e510b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:16.389625 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-38067d45-20e6-48ad-8c08-2e62336e510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:16.452337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 22/44] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:16.475745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98bab9-84e3-4dc4-8e71-a690267fbb28 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:16.576339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98bab9-84e3-4dc4-8e71-a690267fbb28 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:16.608347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef389d-c004-4bd5-bc19-348f2ca611be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:16.609149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef389d-c004-4bd5-bc19-348f2ca611be None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:16.609431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef389d-c004-4bd5-bc19-348f2ca611be None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:16.609704 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef389d-c004-4bd5-bc19-348f2ca611be None admin] PATH_INFO: `/v3/domains/default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:16.610856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef389d-c004-4bd5-bc19-348f2ca611be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:16.612333 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef389d-c004-4bd5-bc19-348f2ca611be None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:16.614093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 23/45] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:16.619379 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38067d45-20e6-48ad-8c08-2e62336e510b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:16.713741 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38067d45-20e6-48ad-8c08-2e62336e510b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:16.745341 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0ec21-f303-445e-a193-dc06c2d015e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:16.745925 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0ec21-f303-445e-a193-dc06c2d015e0 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:16.746206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0ec21-f303-445e-a193-dc06c2d015e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:16.746479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0ec21-f303-445e-a193-dc06c2d015e0 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:16.747189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0ec21-f303-445e-a193-dc06c2d015e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:16.748669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0ec21-f303-445e-a193-dc06c2d015e0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:16.774514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 08:57:16 2022] POST /identity/v3/projects => generated 312 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:57:18.130348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293b73-4d26-43a4-818d-0c52bb9e069e None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:18.130854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293b73-4d26-43a4-818d-0c52bb9e069e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:18.130963 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293b73-4d26-43a4-818d-0c52bb9e069e None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:18.132311 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:18.137890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf760d8-c8d0-4740-beda-cbfd7d022170 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:18.138292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf760d8-c8d0-4740-beda-cbfd7d022170 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:18.138448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf760d8-c8d0-4740-beda-cbfd7d022170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:18.155289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-abf760d8-c8d0-4740-beda-cbfd7d022170 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:18.156493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-abf760d8-c8d0-4740-beda-cbfd7d022170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:18.219168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:18.242123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7293b73-4d26-43a4-818d-0c52bb9e069e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:18.338675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7293b73-4d26-43a4-818d-0c52bb9e069e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:18.370163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8fdee-b191-4402-a466-69405e2144ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:18.371211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8fdee-b191-4402-a466-69405e2144ce None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:18.371712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8fdee-b191-4402-a466-69405e2144ce None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:18.372212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8fdee-b191-4402-a466-69405e2144ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:18.384112 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8fdee-b191-4402-a466-69405e2144ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-84f8fdee-b191-4402-a466-69405e2144ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:18.392920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:18.393799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:18.394556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:18.394556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:18.394556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:18.394556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:18.394556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:18.394556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:18.394556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:18.394556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:18.394556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:18.394556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:18.394556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:18.394556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:18.400835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 25/49] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:57:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:18.401994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf760d8-c8d0-4740-beda-cbfd7d022170 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:18.498918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf760d8-c8d0-4740-beda-cbfd7d022170 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:18.531929 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf33e6-b8ae-4cca-a728-82cc275f555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:18.532567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf33e6-b8ae-4cca-a728-82cc275f555d None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:18.532848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf33e6-b8ae-4cca-a728-82cc275f555d None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:18.533118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf33e6-b8ae-4cca-a728-82cc275f555d None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:18.533863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf33e6-b8ae-4cca-a728-82cc275f555d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:18.534165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf33e6-b8ae-4cca-a728-82cc275f555d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:18.535535 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf33e6-b8ae-4cca-a728-82cc275f555d None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:18.547852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 25/50] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:18.549053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8fdee-b191-4402-a466-69405e2144ce None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:18.645182 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8fdee-b191-4402-a466-69405e2144ce None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:18.676452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44fcf2-9693-402b-9c78-d253f4ceb252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:18.677337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44fcf2-9693-402b-9c78-d253f4ceb252 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:18.677622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44fcf2-9693-402b-9c78-d253f4ceb252 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:18.677899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44fcf2-9693-402b-9c78-d253f4ceb252 None admin] PATH_INFO: `/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:18.679337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44fcf2-9693-402b-9c78-d253f4ceb252 None admin] RBAC: Authorizing `identity:get_user(user_id=1486f7b27bfb4a6a89f2d831ec8cd6c7)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:18.681390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44fcf2-9693-402b-9c78-d253f4ceb252 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:18.683189 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 26/51] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:18 2022] GET /identity/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:18.688434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf33e6-b8ae-4cca-a728-82cc275f555d None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:18.781558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf33e6-b8ae-4cca-a728-82cc275f555d None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:18.813367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a23c22-80ed-4acf-a18c-1bec031fed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:18.814155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a23c22-80ed-4acf-a18c-1bec031fed3b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:18.814441 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a23c22-80ed-4acf-a18c-1bec031fed3b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:18.814714 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a23c22-80ed-4acf-a18c-1bec031fed3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:18.815956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a23c22-80ed-4acf-a18c-1bec031fed3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:18.817429 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a23c22-80ed-4acf-a18c-1bec031fed3b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:18.819187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 26/52] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:18.824856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44fcf2-9693-402b-9c78-d253f4ceb252 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:18.923795 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44fcf2-9693-402b-9c78-d253f4ceb252 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:18.955526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca2031-bc03-4fe0-a8f0-cfeb7313f110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:18.956210 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca2031-bc03-4fe0-a8f0-cfeb7313f110 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:18.956540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca2031-bc03-4fe0-a8f0-cfeb7313f110 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:18.956816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca2031-bc03-4fe0-a8f0-cfeb7313f110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:18.957637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca2031-bc03-4fe0-a8f0-cfeb7313f110 None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.domain.id=default, user.id=1486f7b27bfb4a6a89f2d831ec8cd6c7) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:18.957944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca2031-bc03-4fe0-a8f0-cfeb7313f110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:18.959361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca2031-bc03-4fe0-a8f0-cfeb7313f110 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:18.968472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1322 bytes} [Tue May 3 08:57:18 2022] GET /identity/v3/role_assignments?user.id=1486f7b27bfb4a6a89f2d831ec8cd6c7&scope.domain.id=default&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:19.040602 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc860a-e2ad-4bec-a8ec-7ff2c2ca7a17 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:19.040930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc860a-e2ad-4bec-a8ec-7ff2c2ca7a17 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:19.041176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc860a-e2ad-4bec-a8ec-7ff2c2ca7a17 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:19.042743 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 27/54] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:19.048229 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b9a30-39dd-4ddc-bbd5-02ce31ca8768 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:19.048528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b9a30-39dd-4ddc-bbd5-02ce31ca8768 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:19.048809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b9a30-39dd-4ddc-bbd5-02ce31ca8768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:19.066565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ab5b9a30-39dd-4ddc-bbd5-02ce31ca8768 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:19.067788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ab5b9a30-39dd-4ddc-bbd5-02ce31ca8768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:19.137695 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 28/55] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:19.161291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc860a-e2ad-4bec-a8ec-7ff2c2ca7a17 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:19.268065 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc860a-e2ad-4bec-a8ec-7ff2c2ca7a17 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:19.298612 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7641-0c1a-4e2b-aa49-764dd8cc6343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:19.299393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7641-0c1a-4e2b-aa49-764dd8cc6343 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:19.299682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7641-0c1a-4e2b-aa49-764dd8cc6343 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:19.299978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7641-0c1a-4e2b-aa49-764dd8cc6343 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:19.301163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff7641-0c1a-4e2b-aa49-764dd8cc6343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:19.302605 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff7641-0c1a-4e2b-aa49-764dd8cc6343 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:19.304223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 28/56] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:19.310277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b9a30-39dd-4ddc-bbd5-02ce31ca8768 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:19.401893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b9a30-39dd-4ddc-bbd5-02ce31ca8768 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:19.439640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdee69-7fb6-4efe-b283-bc3d067acef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:19.440329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdee69-7fb6-4efe-b283-bc3d067acef3 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:19.440617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdee69-7fb6-4efe-b283-bc3d067acef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:19.440895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdee69-7fb6-4efe-b283-bc3d067acef3 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:19.441614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdee69-7fb6-4efe-b283-bc3d067acef3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:19.443072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdee69-7fb6-4efe-b283-bc3d067acef3 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:19.466759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 29/57] 10.222.0.23 () {60 vars in 1140 bytes} [Tue May 3 08:57:19 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:57:21.706317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c4133-b395-4e56-996d-348b33f6b124 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:21.706846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c4133-b395-4e56-996d-348b33f6b124 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:21.706846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c4133-b395-4e56-996d-348b33f6b124 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:21.708266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 29/58] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:21.713946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594127-e81d-4c68-8943-1f89c14973cc None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:21.714357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594127-e81d-4c68-8943-1f89c14973cc None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:21.714496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594127-e81d-4c68-8943-1f89c14973cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:21.730657 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-60594127-e81d-4c68-8943-1f89c14973cc None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:21.731804 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-60594127-e81d-4c68-8943-1f89c14973cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:21.793260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 30/59] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:21.817544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c4133-b395-4e56-996d-348b33f6b124 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:21.914784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c4133-b395-4e56-996d-348b33f6b124 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:21.945585 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ae244-5fa1-4ee7-80f6-200a996c6051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:21.946927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ae244-5fa1-4ee7-80f6-200a996c6051 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:21.947209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ae244-5fa1-4ee7-80f6-200a996c6051 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:21.947480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ae244-5fa1-4ee7-80f6-200a996c6051 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:21.948742 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ae244-5fa1-4ee7-80f6-200a996c6051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:21.950193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ae244-5fa1-4ee7-80f6-200a996c6051 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:21.952283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 30/60] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:21.957818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60594127-e81d-4c68-8943-1f89c14973cc None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:22.047970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60594127-e81d-4c68-8943-1f89c14973cc None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:22.080072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798b08a-cb5e-4792-86f4-ca47b7595202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:22.080761 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798b08a-cb5e-4792-86f4-ca47b7595202 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:22.081042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798b08a-cb5e-4792-86f4-ca47b7595202 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:22.081317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798b08a-cb5e-4792-86f4-ca47b7595202 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:22.082029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798b08a-cb5e-4792-86f4-ca47b7595202 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:22.083460 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798b08a-cb5e-4792-86f4-ca47b7595202 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:22.108759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 31/61] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:57:21 2022] POST /identity/v3/users => generated 275 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:57:25.347480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a847a9-a66b-4320-8a8a-36c080ad8afe None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:25.348501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a847a9-a66b-4320-8a8a-36c080ad8afe None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:25.349067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a847a9-a66b-4320-8a8a-36c080ad8afe None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:25.350941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 31/62] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:25.356482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6713451-7343-4b38-bbfa-9c79235d5f02 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:25.357307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6713451-7343-4b38-bbfa-9c79235d5f02 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:25.357785 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6713451-7343-4b38-bbfa-9c79235d5f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:25.375584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-c6713451-7343-4b38-bbfa-9c79235d5f02 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:25.381202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c6713451-7343-4b38-bbfa-9c79235d5f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:25.423702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d6f56-f62e-458a-9553-08a850d15d80 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:25.424003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d6f56-f62e-458a-9553-08a850d15d80 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:25.424288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d6f56-f62e-458a-9553-08a850d15d80 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:25.428555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:25.439710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e887c-4bb7-4554-98c5-e39fc6a87cdc None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:25.440020 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e887c-4bb7-4554-98c5-e39fc6a87cdc None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:25.440351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e887c-4bb7-4554-98c5-e39fc6a87cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:25.469859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-531e887c-4bb7-4554-98c5-e39fc6a87cdc None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:25.471060 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-531e887c-4bb7-4554-98c5-e39fc6a87cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:25.482070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 32/64] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:25.503939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6713451-7343-4b38-bbfa-9c79235d5f02 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:25.574141 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 33/65] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:25.617836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e887c-4bb7-4554-98c5-e39fc6a87cdc None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:25.639501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6713451-7343-4b38-bbfa-9c79235d5f02 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:25.705412 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772d3b3-3195-48f1-8385-e402145629b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:25.706337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772d3b3-3195-48f1-8385-e402145629b3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:25.706622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772d3b3-3195-48f1-8385-e402145629b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:25.707209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772d3b3-3195-48f1-8385-e402145629b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:25.718524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772d3b3-3195-48f1-8385-e402145629b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-a772d3b3-3195-48f1-8385-e402145629b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:25.727224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:25.728167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:25.729440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 33/66] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:57:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:25.734436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772d3b3-3195-48f1-8385-e402145629b3 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:25.802246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e887c-4bb7-4554-98c5-e39fc6a87cdc None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:25.851648 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812950d-e8f6-41b3-9b1a-08252e3b633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:25.854898 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812950d-e8f6-41b3-9b1a-08252e3b633b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:25.855845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812950d-e8f6-41b3-9b1a-08252e3b633b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:25.856498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812950d-e8f6-41b3-9b1a-08252e3b633b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:25.871252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812950d-e8f6-41b3-9b1a-08252e3b633b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-2812950d-e8f6-41b3-9b1a-08252e3b633b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:25.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:25.882289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:25.883041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:25.883041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:25.883041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:25.883041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:25.883041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:25.883041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:25.883041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:25.883041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:25.883041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:25.883041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:25.883041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:25.883041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:25.886205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 34/67] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:25.887069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772d3b3-3195-48f1-8385-e402145629b3 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:25.894740 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812950d-e8f6-41b3-9b1a-08252e3b633b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:25.955648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b5429-3a9c-4f3d-88ab-c65e8ee9bd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:25.956348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b5429-3a9c-4f3d-88ab-c65e8ee9bd84 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:25.956633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b5429-3a9c-4f3d-88ab-c65e8ee9bd84 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:25.956912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b5429-3a9c-4f3d-88ab-c65e8ee9bd84 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:25.957670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b5429-3a9c-4f3d-88ab-c65e8ee9bd84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:25.957979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b5429-3a9c-4f3d-88ab-c65e8ee9bd84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:25.959372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b5429-3a9c-4f3d-88ab-c65e8ee9bd84 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:25.971476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 34/68] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:25.977016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b5429-3a9c-4f3d-88ab-c65e8ee9bd84 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:26.069409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812950d-e8f6-41b3-9b1a-08252e3b633b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:26.130303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b5429-3a9c-4f3d-88ab-c65e8ee9bd84 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:26.132309 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad5a38-05e6-4f2a-a76a-4e7e0c12e1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:26.132989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad5a38-05e6-4f2a-a76a-4e7e0c12e1ef None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:26.133306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad5a38-05e6-4f2a-a76a-4e7e0c12e1ef None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:26.133578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad5a38-05e6-4f2a-a76a-4e7e0c12e1ef None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:26.134345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad5a38-05e6-4f2a-a76a-4e7e0c12e1ef None admin] RBAC: Adding query filter params (name=member) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:26.134651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad5a38-05e6-4f2a-a76a-4e7e0c12e1ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:26.136049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad5a38-05e6-4f2a-a76a-4e7e0c12e1ef None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:26.149591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:26.155106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad5a38-05e6-4f2a-a76a-4e7e0c12e1ef None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:26.196068 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed05d3e-0d59-4892-bf74-01e0aea7d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:26.197050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed05d3e-0d59-4892-bf74-01e0aea7d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:26.197341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed05d3e-0d59-4892-bf74-01e0aea7d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:26.197617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed05d3e-0d59-4892-bf74-01e0aea7d1d2 None admin] PATH_INFO: `/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:26.198936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed05d3e-0d59-4892-bf74-01e0aea7d1d2 None admin] RBAC: Authorizing `identity:get_user(user_id=1486f7b27bfb4a6a89f2d831ec8cd6c7)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:26.200417 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed05d3e-0d59-4892-bf74-01e0aea7d1d2 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:26.202468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 35/70] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:25 2022] GET /identity/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7 => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:26.209606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed05d3e-0d59-4892-bf74-01e0aea7d1d2 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:26.338021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad5a38-05e6-4f2a-a76a-4e7e0c12e1ef None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:26.376668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e1898-540a-410b-b0b6-2db3e8250397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:26.378197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e1898-540a-410b-b0b6-2db3e8250397 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:26.378622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e1898-540a-410b-b0b6-2db3e8250397 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:26.379030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e1898-540a-410b-b0b6-2db3e8250397 None admin] PATH_INFO: `/v3/users/20992ce0ed594e3f92a948a56437a7c2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:26.386750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed05d3e-0d59-4892-bf74-01e0aea7d1d2 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:26.393732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e1898-540a-410b-b0b6-2db3e8250397 None admin] RBAC: Authorizing `identity:get_user(user_id=20992ce0ed594e3f92a948a56437a7c2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:26.395360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e1898-540a-410b-b0b6-2db3e8250397 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:26.397233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:26 2022] GET /identity/v3/users/20992ce0ed594e3f92a948a56437a7c2 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:26.409270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e1898-540a-410b-b0b6-2db3e8250397 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:26.431478 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c21b5-ca9d-4d22-b742-d0560f1ec9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:26.432400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c21b5-ca9d-4d22-b742-d0560f1ec9bc None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:26.432515 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c21b5-ca9d-4d22-b742-d0560f1ec9bc None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:26.432761 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c21b5-ca9d-4d22-b742-d0560f1ec9bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:26.506465 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c21b5-ca9d-4d22-b742-d0560f1ec9bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:26.507960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c21b5-ca9d-4d22-b742-d0560f1ec9bc None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:26.521028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e1898-540a-410b-b0b6-2db3e8250397 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:26.555752 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb649a0-7831-46fe-8659-e0d06e467ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:26.556696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb649a0-7831-46fe-8659-e0d06e467ee3 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:26.557117 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb649a0-7831-46fe-8659-e0d06e467ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:26.557525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb649a0-7831-46fe-8659-e0d06e467ee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:26.611902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 36/72] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:57:26.617738 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fecf70-3c61-4543-be8c-8704197cc251 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:26.618034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fecf70-3c61-4543-be8c-8704197cc251 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:26.618316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fecf70-3c61-4543-be8c-8704197cc251 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:26.619701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 37/73] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:26.620417 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fecf70-3c61-4543-be8c-8704197cc251 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:26.632161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb649a0-7831-46fe-8659-e0d06e467ee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:26.633982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb649a0-7831-46fe-8659-e0d06e467ee3 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:26.721054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fecf70-3c61-4543-be8c-8704197cc251 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:26.731799 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 37/74] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:57:26.733286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc970419-7f71-4542-abd2-81e10d7fa644 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:26.733715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc970419-7f71-4542-abd2-81e10d7fa644 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:26.734127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc970419-7f71-4542-abd2-81e10d7fa644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:26.751707 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-bc970419-7f71-4542-abd2-81e10d7fa644 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:26.753130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-bc970419-7f71-4542-abd2-81e10d7fa644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:26.756480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9647d7c-f754-4fe2-a132-bb0720f6efa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:26.757243 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9647d7c-f754-4fe2-a132-bb0720f6efa6 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:26.757521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9647d7c-f754-4fe2-a132-bb0720f6efa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:26.757793 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9647d7c-f754-4fe2-a132-bb0720f6efa6 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:26.759048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9647d7c-f754-4fe2-a132-bb0720f6efa6 None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:26.760649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9647d7c-f754-4fe2-a132-bb0720f6efa6 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:26.762509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:26 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:26.763275 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9647d7c-f754-4fe2-a132-bb0720f6efa6 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:26.826421 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 38/76] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:26.827483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc970419-7f71-4542-abd2-81e10d7fa644 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:26.876266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9647d7c-f754-4fe2-a132-bb0720f6efa6 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:26.915509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e75c6-ee79-4dac-828e-4bee81034504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:26.916396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e75c6-ee79-4dac-828e-4bee81034504 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:26.916676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e75c6-ee79-4dac-828e-4bee81034504 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:26.916969 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e75c6-ee79-4dac-828e-4bee81034504 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:26.918160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e75c6-ee79-4dac-828e-4bee81034504 None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:26.919594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e75c6-ee79-4dac-828e-4bee81034504 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:26.921671 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 39/77] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:26 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:26.922579 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1a409-361f-4161-948a-8c15e860f51d None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:26.922872 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1a409-361f-4161-948a-8c15e860f51d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:26.923143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1a409-361f-4161-948a-8c15e860f51d None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:26.924520 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 40/78] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:26.925077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1a409-361f-4161-948a-8c15e860f51d None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:26.941808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc970419-7f71-4542-abd2-81e10d7fa644 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:26.975449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108db123-f97b-4936-b1ee-a93e7a4c915c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:26.976111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108db123-f97b-4936-b1ee-a93e7a4c915c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:26.976401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108db123-f97b-4936-b1ee-a93e7a4c915c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:26.976674 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108db123-f97b-4936-b1ee-a93e7a4c915c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:26.977561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108db123-f97b-4936-b1ee-a93e7a4c915c None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=01616978948a4ea094e1ee9190ac21f2, user.id=1486f7b27bfb4a6a89f2d831ec8cd6c7) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:26.977874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108db123-f97b-4936-b1ee-a93e7a4c915c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:26.979303 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108db123-f97b-4936-b1ee-a93e7a4c915c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:26.984566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 39/79] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:26 2022] GET /identity/v3/role_assignments?user.id=1486f7b27bfb4a6a89f2d831ec8cd6c7&scope.project.id=01616978948a4ea094e1ee9190ac21f2&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:26.985337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108db123-f97b-4936-b1ee-a93e7a4c915c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:27.040673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1a409-361f-4161-948a-8c15e860f51d None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:27.081275 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aee8b2-3c50-4b87-bed6-b84152a659e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:27.082211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aee8b2-3c50-4b87-bed6-b84152a659e5 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:27.082586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aee8b2-3c50-4b87-bed6-b84152a659e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:27.082859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aee8b2-3c50-4b87-bed6-b84152a659e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:27.093422 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108db123-f97b-4936-b1ee-a93e7a4c915c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:27.094869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aee8b2-3c50-4b87-bed6-b84152a659e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-85aee8b2-3c50-4b87-bed6-b84152a659e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:27.103429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:27.104439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:27.105266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 41/80] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:57:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:27.106574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe724a-9c25-4c76-839d-fc60cecb6b68 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:27.106574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe724a-9c25-4c76-839d-fc60cecb6b68 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:27.107848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe724a-9c25-4c76-839d-fc60cecb6b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:27.128427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-9ebe724a-9c25-4c76-839d-fc60cecb6b68 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:27.129576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9ebe724a-9c25-4c76-839d-fc60cecb6b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:27.135031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e9f3e-f94f-4301-a774-7bc6f7eaccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:27.135696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e9f3e-f94f-4301-a774-7bc6f7eaccdd None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:27.135975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e9f3e-f94f-4301-a774-7bc6f7eaccdd None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:27.136277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e9f3e-f94f-4301-a774-7bc6f7eaccdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:27.137121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e9f3e-f94f-4301-a774-7bc6f7eaccdd None admin] RBAC: Adding query filter params (role.id=e67ab18ce1304dc28ac4e134bba5f8be, scope.project.id=01616978948a4ea094e1ee9190ac21f2, user.id=20992ce0ed594e3f92a948a56437a7c2) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:27.137432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e9f3e-f94f-4301-a774-7bc6f7eaccdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:27.139093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e9f3e-f94f-4301-a774-7bc6f7eaccdd None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:27.144958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 40/81] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:26 2022] GET /identity/v3/role_assignments?user.id=20992ce0ed594e3f92a948a56437a7c2&scope.project.id=01616978948a4ea094e1ee9190ac21f2&role.id=e67ab18ce1304dc28ac4e134bba5f8be => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:27.146431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517feb34-1a59-4a40-ae2a-85033fb75e1b None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:27.146722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517feb34-1a59-4a40-ae2a-85033fb75e1b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:27.146993 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517feb34-1a59-4a40-ae2a-85033fb75e1b None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:27.148547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 41/82] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:27.154572 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517feb34-1a59-4a40-ae2a-85033fb75e1b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:27.238319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 42/83] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:27.240244 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c7963-a735-4617-99b5-e4a3e88e6b69 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:27.240806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c7963-a735-4617-99b5-e4a3e88e6b69 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:27.241278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c7963-a735-4617-99b5-e4a3e88e6b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:27.275048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-611c7963-a735-4617-99b5-e4a3e88e6b69 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:27.276668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-611c7963-a735-4617-99b5-e4a3e88e6b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:27.301907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517feb34-1a59-4a40-ae2a-85033fb75e1b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:27.348936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f42c9-0b1f-4fd1-8dba-62521397d4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:27.349609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f42c9-0b1f-4fd1-8dba-62521397d4d0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:27.349890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f42c9-0b1f-4fd1-8dba-62521397d4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:27.350160 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f42c9-0b1f-4fd1-8dba-62521397d4d0 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:27.350906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f42c9-0b1f-4fd1-8dba-62521397d4d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:27.351211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f42c9-0b1f-4fd1-8dba-62521397d4d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:27.356109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f42c9-0b1f-4fd1-8dba-62521397d4d0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:27.361744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 42/84] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:57:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:27.362155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 43/85] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:27.366962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f42c9-0b1f-4fd1-8dba-62521397d4d0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:27.368777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c7963-a735-4617-99b5-e4a3e88e6b69 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:27.468155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f42c9-0b1f-4fd1-8dba-62521397d4d0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:27.487773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c7963-a735-4617-99b5-e4a3e88e6b69 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:27.503889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1530d-d488-4033-a67c-15571b1f2ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:27.504719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1530d-d488-4033-a67c-15571b1f2ab3 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:27.505004 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1530d-d488-4033-a67c-15571b1f2ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:27.505300 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1530d-d488-4033-a67c-15571b1f2ab3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:27.507262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1530d-d488-4033-a67c-15571b1f2ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:27.510038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1530d-d488-4033-a67c-15571b1f2ab3 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:27.513044 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 43/86] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:27.514428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1530d-d488-4033-a67c-15571b1f2ab3 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:27.535247 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb925c-7f94-4191-9f21-68f505027a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:27.536319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb925c-7f94-4191-9f21-68f505027a4e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:27.536798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb925c-7f94-4191-9f21-68f505027a4e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:27.537212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb925c-7f94-4191-9f21-68f505027a4e None admin] PATH_INFO: `/v3/users/20992ce0ed594e3f92a948a56437a7c2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:27.539031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb925c-7f94-4191-9f21-68f505027a4e None admin] RBAC: Authorizing `identity:get_user(user_id=20992ce0ed594e3f92a948a56437a7c2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:27.542037 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb925c-7f94-4191-9f21-68f505027a4e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:27.544764 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 44/87] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:27 2022] GET /identity/v3/users/20992ce0ed594e3f92a948a56437a7c2 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:27.545338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb925c-7f94-4191-9f21-68f505027a4e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:27.621401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1530d-d488-4033-a67c-15571b1f2ab3 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:27.655059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb925c-7f94-4191-9f21-68f505027a4e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:27.655452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87502d28-b1e5-4d0d-b025-24164f976c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:27.656300 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87502d28-b1e5-4d0d-b025-24164f976c70 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:27.656584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87502d28-b1e5-4d0d-b025-24164f976c70 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:27.656858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87502d28-b1e5-4d0d-b025-24164f976c70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:27.667822 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87502d28-b1e5-4d0d-b025-24164f976c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-87502d28-b1e5-4d0d-b025-24164f976c70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:27.675399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:27.677689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 44/88] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:27.679686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87502d28-b1e5-4d0d-b025-24164f976c70 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:27.693569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1efcc-dc53-49a7-be0d-4d8bc05e0954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:27.694246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1efcc-dc53-49a7-be0d-4d8bc05e0954 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:27.694564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1efcc-dc53-49a7-be0d-4d8bc05e0954 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:27.694835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1efcc-dc53-49a7-be0d-4d8bc05e0954 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:27.695543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1efcc-dc53-49a7-be0d-4d8bc05e0954 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:27.697676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1efcc-dc53-49a7-be0d-4d8bc05e0954 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:27.721152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 45/89] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:57:27 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:57:27.722415 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1efcc-dc53-49a7-be0d-4d8bc05e0954 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:27.799913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87502d28-b1e5-4d0d-b025-24164f976c70 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:27.830976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1efcc-dc53-49a7-be0d-4d8bc05e0954 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:27.855031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b5f29-6a90-46b0-9baa-79668f743ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:27.855984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b5f29-6a90-46b0-9baa-79668f743ea3 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:27.856435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b5f29-6a90-46b0-9baa-79668f743ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:27.856842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b5f29-6a90-46b0-9baa-79668f743ea3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:27.866524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc50c7d-21df-4456-bc9b-424d60d6247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:27.867213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc50c7d-21df-4456-bc9b-424d60d6247e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:27.867494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc50c7d-21df-4456-bc9b-424d60d6247e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:27.868485 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc50c7d-21df-4456-bc9b-424d60d6247e None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:27.869312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc50c7d-21df-4456-bc9b-424d60d6247e None admin] RBAC: Adding query filter params (name=member) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:27.869623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc50c7d-21df-4456-bc9b-424d60d6247e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:27.871051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc50c7d-21df-4456-bc9b-424d60d6247e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:27.880429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 46/90] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:27.887743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc50c7d-21df-4456-bc9b-424d60d6247e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:27.978105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b5f29-6a90-46b0-9baa-79668f743ea3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:27.979490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b5f29-6a90-46b0-9baa-79668f743ea3 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:27.995375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc50c7d-21df-4456-bc9b-424d60d6247e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:28.030367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc582-b59b-4e4f-aece-96af3d7f5da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:28.031257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc582-b59b-4e4f-aece-96af3d7f5da0 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:28.031535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc582-b59b-4e4f-aece-96af3d7f5da0 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:28.031812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc582-b59b-4e4f-aece-96af3d7f5da0 None admin] PATH_INFO: `/v3/users/20992ce0ed594e3f92a948a56437a7c2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:28.033153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc582-b59b-4e4f-aece-96af3d7f5da0 None admin] RBAC: Authorizing `identity:get_user(user_id=20992ce0ed594e3f92a948a56437a7c2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:28.034628 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc582-b59b-4e4f-aece-96af3d7f5da0 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:28.036543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 47/91] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:27 2022] GET /identity/v3/users/20992ce0ed594e3f92a948a56437a7c2 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:28.042745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc582-b59b-4e4f-aece-96af3d7f5da0 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:28.098240 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 45/92] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:57:28.105095 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b5f29-6a90-46b0-9baa-79668f743ea3 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:28.166918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc582-b59b-4e4f-aece-96af3d7f5da0 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:28.212017 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b5f29-6a90-46b0-9baa-79668f743ea3 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:28.216506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56943f-0659-4e0b-8be4-910966664cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:28.217545 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56943f-0659-4e0b-8be4-910966664cb2 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:28.218017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56943f-0659-4e0b-8be4-910966664cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:28.218460 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56943f-0659-4e0b-8be4-910966664cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:28.252582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ffc67-563f-44b0-8442-0eb4d998b510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:28.253702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ffc67-563f-44b0-8442-0eb4d998b510 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:28.254169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ffc67-563f-44b0-8442-0eb4d998b510 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:28.254581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ffc67-563f-44b0-8442-0eb4d998b510 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:28.255959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ffc67-563f-44b0-8442-0eb4d998b510 None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:28.258251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ffc67-563f-44b0-8442-0eb4d998b510 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:28.260356 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 46/93] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:28 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:28.266629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ffc67-563f-44b0-8442-0eb4d998b510 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:28.305432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56943f-0659-4e0b-8be4-910966664cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:28.307256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56943f-0659-4e0b-8be4-910966664cb2 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:28.386417 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ffc67-563f-44b0-8442-0eb4d998b510 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:28.414101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 48/94] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:57:28.420341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56943f-0659-4e0b-8be4-910966664cb2 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:28.431585 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e23de-27d6-4636-95da-8055e59aa402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:28.432909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e23de-27d6-4636-95da-8055e59aa402 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:28.433198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e23de-27d6-4636-95da-8055e59aa402 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:28.433473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e23de-27d6-4636-95da-8055e59aa402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:28.434334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e23de-27d6-4636-95da-8055e59aa402 None admin] RBAC: Adding query filter params (role.id=f12928ff609a47a9bef9cb8abc28932b, scope.project.id=01616978948a4ea094e1ee9190ac21f2, user.id=20992ce0ed594e3f92a948a56437a7c2) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:28.434647 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e23de-27d6-4636-95da-8055e59aa402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:28.436557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e23de-27d6-4636-95da-8055e59aa402 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:28.443683 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 47/95] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:28 2022] GET /identity/v3/role_assignments?user.id=20992ce0ed594e3f92a948a56437a7c2&scope.project.id=01616978948a4ea094e1ee9190ac21f2&role.id=f12928ff609a47a9bef9cb8abc28932b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:28.545979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56943f-0659-4e0b-8be4-910966664cb2 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:28.588755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aee86d-98f3-4d63-8281-236aee8a4e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:28.589640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aee86d-98f3-4d63-8281-236aee8a4e51 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:28.589923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aee86d-98f3-4d63-8281-236aee8a4e51 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:28.590198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aee86d-98f3-4d63-8281-236aee8a4e51 None admin] PATH_INFO: `/v3/projects/4d3cac363d554bfa94a9c01f8c832e87` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:28.594543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aee86d-98f3-4d63-8281-236aee8a4e51 None admin] RBAC: Authorizing `identity:get_project(project_id=4d3cac363d554bfa94a9c01f8c832e87)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:28.597617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aee86d-98f3-4d63-8281-236aee8a4e51 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:28.599481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 49/96] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:28 2022] GET /identity/v3/projects/4d3cac363d554bfa94a9c01f8c832e87 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:28.606521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e23de-27d6-4636-95da-8055e59aa402 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:28.719641 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e23de-27d6-4636-95da-8055e59aa402 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:28.753348 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1459cc-a300-4a0f-91a7-a2da0c04a02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:28.754002 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1459cc-a300-4a0f-91a7-a2da0c04a02d None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:28.754283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1459cc-a300-4a0f-91a7-a2da0c04a02d None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:28.754551 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1459cc-a300-4a0f-91a7-a2da0c04a02d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:28.755382 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1459cc-a300-4a0f-91a7-a2da0c04a02d None admin] RBAC: Adding query filter params (role.id=e67ab18ce1304dc28ac4e134bba5f8be, scope.project.id=4d3cac363d554bfa94a9c01f8c832e87, user.id=20992ce0ed594e3f92a948a56437a7c2) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:28.755689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1459cc-a300-4a0f-91a7-a2da0c04a02d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:28.757149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1459cc-a300-4a0f-91a7-a2da0c04a02d None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:28.763427 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 48/97] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:28 2022] GET /identity/v3/role_assignments?user.id=20992ce0ed594e3f92a948a56437a7c2&scope.project.id=4d3cac363d554bfa94a9c01f8c832e87&role.id=e67ab18ce1304dc28ac4e134bba5f8be => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:29.578059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e002-eacb-4e94-a1e5-dd1f7c25974c None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:29.578570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e002-eacb-4e94-a1e5-dd1f7c25974c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:29.578875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e002-eacb-4e94-a1e5-dd1f7c25974c None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:29.581290 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 50/98] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:29.586909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277bcd9-85ff-4758-bdf4-2b831fbfd1da None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:29.587264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277bcd9-85ff-4758-bdf4-2b831fbfd1da None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:29.587504 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277bcd9-85ff-4758-bdf4-2b831fbfd1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:29.610595 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-e277bcd9-85ff-4758-bdf4-2b831fbfd1da None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:29.612560 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e277bcd9-85ff-4758-bdf4-2b831fbfd1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:29.684188 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 49/99] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:29.703893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21e002-eacb-4e94-a1e5-dd1f7c25974c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:29.842386 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21e002-eacb-4e94-a1e5-dd1f7c25974c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:29.885845 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dfadb-42dd-46a4-8d26-f3b3a1051a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:29.886662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dfadb-42dd-46a4-8d26-f3b3a1051a3e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:29.886951 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dfadb-42dd-46a4-8d26-f3b3a1051a3e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:29.887223 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dfadb-42dd-46a4-8d26-f3b3a1051a3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:29.904177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dfadb-42dd-46a4-8d26-f3b3a1051a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-219dfadb-42dd-46a4-8d26-f3b3a1051a3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:29.914665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:29.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:29.916344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 51/100] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:57:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:29.923697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277bcd9-85ff-4758-bdf4-2b831fbfd1da None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:30.067492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277bcd9-85ff-4758-bdf4-2b831fbfd1da None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:30.116873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6dca2-7f88-40aa-bd64-f984beeec6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:30.117473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6dca2-7f88-40aa-bd64-f984beeec6cd None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:30.117790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6dca2-7f88-40aa-bd64-f984beeec6cd None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:30.118070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6dca2-7f88-40aa-bd64-f984beeec6cd None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:30.118835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6dca2-7f88-40aa-bd64-f984beeec6cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:30.119142 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6dca2-7f88-40aa-bd64-f984beeec6cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:30.120553 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6dca2-7f88-40aa-bd64-f984beeec6cd None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:30.128964 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 50/101] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:30.135030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dfadb-42dd-46a4-8d26-f3b3a1051a3e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:30.260159 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dfadb-42dd-46a4-8d26-f3b3a1051a3e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:30.306433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196d00c-a1a0-46f1-8b27-cd71c014cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:30.307324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196d00c-a1a0-46f1-8b27-cd71c014cdc8 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:30.307609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196d00c-a1a0-46f1-8b27-cd71c014cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:30.307888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196d00c-a1a0-46f1-8b27-cd71c014cdc8 None admin] PATH_INFO: `/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:30.309122 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196d00c-a1a0-46f1-8b27-cd71c014cdc8 None admin] RBAC: Authorizing `identity:get_user(user_id=1486f7b27bfb4a6a89f2d831ec8cd6c7)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:30.310571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196d00c-a1a0-46f1-8b27-cd71c014cdc8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:30.312219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 52/102] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:30 2022] GET /identity/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:30.317948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6dca2-7f88-40aa-bd64-f984beeec6cd None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:30.442659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6dca2-7f88-40aa-bd64-f984beeec6cd None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:30.485672 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052516f-121b-4884-97aa-5cb2e37a4941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:30.486530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052516f-121b-4884-97aa-5cb2e37a4941 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:30.486812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052516f-121b-4884-97aa-5cb2e37a4941 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:30.487086 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052516f-121b-4884-97aa-5cb2e37a4941 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:30.493357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052516f-121b-4884-97aa-5cb2e37a4941 None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:30.494832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052516f-121b-4884-97aa-5cb2e37a4941 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:30.496857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 51/103] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:30 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:30.500360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab1324-0850-4038-9d46-c79be68f8b04 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:30.500647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab1324-0850-4038-9d46-c79be68f8b04 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:30.500932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab1324-0850-4038-9d46-c79be68f8b04 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:30.502525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 53/104] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:30.503212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052516f-121b-4884-97aa-5cb2e37a4941 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:30.514207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c8f3-8f73-4cea-acbb-a24318e21a49 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:30.514493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c8f3-8f73-4cea-acbb-a24318e21a49 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:30.514772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c8f3-8f73-4cea-acbb-a24318e21a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:30.541405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-3207c8f3-8f73-4cea-acbb-a24318e21a49 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:30.549223 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3207c8f3-8f73-4cea-acbb-a24318e21a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:30.694712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 54/105] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:30.695845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052516f-121b-4884-97aa-5cb2e37a4941 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:30.720864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207c8f3-8f73-4cea-acbb-a24318e21a49 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:30.756853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef824a3f-f0c5-49ae-ba94-359412483f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:30.757764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef824a3f-f0c5-49ae-ba94-359412483f0b None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:30.758051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef824a3f-f0c5-49ae-ba94-359412483f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:30.758363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef824a3f-f0c5-49ae-ba94-359412483f0b None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2/users/1486f7b27bfb4a6a89f2d831ec8cd6c7/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:30.761585 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef824a3f-f0c5-49ae-ba94-359412483f0b None admin] RBAC: Authorizing `identity:create_grant(project_id=01616978948a4ea094e1ee9190ac21f2, user_id=1486f7b27bfb4a6a89f2d831ec8cd6c7, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:30.763053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef824a3f-f0c5-49ae-ba94-359412483f0b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:30.789026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 52/106] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:57:30 2022] PUT /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2/users/1486f7b27bfb4a6a89f2d831ec8cd6c7/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:57:30.899898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207c8f3-8f73-4cea-acbb-a24318e21a49 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:30.946194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce7f62-d3fa-4ea5-abd8-fa8bbe882556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:30.946923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce7f62-d3fa-4ea5-abd8-fa8bbe882556 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:30.947208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce7f62-d3fa-4ea5-abd8-fa8bbe882556 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:30.947483 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce7f62-d3fa-4ea5-abd8-fa8bbe882556 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:30.965199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce7f62-d3fa-4ea5-abd8-fa8bbe882556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-f2ce7f62-d3fa-4ea5-abd8-fa8bbe882556 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:30.973060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:30.973902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:30.975039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 55/107] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:30.980857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef824a3f-f0c5-49ae-ba94-359412483f0b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:31.130573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef824a3f-f0c5-49ae-ba94-359412483f0b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:31.169456 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5c47e-a233-4586-8712-2d78cb6ca2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:31.170131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5c47e-a233-4586-8712-2d78cb6ca2e5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:31.170419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5c47e-a233-4586-8712-2d78cb6ca2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:31.170701 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5c47e-a233-4586-8712-2d78cb6ca2e5 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:31.171459 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5c47e-a233-4586-8712-2d78cb6ca2e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:31.171770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5c47e-a233-4586-8712-2d78cb6ca2e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:31.173181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5c47e-a233-4586-8712-2d78cb6ca2e5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:31.187841 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 53/108] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:31.193493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce7f62-d3fa-4ea5-abd8-fa8bbe882556 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:31.321363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce7f62-d3fa-4ea5-abd8-fa8bbe882556 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:31.360070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57967c8a-9465-462a-85ea-91a2111c1a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:31.360975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57967c8a-9465-462a-85ea-91a2111c1a09 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:31.361260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57967c8a-9465-462a-85ea-91a2111c1a09 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:31.361533 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57967c8a-9465-462a-85ea-91a2111c1a09 None admin] PATH_INFO: `/v3/users/20992ce0ed594e3f92a948a56437a7c2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:31.368857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57967c8a-9465-462a-85ea-91a2111c1a09 None admin] RBAC: Authorizing `identity:get_user(user_id=20992ce0ed594e3f92a948a56437a7c2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:31.370331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57967c8a-9465-462a-85ea-91a2111c1a09 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:31.372347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 56/109] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:31 2022] GET /identity/v3/users/20992ce0ed594e3f92a948a56437a7c2 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:31.377852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5c47e-a233-4586-8712-2d78cb6ca2e5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:31.416206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e852f-a4a2-4da2-b34e-60f50141990c None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:31.416500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e852f-a4a2-4da2-b34e-60f50141990c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:31.416773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e852f-a4a2-4da2-b34e-60f50141990c None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:31.418286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 57/110] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:31.426694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959866-054d-4af9-946a-3692f285b7cd None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:31.426980 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959866-054d-4af9-946a-3692f285b7cd None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:31.427265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959866-054d-4af9-946a-3692f285b7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:31.461155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e1959866-054d-4af9-946a-3692f285b7cd None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:31.462944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e1959866-054d-4af9-946a-3692f285b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:31.488138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5c47e-a233-4586-8712-2d78cb6ca2e5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:31.554376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0f4e1-59e1-4662-94f6-5bffa88b3fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:31.555279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0f4e1-59e1-4662-94f6-5bffa88b3fe2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:31.555562 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0f4e1-59e1-4662-94f6-5bffa88b3fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:31.555836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0f4e1-59e1-4662-94f6-5bffa88b3fe2 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:31.557276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0f4e1-59e1-4662-94f6-5bffa88b3fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:31.558729 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0f4e1-59e1-4662-94f6-5bffa88b3fe2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:31.560447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 54/111] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:31 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:31.566645 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0f4e1-59e1-4662-94f6-5bffa88b3fe2 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:31.592645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 58/112] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:31.630174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1959866-054d-4af9-946a-3692f285b7cd None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:31.749742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1959866-054d-4af9-946a-3692f285b7cd None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:31.755827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0f4e1-59e1-4662-94f6-5bffa88b3fe2 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:31.787216 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85f3f0-bc77-4b57-996e-0e88e2c51356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:31.788304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85f3f0-bc77-4b57-996e-0e88e2c51356 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:31.788727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85f3f0-bc77-4b57-996e-0e88e2c51356 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:31.789440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85f3f0-bc77-4b57-996e-0e88e2c51356 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:31.790764 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85f3f0-bc77-4b57-996e-0e88e2c51356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:31.792812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85f3f0-bc77-4b57-996e-0e88e2c51356 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:31.794594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 59/113] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:31.803629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85f3f0-bc77-4b57-996e-0e88e2c51356 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:31.818664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249e602-f432-4c57-b69a-4c79184f2df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:31.819528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249e602-f432-4c57-b69a-4c79184f2df1 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:31.820001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249e602-f432-4c57-b69a-4c79184f2df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:31.820152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249e602-f432-4c57-b69a-4c79184f2df1 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2/users/20992ce0ed594e3f92a948a56437a7c2/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:31.825492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249e602-f432-4c57-b69a-4c79184f2df1 None admin] RBAC: Authorizing `identity:create_grant(project_id=01616978948a4ea094e1ee9190ac21f2, user_id=20992ce0ed594e3f92a948a56437a7c2, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:31.827374 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249e602-f432-4c57-b69a-4c79184f2df1 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:31.865206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 55/114] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:57:31 2022] PUT /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2/users/20992ce0ed594e3f92a948a56437a7c2/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:57:31.868340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a7794-502e-44df-98cf-646c3780c352 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:31.868633 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a7794-502e-44df-98cf-646c3780c352 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:31.869204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a7794-502e-44df-98cf-646c3780c352 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:31.888699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 56/115] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:31 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:31.894442 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b412486-91ec-4dbb-ad59-853740f843b8 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:31.894602 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b412486-91ec-4dbb-ad59-853740f843b8 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:31.894821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b412486-91ec-4dbb-ad59-853740f843b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:31.920366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85f3f0-bc77-4b57-996e-0e88e2c51356 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:31.931268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-9b412486-91ec-4dbb-ad59-853740f843b8 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:31.932930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9b412486-91ec-4dbb-ad59-853740f843b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:31.957000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3116d-df6e-49ac-8120-cad81415f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:31.958087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3116d-df6e-49ac-8120-cad81415f8c6 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:31.958575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3116d-df6e-49ac-8120-cad81415f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:31.959054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3116d-df6e-49ac-8120-cad81415f8c6 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:31.960002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf3116d-df6e-49ac-8120-cad81415f8c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:31.961727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf3116d-df6e-49ac-8120-cad81415f8c6 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:32.000335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 60/116] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 08:57:31 2022] POST /identity/v3/projects => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:57:32.087544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 57/117] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:32.115662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3116d-df6e-49ac-8120-cad81415f8c6 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:32.245095 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858f13-fd75-4f28-bd4b-3096427b6a83 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:32.245427 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858f13-fd75-4f28-bd4b-3096427b6a83 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:32.245645 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858f13-fd75-4f28-bd4b-3096427b6a83 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:32.247038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 58/118] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:32.252914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db262b-e47c-45c3-a918-b575f8c29170 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:32.253191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db262b-e47c-45c3-a918-b575f8c29170 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:32.253380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db262b-e47c-45c3-a918-b575f8c29170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:32.258505 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3116d-df6e-49ac-8120-cad81415f8c6 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:32.273924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-77db262b-e47c-45c3-a918-b575f8c29170 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:32.275491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-77db262b-e47c-45c3-a918-b575f8c29170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:32.312836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4f8ed-df6f-4039-b3a1-ebb6f4549151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:32.313937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4f8ed-df6f-4039-b3a1-ebb6f4549151 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:32.314372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4f8ed-df6f-4039-b3a1-ebb6f4549151 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:32.314794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4f8ed-df6f-4039-b3a1-ebb6f4549151 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:32.332732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4f8ed-df6f-4039-b3a1-ebb6f4549151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-f8d4f8ed-df6f-4039-b3a1-ebb6f4549151 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:32.340811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:32.342005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:32.342982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:32.342982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:32.342982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:32.342982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:32.342982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:32.342982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:32.342982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:32.342982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:32.342982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:32.342982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:32.342982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:32.342982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:32.345109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 61/119] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:32.351166 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4f8ed-df6f-4039-b3a1-ebb6f4549151 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:32.370691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 59/120] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:32.401833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db262b-e47c-45c3-a918-b575f8c29170 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:32.503885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4f8ed-df6f-4039-b3a1-ebb6f4549151 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:32.541699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755b3d7-df82-4ecf-9db1-a40d6fb8c802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:32.542376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b3d7-df82-4ecf-9db1-a40d6fb8c802 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:32.543010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b3d7-df82-4ecf-9db1-a40d6fb8c802 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:32.543010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b3d7-df82-4ecf-9db1-a40d6fb8c802 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:32.543673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755b3d7-df82-4ecf-9db1-a40d6fb8c802 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:32.543982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755b3d7-df82-4ecf-9db1-a40d6fb8c802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:32.545392 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755b3d7-df82-4ecf-9db1-a40d6fb8c802 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:32.553880 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 62/121] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:32.555035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2ecb7-ed6d-4701-9729-dd8e403de75d None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:32.555326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2ecb7-ed6d-4701-9729-dd8e403de75d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:32.555605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2ecb7-ed6d-4701-9729-dd8e403de75d None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:32.556875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 63/122] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:32.558807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db262b-e47c-45c3-a918-b575f8c29170 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:32.561147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2ecb7-ed6d-4701-9729-dd8e403de75d None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:32.600121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a4372-1c4b-4bcf-b277-f274fdaa6bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:32.601280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a4372-1c4b-4bcf-b277-f274fdaa6bed None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:32.601773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a4372-1c4b-4bcf-b277-f274fdaa6bed None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:32.602866 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a4372-1c4b-4bcf-b277-f274fdaa6bed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:32.616434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a4372-1c4b-4bcf-b277-f274fdaa6bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-431a4372-1c4b-4bcf-b277-f274fdaa6bed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:32.627907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:32.628783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:32.629528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:32.629528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:32.629528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:32.629528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:32.629528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:32.629528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:32.629528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:32.629528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:32.629528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:32.629528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:32.629528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:57:32.629528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:32.636384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 60/123] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:57:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:32.637982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa29fc1-1e65-490c-82a1-fe1d94a04336 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:32.638315 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa29fc1-1e65-490c-82a1-fe1d94a04336 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:32.638545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa29fc1-1e65-490c-82a1-fe1d94a04336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:32.661361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-7fa29fc1-1e65-490c-82a1-fe1d94a04336 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:32.663225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7fa29fc1-1e65-490c-82a1-fe1d94a04336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:32.674149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2ecb7-ed6d-4701-9729-dd8e403de75d None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:32.737996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 61/124] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:32.739581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa29fc1-1e65-490c-82a1-fe1d94a04336 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:32.748426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f76a6-52cf-49d3-8a1c-27d1390c314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:32.749409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f76a6-52cf-49d3-8a1c-27d1390c314d None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:32.749743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f76a6-52cf-49d3-8a1c-27d1390c314d None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:32.750269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f76a6-52cf-49d3-8a1c-27d1390c314d None admin] PATH_INFO: `/v3/users/7f3f41e0303e40949987c7e50bbcb125` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:32.785147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f76a6-52cf-49d3-8a1c-27d1390c314d None admin] RBAC: Authorizing `identity:get_user(user_id=7f3f41e0303e40949987c7e50bbcb125)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:32.786615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f76a6-52cf-49d3-8a1c-27d1390c314d None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:32.792831 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 64/125] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:32 2022] GET /identity/v3/users/7f3f41e0303e40949987c7e50bbcb125 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:32.797911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f76a6-52cf-49d3-8a1c-27d1390c314d None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:32.861699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa29fc1-1e65-490c-82a1-fe1d94a04336 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:32.899608 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fe3eb-48c4-4e0f-bcdd-592505cf7e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:32.900828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fe3eb-48c4-4e0f-bcdd-592505cf7e57 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:32.901272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fe3eb-48c4-4e0f-bcdd-592505cf7e57 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:32.901919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fe3eb-48c4-4e0f-bcdd-592505cf7e57 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:32.902962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fe3eb-48c4-4e0f-bcdd-592505cf7e57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:32.903425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fe3eb-48c4-4e0f-bcdd-592505cf7e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:32.905287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fe3eb-48c4-4e0f-bcdd-592505cf7e57 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:32.914283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 62/126] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:57:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:32.919798 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fe3eb-48c4-4e0f-bcdd-592505cf7e57 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:32.998179 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f76a6-52cf-49d3-8a1c-27d1390c314d None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:33.024713 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fe3eb-48c4-4e0f-bcdd-592505cf7e57 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:33.060527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cad21-64b1-445e-b95b-8d8575bb191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:33.061836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cad21-64b1-445e-b95b-8d8575bb191b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:33.062308 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cad21-64b1-445e-b95b-8d8575bb191b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:33.062883 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cad21-64b1-445e-b95b-8d8575bb191b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:33.073357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52e2eb-4510-48a9-8fe9-62ac39b7f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:33.074113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52e2eb-4510-48a9-8fe9-62ac39b7f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:33.074463 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52e2eb-4510-48a9-8fe9-62ac39b7f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:33.074654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cad21-64b1-445e-b95b-8d8575bb191b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:33.074907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52e2eb-4510-48a9-8fe9-62ac39b7f9c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-df4cad21-64b1-445e-b95b-8d8575bb191b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:33.083123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:33.083969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:33.084759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:33.084759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:33.084759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:33.084759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:33.084759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:33.084759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:33.084759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:33.084759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:33.084759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:33.084759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:33.084759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:33.084759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:33.088704 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 63/127] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:33.093534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cad21-64b1-445e-b95b-8d8575bb191b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:33.218396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52e2eb-4510-48a9-8fe9-62ac39b7f9c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:33.225797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52e2eb-4510-48a9-8fe9-62ac39b7f9c5 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:33.258901 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cad21-64b1-445e-b95b-8d8575bb191b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:33.321559 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40661b4-9297-4f73-b707-e28298ecd9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:33.322490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40661b4-9297-4f73-b707-e28298ecd9e2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:33.322845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40661b4-9297-4f73-b707-e28298ecd9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:33.323191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40661b4-9297-4f73-b707-e28298ecd9e2 None admin] PATH_INFO: `/v3/users/20992ce0ed594e3f92a948a56437a7c2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:33.324561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40661b4-9297-4f73-b707-e28298ecd9e2 None admin] RBAC: Authorizing `identity:get_user(user_id=20992ce0ed594e3f92a948a56437a7c2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:33.326357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40661b4-9297-4f73-b707-e28298ecd9e2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:33.328066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 64/128] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:33 2022] GET /identity/v3/users/20992ce0ed594e3f92a948a56437a7c2 => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:33.328914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40661b4-9297-4f73-b707-e28298ecd9e2 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:33.339298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 65/129] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:57:33.340689 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52e2eb-4510-48a9-8fe9-62ac39b7f9c5 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:33.436986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52e2eb-4510-48a9-8fe9-62ac39b7f9c5 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:33.471273 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e35a13-3f93-49ce-a6a8-d687723d2cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:33.473251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e35a13-3f93-49ce-a6a8-d687723d2cc5 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:33.473755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e35a13-3f93-49ce-a6a8-d687723d2cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:33.474740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e35a13-3f93-49ce-a6a8-d687723d2cc5 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:33.477291 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e35a13-3f93-49ce-a6a8-d687723d2cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:33.478975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e35a13-3f93-49ce-a6a8-d687723d2cc5 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:33.484097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 66/130] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:33 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:33.490685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e35a13-3f93-49ce-a6a8-d687723d2cc5 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:33.537963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40661b4-9297-4f73-b707-e28298ecd9e2 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:33.600894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a698078-b36e-40c9-a3d3-b89f2863075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:33.601506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a698078-b36e-40c9-a3d3-b89f2863075e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:33.602317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a698078-b36e-40c9-a3d3-b89f2863075e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:33.602613 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a698078-b36e-40c9-a3d3-b89f2863075e None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:33.603371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a698078-b36e-40c9-a3d3-b89f2863075e None admin] RBAC: Adding query filter params (name=member) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:33.603682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a698078-b36e-40c9-a3d3-b89f2863075e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:33.605102 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a698078-b36e-40c9-a3d3-b89f2863075e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:33.619127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 65/131] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:33.619127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a698078-b36e-40c9-a3d3-b89f2863075e None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:33.626185 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e35a13-3f93-49ce-a6a8-d687723d2cc5 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:33.664013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde83a2f-16c5-4097-8767-dc8d265b5818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:33.665848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde83a2f-16c5-4097-8767-dc8d265b5818 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:33.666336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde83a2f-16c5-4097-8767-dc8d265b5818 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:33.666819 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde83a2f-16c5-4097-8767-dc8d265b5818 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:33.668303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde83a2f-16c5-4097-8767-dc8d265b5818 None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:33.669951 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde83a2f-16c5-4097-8767-dc8d265b5818 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:33.671975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 67/132] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:33 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:33.673008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde83a2f-16c5-4097-8767-dc8d265b5818 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:33.774199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde83a2f-16c5-4097-8767-dc8d265b5818 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:33.810830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02056e9-caad-4ea4-bffa-fd8f302bc90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:33.812107 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02056e9-caad-4ea4-bffa-fd8f302bc90e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:33.812583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02056e9-caad-4ea4-bffa-fd8f302bc90e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:33.813110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02056e9-caad-4ea4-bffa-fd8f302bc90e None admin] PATH_INFO: `/v3/users/20992ce0ed594e3f92a948a56437a7c2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:33.814512 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02056e9-caad-4ea4-bffa-fd8f302bc90e None admin] RBAC: Authorizing `identity:get_user(user_id=20992ce0ed594e3f92a948a56437a7c2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:33.816215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02056e9-caad-4ea4-bffa-fd8f302bc90e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:33.818080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 68/133] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:33 2022] GET /identity/v3/users/20992ce0ed594e3f92a948a56437a7c2 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:33.819107 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02056e9-caad-4ea4-bffa-fd8f302bc90e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:33.826475 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a698078-b36e-40c9-a3d3-b89f2863075e None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:33.905573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55704010-4564-4d3b-93b7-c080db91130d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:33.906379 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55704010-4564-4d3b-93b7-c080db91130d None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:33.906663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55704010-4564-4d3b-93b7-c080db91130d None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:33.906935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55704010-4564-4d3b-93b7-c080db91130d None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2/users/20992ce0ed594e3f92a948a56437a7c2/roles/f12928ff609a47a9bef9cb8abc28932b` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:33.909199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55704010-4564-4d3b-93b7-c080db91130d None admin] RBAC: Authorizing `identity:create_grant(project_id=01616978948a4ea094e1ee9190ac21f2, user_id=20992ce0ed594e3f92a948a56437a7c2, role_id=f12928ff609a47a9bef9cb8abc28932b)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:33.910675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55704010-4564-4d3b-93b7-c080db91130d None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:33.923579 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02056e9-caad-4ea4-bffa-fd8f302bc90e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:33.925705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 66/134] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:57:33 2022] PUT /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2/users/20992ce0ed594e3f92a948a56437a7c2/roles/f12928ff609a47a9bef9cb8abc28932b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:57:33.932153 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55704010-4564-4d3b-93b7-c080db91130d None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:33.995448 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e820e18-bc0c-42fe-8852-41411856605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:33.996136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e820e18-bc0c-42fe-8852-41411856605d None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:33.996420 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e820e18-bc0c-42fe-8852-41411856605d None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:33.996689 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e820e18-bc0c-42fe-8852-41411856605d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:33.997527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e820e18-bc0c-42fe-8852-41411856605d None admin] RBAC: Adding query filter params (role.id=4f6101138a274d1d8a67780808b9a71e, scope.project.id=01616978948a4ea094e1ee9190ac21f2, user.id=7f3f41e0303e40949987c7e50bbcb125) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:33.997835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e820e18-bc0c-42fe-8852-41411856605d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:34.001989 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e820e18-bc0c-42fe-8852-41411856605d None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:34.013410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 69/135] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:33 2022] GET /identity/v3/role_assignments?user.id=7f3f41e0303e40949987c7e50bbcb125&scope.project.id=01616978948a4ea094e1ee9190ac21f2&role.id=4f6101138a274d1d8a67780808b9a71e => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:34.014878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c2589-b06a-496b-9464-8dca0d2115c6 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:34.015168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c2589-b06a-496b-9464-8dca0d2115c6 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:34.015446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c2589-b06a-496b-9464-8dca0d2115c6 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:34.016834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 70/136] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:34.022602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae460e53-e220-4566-90c4-d986e5cb2385 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:34.022905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae460e53-e220-4566-90c4-d986e5cb2385 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:34.023207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae460e53-e220-4566-90c4-d986e5cb2385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:34.049937 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55704010-4564-4d3b-93b7-c080db91130d None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:34.057296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ae460e53-e220-4566-90c4-d986e5cb2385 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:34.058501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ae460e53-e220-4566-90c4-d986e5cb2385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:34.090652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8cb4e-5af8-4a0e-8890-76d38021be78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:34.092103 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8cb4e-5af8-4a0e-8890-76d38021be78 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:34.092418 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8cb4e-5af8-4a0e-8890-76d38021be78 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:34.092698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8cb4e-5af8-4a0e-8890-76d38021be78 None admin] PATH_INFO: `/v3/projects/4d3cac363d554bfa94a9c01f8c832e87` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:34.094501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8cb4e-5af8-4a0e-8890-76d38021be78 None admin] RBAC: Authorizing `identity:get_project(project_id=4d3cac363d554bfa94a9c01f8c832e87)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:34.096384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8cb4e-5af8-4a0e-8890-76d38021be78 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:34.098406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 67/137] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:33 2022] GET /identity/v3/projects/4d3cac363d554bfa94a9c01f8c832e87 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:34.105290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8cb4e-5af8-4a0e-8890-76d38021be78 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:34.223551 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8cb4e-5af8-4a0e-8890-76d38021be78 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:34.245021 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 71/138] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:34.271636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc883f7-d985-4910-a9f3-7b091b0b6d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:34.272965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc883f7-d985-4910-a9f3-7b091b0b6d22 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:34.273469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc883f7-d985-4910-a9f3-7b091b0b6d22 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:34.273994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc883f7-d985-4910-a9f3-7b091b0b6d22 None admin] PATH_INFO: `/v3/projects/4d3cac363d554bfa94a9c01f8c832e87/users/20992ce0ed594e3f92a948a56437a7c2/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:34.278131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc883f7-d985-4910-a9f3-7b091b0b6d22 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d3cac363d554bfa94a9c01f8c832e87, user_id=20992ce0ed594e3f92a948a56437a7c2, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:34.279742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae460e53-e220-4566-90c4-d986e5cb2385 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:34.288123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc883f7-d985-4910-a9f3-7b091b0b6d22 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:34.314618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 68/139] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:57:34 2022] PUT /identity/v3/projects/4d3cac363d554bfa94a9c01f8c832e87/users/20992ce0ed594e3f92a948a56437a7c2/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:57:34.412852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae460e53-e220-4566-90c4-d986e5cb2385 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:34.452901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e523203-ebef-48b8-9408-7cb42cf6c189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:34.453991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e523203-ebef-48b8-9408-7cb42cf6c189 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:34.454477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e523203-ebef-48b8-9408-7cb42cf6c189 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:34.454927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e523203-ebef-48b8-9408-7cb42cf6c189 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:34.466385 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e523203-ebef-48b8-9408-7cb42cf6c189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-1e523203-ebef-48b8-9408-7cb42cf6c189 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:34.474648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:34.475509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:34.476298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:34.476298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:34.476298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:34.476298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:34.476298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:34.476298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:34.476298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:34.476298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:34.476298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:34.476298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:34.476298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:34.476298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:34.478918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 72/140] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:34.485360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc883f7-d985-4910-a9f3-7b091b0b6d22 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:34.603778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc883f7-d985-4910-a9f3-7b091b0b6d22 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:34.648507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2358e-cba1-437b-b2f2-496462b35494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:34.649464 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2358e-cba1-437b-b2f2-496462b35494 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:34.649907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2358e-cba1-437b-b2f2-496462b35494 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:34.650325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2358e-cba1-437b-b2f2-496462b35494 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:34.651224 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2358e-cba1-437b-b2f2-496462b35494 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:34.651674 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2358e-cba1-437b-b2f2-496462b35494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:34.653291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2358e-cba1-437b-b2f2-496462b35494 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:34.666772 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 69/141] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:34.672350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e523203-ebef-48b8-9408-7cb42cf6c189 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:34.781719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e523203-ebef-48b8-9408-7cb42cf6c189 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:34.829698 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3c19b-77ff-4092-ab8e-6b1a0e3e6c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:34.830590 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3c19b-77ff-4092-ab8e-6b1a0e3e6c09 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:34.830877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3c19b-77ff-4092-ab8e-6b1a0e3e6c09 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:34.831155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3c19b-77ff-4092-ab8e-6b1a0e3e6c09 None admin] PATH_INFO: `/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:34.832425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3c19b-77ff-4092-ab8e-6b1a0e3e6c09 None admin] RBAC: Authorizing `identity:get_user(user_id=1486f7b27bfb4a6a89f2d831ec8cd6c7)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:34.833874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3c19b-77ff-4092-ab8e-6b1a0e3e6c09 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:34.835819 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 73/142] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:34 2022] GET /identity/v3/users/1486f7b27bfb4a6a89f2d831ec8cd6c7 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:34.841640 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2358e-cba1-437b-b2f2-496462b35494 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:34.991195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2358e-cba1-437b-b2f2-496462b35494 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:35.033764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a4d9b-fe27-4469-be99-460ff63e47be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:35.034763 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a4d9b-fe27-4469-be99-460ff63e47be None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:35.035246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a4d9b-fe27-4469-be99-460ff63e47be None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:35.035733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a4d9b-fe27-4469-be99-460ff63e47be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:35.077184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51510890-2337-4ab1-915e-d7226dc04557 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:35.077813 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51510890-2337-4ab1-915e-d7226dc04557 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:35.078334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51510890-2337-4ab1-915e-d7226dc04557 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:35.079893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 74/143] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:35.085016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025003b8-7b9a-4f89-b72b-7ff7ed63f8a7 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:35.085549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025003b8-7b9a-4f89-b72b-7ff7ed63f8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:35.086046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025003b8-7b9a-4f89-b72b-7ff7ed63f8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:35.103738 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-025003b8-7b9a-4f89-b72b-7ff7ed63f8a7 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:35.105253 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-025003b8-7b9a-4f89-b72b-7ff7ed63f8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:35.112126 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a4d9b-fe27-4469-be99-460ff63e47be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:35.114115 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a4d9b-fe27-4469-be99-460ff63e47be None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:35.171028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 75/144] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:35.194301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025003b8-7b9a-4f89-b72b-7ff7ed63f8a7 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:35.227756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 70/145] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:57:35.233690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a4d9b-fe27-4469-be99-460ff63e47be None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:35.344150 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a4d9b-fe27-4469-be99-460ff63e47be None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:35.392443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48df64-c987-4fc1-9afa-5e002ad4983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:35.392443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48df64-c987-4fc1-9afa-5e002ad4983c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:35.392443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48df64-c987-4fc1-9afa-5e002ad4983c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:35.392443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48df64-c987-4fc1-9afa-5e002ad4983c None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:35.399347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48df64-c987-4fc1-9afa-5e002ad4983c None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:35.402014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48df64-c987-4fc1-9afa-5e002ad4983c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:35.402952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 71/146] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:35 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:35.409080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48df64-c987-4fc1-9afa-5e002ad4983c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:35.426672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025003b8-7b9a-4f89-b72b-7ff7ed63f8a7 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:35.519407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48df64-c987-4fc1-9afa-5e002ad4983c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:35.528806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496e764-e9bf-4f45-91db-25968ce0bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:35.529627 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496e764-e9bf-4f45-91db-25968ce0bf31 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:35.529917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496e764-e9bf-4f45-91db-25968ce0bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:35.530181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496e764-e9bf-4f45-91db-25968ce0bf31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:35.553177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496e764-e9bf-4f45-91db-25968ce0bf31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-f496e764-e9bf-4f45-91db-25968ce0bf31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:35.561425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:35.563526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 76/147] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:35.565769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851495a6-35f9-4966-b8d5-27f2ae0718f2 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:35.567462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851495a6-35f9-4966-b8d5-27f2ae0718f2 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:35.567596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f4605-a784-43aa-99cc-0145eaf8c8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:35.567596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4605-a784-43aa-99cc-0145eaf8c8d8 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:35.567596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4605-a784-43aa-99cc-0145eaf8c8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:35.568012 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4605-a784-43aa-99cc-0145eaf8c8d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:35.572181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f4605-a784-43aa-99cc-0145eaf8c8d8 None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=01616978948a4ea094e1ee9190ac21f2, user.id=1486f7b27bfb4a6a89f2d831ec8cd6c7) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:35.572181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f4605-a784-43aa-99cc-0145eaf8c8d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:35.572181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f4605-a784-43aa-99cc-0145eaf8c8d8 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:35.575383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851495a6-35f9-4966-b8d5-27f2ae0718f2 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:35.577065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 77/148] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:35 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:35.577795 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851495a6-35f9-4966-b8d5-27f2ae0718f2 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:35.580301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 72/149] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:35 2022] GET /identity/v3/role_assignments?user.id=1486f7b27bfb4a6a89f2d831ec8cd6c7&scope.project.id=01616978948a4ea094e1ee9190ac21f2&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:35.585532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9345-47fb-4bfb-8c3b-11ae1c9fa96d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:35.585788 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9345-47fb-4bfb-8c3b-11ae1c9fa96d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:35.586070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9345-47fb-4bfb-8c3b-11ae1c9fa96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:35.623636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-465d9345-47fb-4bfb-8c3b-11ae1c9fa96d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:35.624805 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-465d9345-47fb-4bfb-8c3b-11ae1c9fa96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:35.775121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 73/150] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:35.801624 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851495a6-35f9-4966-b8d5-27f2ae0718f2 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:35.811928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d9345-47fb-4bfb-8c3b-11ae1c9fa96d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:35.868835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c59f4-8270-473c-96d3-cfc03a286b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:35.869526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c59f4-8270-473c-96d3-cfc03a286b9c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:35.869809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c59f4-8270-473c-96d3-cfc03a286b9c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:35.870085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c59f4-8270-473c-96d3-cfc03a286b9c None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:35.870846 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c59f4-8270-473c-96d3-cfc03a286b9c None admin] RBAC: Adding query filter params (name=member) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:35.871158 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c59f4-8270-473c-96d3-cfc03a286b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:35.872607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c59f4-8270-473c-96d3-cfc03a286b9c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:35.894339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 78/151] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:35.914422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c59f4-8270-473c-96d3-cfc03a286b9c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:36.012274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d9345-47fb-4bfb-8c3b-11ae1c9fa96d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:36.083656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaca1e-6583-46d4-b9e0-5e029076eaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:36.084834 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaca1e-6583-46d4-b9e0-5e029076eaa4 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:36.085492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaca1e-6583-46d4-b9e0-5e029076eaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:36.086135 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaca1e-6583-46d4-b9e0-5e029076eaa4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:36.089235 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adaca1e-6583-46d4-b9e0-5e029076eaa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:36.091886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adaca1e-6583-46d4-b9e0-5e029076eaa4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:36.097159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 74/152] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:36.098987 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c59f4-8270-473c-96d3-cfc03a286b9c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:36.104221 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaca1e-6583-46d4-b9e0-5e029076eaa4 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:36.139485 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74da42-0eb8-4b73-97ba-efeabe825368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:36.140401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74da42-0eb8-4b73-97ba-efeabe825368 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:36.140689 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74da42-0eb8-4b73-97ba-efeabe825368 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:36.140968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74da42-0eb8-4b73-97ba-efeabe825368 None admin] PATH_INFO: `/v3/users/20992ce0ed594e3f92a948a56437a7c2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:36.142794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74da42-0eb8-4b73-97ba-efeabe825368 None admin] RBAC: Authorizing `identity:get_user(user_id=20992ce0ed594e3f92a948a56437a7c2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:36.144268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74da42-0eb8-4b73-97ba-efeabe825368 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:36.145953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 79/153] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:35 2022] GET /identity/v3/users/20992ce0ed594e3f92a948a56437a7c2 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:36.153235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74da42-0eb8-4b73-97ba-efeabe825368 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:36.264684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaca1e-6583-46d4-b9e0-5e029076eaa4 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:36.283480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74da42-0eb8-4b73-97ba-efeabe825368 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:36.318497 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a6170-f015-4df1-bb2a-57f359079eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:36.319185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a6170-f015-4df1-bb2a-57f359079eb4 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:36.319478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a6170-f015-4df1-bb2a-57f359079eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:36.319749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a6170-f015-4df1-bb2a-57f359079eb4 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:36.320600 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a6170-f015-4df1-bb2a-57f359079eb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:36.322631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a6170-f015-4df1-bb2a-57f359079eb4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:36.325010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2d354-4f61-435c-be76-0f1a73d61c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:36.326202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2d354-4f61-435c-be76-0f1a73d61c47 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:36.326736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2d354-4f61-435c-be76-0f1a73d61c47 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:36.327198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2d354-4f61-435c-be76-0f1a73d61c47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:36.391900 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 75/154] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:57:36 2022] POST /identity/v3/users => generated 283 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:57:36.404176 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2d354-4f61-435c-be76-0f1a73d61c47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:36.406136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2d354-4f61-435c-be76-0f1a73d61c47 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:36.513318 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 80/155] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:57:36.521548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a6170-f015-4df1-bb2a-57f359079eb4 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:36.671919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a6170-f015-4df1-bb2a-57f359079eb4 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:36.709243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93f1d6-d9e0-49b8-8432-579018c12b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:36.710108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93f1d6-d9e0-49b8-8432-579018c12b0f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:36.710387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93f1d6-d9e0-49b8-8432-579018c12b0f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:36.710661 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93f1d6-d9e0-49b8-8432-579018c12b0f None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:36.711884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93f1d6-d9e0-49b8-8432-579018c12b0f None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:36.713352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93f1d6-d9e0-49b8-8432-579018c12b0f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:36.715376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 76/156] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:36 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:36.720761 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2d354-4f61-435c-be76-0f1a73d61c47 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:36.846695 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2d354-4f61-435c-be76-0f1a73d61c47 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:36.895812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48222e19-767b-4c7f-8891-cf20007306dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:36.896558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48222e19-767b-4c7f-8891-cf20007306dd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:36.896841 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48222e19-767b-4c7f-8891-cf20007306dd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:36.897115 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48222e19-767b-4c7f-8891-cf20007306dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:36.897952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48222e19-767b-4c7f-8891-cf20007306dd None admin] RBAC: Adding query filter params (role.id=e67ab18ce1304dc28ac4e134bba5f8be, scope.project.id=01616978948a4ea094e1ee9190ac21f2, user.id=20992ce0ed594e3f92a948a56437a7c2) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:36.898264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48222e19-767b-4c7f-8891-cf20007306dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:36.899944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48222e19-767b-4c7f-8891-cf20007306dd None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:36.907067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 81/157] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:36 2022] GET /identity/v3/role_assignments?user.id=20992ce0ed594e3f92a948a56437a7c2&scope.project.id=01616978948a4ea094e1ee9190ac21f2&role.id=e67ab18ce1304dc28ac4e134bba5f8be => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:37.105125 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ccc64-de40-442c-804d-b5c084c97e3e None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:37.105663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ccc64-de40-442c-804d-b5c084c97e3e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:37.105663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ccc64-de40-442c-804d-b5c084c97e3e None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:37.107331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 77/158] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:37.113098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb692b-8ccf-4f86-b50f-07b7ef95503a None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:37.113394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb692b-8ccf-4f86-b50f-07b7ef95503a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:37.113716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb692b-8ccf-4f86-b50f-07b7ef95503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:37.134361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b6bb692b-8ccf-4f86-b50f-07b7ef95503a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:37.135614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b6bb692b-8ccf-4f86-b50f-07b7ef95503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:37.219012 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 82/159] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:37.243194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ccc64-de40-442c-804d-b5c084c97e3e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:37.347932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ccc64-de40-442c-804d-b5c084c97e3e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:37.382888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e4028-94f0-42ef-b103-b334548c0187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:37.384061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e4028-94f0-42ef-b103-b334548c0187 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:37.384571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e4028-94f0-42ef-b103-b334548c0187 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:37.385027 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e4028-94f0-42ef-b103-b334548c0187 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:37.395352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e4028-94f0-42ef-b103-b334548c0187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-cb5e4028-94f0-42ef-b103-b334548c0187 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:37.403394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:37.404301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:37.405040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:37.405040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:37.405040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:37.405040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:37.405040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:37.405040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:37.405040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:37.405040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:37.405040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:37.405040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:37.405040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:37.405040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:37.407366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 78/160] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:37.413326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb692b-8ccf-4f86-b50f-07b7ef95503a None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:37.447952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73134c0a-9b5b-4678-9ac2-aa2b5ee76d3e None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:37.448565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73134c0a-9b5b-4678-9ac2-aa2b5ee76d3e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:37.449025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73134c0a-9b5b-4678-9ac2-aa2b5ee76d3e None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:37.450853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 79/161] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:37.456523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50ca6b-86d4-4914-a5b1-a4cfcac52823 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:37.457051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50ca6b-86d4-4914-a5b1-a4cfcac52823 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:37.457543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50ca6b-86d4-4914-a5b1-a4cfcac52823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:37.480738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-bf50ca6b-86d4-4914-a5b1-a4cfcac52823 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:37.480738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-bf50ca6b-86d4-4914-a5b1-a4cfcac52823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:37.544875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb692b-8ccf-4f86-b50f-07b7ef95503a None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:37.568965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 80/162] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:37.588699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4241a50-3566-4af1-a898-ee124b62fdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:37.589712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4241a50-3566-4af1-a898-ee124b62fdae None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:37.590191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4241a50-3566-4af1-a898-ee124b62fdae None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:37.590649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4241a50-3566-4af1-a898-ee124b62fdae None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:37.591594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4241a50-3566-4af1-a898-ee124b62fdae None admin] RBAC: Adding query filter params (name=reader) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:37.592195 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4241a50-3566-4af1-a898-ee124b62fdae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:37.593759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4241a50-3566-4af1-a898-ee124b62fdae None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:37.599163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50ca6b-86d4-4914-a5b1-a4cfcac52823 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:37.609805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 83/163] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:37.615447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4241a50-3566-4af1-a898-ee124b62fdae None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:37.721960 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50ca6b-86d4-4914-a5b1-a4cfcac52823 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:37.731929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4241a50-3566-4af1-a898-ee124b62fdae None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:37.765360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ba023-8a6e-4bf7-82ec-c3acd0fc4494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:37.766325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ba023-8a6e-4bf7-82ec-c3acd0fc4494 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:37.766668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ba023-8a6e-4bf7-82ec-c3acd0fc4494 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:37.767015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ba023-8a6e-4bf7-82ec-c3acd0fc4494 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:37.767260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2ada0-c2fb-42bb-b900-b8adce8d5397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:37.768156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2ada0-c2fb-42bb-b900-b8adce8d5397 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:37.768442 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2ada0-c2fb-42bb-b900-b8adce8d5397 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:37.768715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2ada0-c2fb-42bb-b900-b8adce8d5397 None admin] PATH_INFO: `/v3/users/7f3f41e0303e40949987c7e50bbcb125` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:37.769933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2ada0-c2fb-42bb-b900-b8adce8d5397 None admin] RBAC: Authorizing `identity:get_user(user_id=7f3f41e0303e40949987c7e50bbcb125)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:37.771379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2ada0-c2fb-42bb-b900-b8adce8d5397 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:37.773224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 84/164] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:37 2022] GET /identity/v3/users/7f3f41e0303e40949987c7e50bbcb125 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:37.774778 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af85910-4b88-473b-87fd-e2114ab739c6 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:37.775171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af85910-4b88-473b-87fd-e2114ab739c6 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:37.775349 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af85910-4b88-473b-87fd-e2114ab739c6 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:37.779437 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ba023-8a6e-4bf7-82ec-c3acd0fc4494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:37.781057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 85/165] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:37.786428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8f1d7-2179-47cb-96fc-93fa835650b7 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:37.786713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8f1d7-2179-47cb-96fc-93fa835650b7 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:37.786992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8f1d7-2179-47cb-96fc-93fa835650b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-f58ba023-8a6e-4bf7-82ec-c3acd0fc4494 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:37.787604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:37.788481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:37.789813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 81/166] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:57:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:37.791922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ba023-8a6e-4bf7-82ec-c3acd0fc4494 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:37.809855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-51d8f1d7-2179-47cb-96fc-93fa835650b7 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:37.811037 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-51d8f1d7-2179-47cb-96fc-93fa835650b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:37.882877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 86/167] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:37.883865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8f1d7-2179-47cb-96fc-93fa835650b7 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:37.920933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ba023-8a6e-4bf7-82ec-c3acd0fc4494 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:37.979363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd72857-2048-420f-a4f4-ffb2fd31f653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:37.980176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd72857-2048-420f-a4f4-ffb2fd31f653 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:37.980461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd72857-2048-420f-a4f4-ffb2fd31f653 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:37.980732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd72857-2048-420f-a4f4-ffb2fd31f653 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:37.982527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd72857-2048-420f-a4f4-ffb2fd31f653 None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:37.983987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd72857-2048-420f-a4f4-ffb2fd31f653 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:37.986773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 82/168] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:37 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:37.987539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd72857-2048-420f-a4f4-ffb2fd31f653 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:38.052956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8f1d7-2179-47cb-96fc-93fa835650b7 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:38.118082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82564a5c-baf0-47f1-b5ee-9926b1a79f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:38.119108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82564a5c-baf0-47f1-b5ee-9926b1a79f02 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:38.119586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82564a5c-baf0-47f1-b5ee-9926b1a79f02 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:38.120153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82564a5c-baf0-47f1-b5ee-9926b1a79f02 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:38.121104 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82564a5c-baf0-47f1-b5ee-9926b1a79f02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:38.122881 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82564a5c-baf0-47f1-b5ee-9926b1a79f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:38.129102 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82564a5c-baf0-47f1-b5ee-9926b1a79f02 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:38.143184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 87/169] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:57:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:38.143913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82564a5c-baf0-47f1-b5ee-9926b1a79f02 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:38.159995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd72857-2048-420f-a4f4-ffb2fd31f653 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:38.198040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35901eaf-1b30-4ffe-b8de-51f87c550da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:38.199168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35901eaf-1b30-4ffe-b8de-51f87c550da2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:38.199645 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35901eaf-1b30-4ffe-b8de-51f87c550da2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:38.200162 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35901eaf-1b30-4ffe-b8de-51f87c550da2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:38.232178 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35901eaf-1b30-4ffe-b8de-51f87c550da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-35901eaf-1b30-4ffe-b8de-51f87c550da2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:38.236636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:38.237558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 83/170] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:38.238720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35901eaf-1b30-4ffe-b8de-51f87c550da2 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:38.278761 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82564a5c-baf0-47f1-b5ee-9926b1a79f02 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:38.320196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4be2d8-7424-400a-b64b-b9c1c58b2a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:38.321726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4be2d8-7424-400a-b64b-b9c1c58b2a37 None admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:38.322013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4be2d8-7424-400a-b64b-b9c1c58b2a37 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:38.322285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4be2d8-7424-400a-b64b-b9c1c58b2a37 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2/users/7f3f41e0303e40949987c7e50bbcb125/roles/4f6101138a274d1d8a67780808b9a71e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:38.329449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4be2d8-7424-400a-b64b-b9c1c58b2a37 None admin] RBAC: Authorizing `identity:create_grant(project_id=01616978948a4ea094e1ee9190ac21f2, user_id=7f3f41e0303e40949987c7e50bbcb125, role_id=4f6101138a274d1d8a67780808b9a71e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:38.330916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4be2d8-7424-400a-b64b-b9c1c58b2a37 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:38.348146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35901eaf-1b30-4ffe-b8de-51f87c550da2 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:38.364005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 88/171] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:57:38 2022] PUT /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2/users/7f3f41e0303e40949987c7e50bbcb125/roles/4f6101138a274d1d8a67780808b9a71e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:57:38.364895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4be2d8-7424-400a-b64b-b9c1c58b2a37 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:38.389269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0765edd-7cb2-48ff-900c-f0d1f4cfc37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:38.390160 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0765edd-7cb2-48ff-900c-f0d1f4cfc37f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:38.390437 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0765edd-7cb2-48ff-900c-f0d1f4cfc37f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:38.390710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0765edd-7cb2-48ff-900c-f0d1f4cfc37f None admin] PATH_INFO: `/v3/users/20992ce0ed594e3f92a948a56437a7c2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:38.393475 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0765edd-7cb2-48ff-900c-f0d1f4cfc37f None admin] RBAC: Authorizing `identity:get_user(user_id=20992ce0ed594e3f92a948a56437a7c2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:38.394957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0765edd-7cb2-48ff-900c-f0d1f4cfc37f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:38.397666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 84/172] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:38 2022] GET /identity/v3/users/20992ce0ed594e3f92a948a56437a7c2 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:38.405223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0765edd-7cb2-48ff-900c-f0d1f4cfc37f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:38.586341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4be2d8-7424-400a-b64b-b9c1c58b2a37 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:38.587923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0765edd-7cb2-48ff-900c-f0d1f4cfc37f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:38.628938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8132e-7a68-44d4-9417-e328f8adad31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:38.629592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8132e-7a68-44d4-9417-e328f8adad31 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:38.629875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8132e-7a68-44d4-9417-e328f8adad31 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:38.630850 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8132e-7a68-44d4-9417-e328f8adad31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:38.646448 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3737b-6767-425f-b8e0-0906d536a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:38.647133 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3737b-6767-425f-b8e0-0906d536a504 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:38.647415 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3737b-6767-425f-b8e0-0906d536a504 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:38.647688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3737b-6767-425f-b8e0-0906d536a504 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:38.648497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3737b-6767-425f-b8e0-0906d536a504 None admin] RBAC: Adding query filter params (name=member) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:38.648847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3737b-6767-425f-b8e0-0906d536a504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:38.650229 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3737b-6767-425f-b8e0-0906d536a504 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:38.660856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 89/173] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:38.667716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3737b-6767-425f-b8e0-0906d536a504 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:38.771858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8132e-7a68-44d4-9417-e328f8adad31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:38.773372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8132e-7a68-44d4-9417-e328f8adad31 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:38.874127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3737b-6767-425f-b8e0-0906d536a504 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:38.950155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214f2f-212d-4ac1-bbea-88a5044fc174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:38.951306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214f2f-212d-4ac1-bbea-88a5044fc174 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:38.951585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214f2f-212d-4ac1-bbea-88a5044fc174 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:38.951857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214f2f-212d-4ac1-bbea-88a5044fc174 None admin] PATH_INFO: `/v3/users/20992ce0ed594e3f92a948a56437a7c2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:38.953838 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec214f2f-212d-4ac1-bbea-88a5044fc174 None admin] RBAC: Authorizing `identity:get_user(user_id=20992ce0ed594e3f92a948a56437a7c2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:38.955284 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec214f2f-212d-4ac1-bbea-88a5044fc174 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:38.960013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 90/174] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:38 2022] GET /identity/v3/users/20992ce0ed594e3f92a948a56437a7c2 => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:38.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214f2f-212d-4ac1-bbea-88a5044fc174 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:38.995628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 85/175] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:57:39.013205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8132e-7a68-44d4-9417-e328f8adad31 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:39.209268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8132e-7a68-44d4-9417-e328f8adad31 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:39.239736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214f2f-212d-4ac1-bbea-88a5044fc174 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:39.286230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea9e8b-ff5e-4a6c-a7a2-f47bc0055b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:39.287359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea9e8b-ff5e-4a6c-a7a2-f47bc0055b2c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:39.287638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea9e8b-ff5e-4a6c-a7a2-f47bc0055b2c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:39.288034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea9e8b-ff5e-4a6c-a7a2-f47bc0055b2c None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:39.289885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea9e8b-ff5e-4a6c-a7a2-f47bc0055b2c None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:39.291323 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea9e8b-ff5e-4a6c-a7a2-f47bc0055b2c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:39.293771 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 86/176] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:39 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:39.300806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea9e8b-ff5e-4a6c-a7a2-f47bc0055b2c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:39.309658 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9fee3-5072-4363-85af-365c76b88fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:39.310324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9fee3-5072-4363-85af-365c76b88fa1 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:39.310609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9fee3-5072-4363-85af-365c76b88fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:39.310884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9fee3-5072-4363-85af-365c76b88fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:39.469722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea9e8b-ff5e-4a6c-a7a2-f47bc0055b2c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:39.473165 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9fee3-5072-4363-85af-365c76b88fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:39.474847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9fee3-5072-4363-85af-365c76b88fa1 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:39.557370 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6133be-06f6-448a-b0f6-17604bfa0c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:39.558040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6133be-06f6-448a-b0f6-17604bfa0c8c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:39.558324 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6133be-06f6-448a-b0f6-17604bfa0c8c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:39.558596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6133be-06f6-448a-b0f6-17604bfa0c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:39.559440 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6133be-06f6-448a-b0f6-17604bfa0c8c None admin] RBAC: Adding query filter params (role.id=f12928ff609a47a9bef9cb8abc28932b, scope.project.id=01616978948a4ea094e1ee9190ac21f2, user.id=20992ce0ed594e3f92a948a56437a7c2) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:39.559750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6133be-06f6-448a-b0f6-17604bfa0c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:39.561226 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6133be-06f6-448a-b0f6-17604bfa0c8c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:39.578420 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 87/177] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:39 2022] GET /identity/v3/role_assignments?user.id=20992ce0ed594e3f92a948a56437a7c2&scope.project.id=01616978948a4ea094e1ee9190ac21f2&role.id=f12928ff609a47a9bef9cb8abc28932b => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:39.627753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 91/178] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:57:39.633804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6133be-06f6-448a-b0f6-17604bfa0c8c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:39.783692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6133be-06f6-448a-b0f6-17604bfa0c8c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:39.823424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7196d8-260f-4bea-a424-c90d12b6103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:39.824723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7196d8-260f-4bea-a424-c90d12b6103a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:39.825215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7196d8-260f-4bea-a424-c90d12b6103a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:39.825994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7196d8-260f-4bea-a424-c90d12b6103a None admin] PATH_INFO: `/v3/projects/4d3cac363d554bfa94a9c01f8c832e87` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:39.827531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7196d8-260f-4bea-a424-c90d12b6103a None admin] RBAC: Authorizing `identity:get_project(project_id=4d3cac363d554bfa94a9c01f8c832e87)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:39.829227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7196d8-260f-4bea-a424-c90d12b6103a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:39.832148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 88/179] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:39 2022] GET /identity/v3/projects/4d3cac363d554bfa94a9c01f8c832e87 => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:39.841249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9fee3-5072-4363-85af-365c76b88fa1 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:39.986857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9fee3-5072-4363-85af-365c76b88fa1 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:40.030188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a86ccd-2c54-4162-8b60-6b817472181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:40.030914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a86ccd-2c54-4162-8b60-6b817472181b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.031200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a86ccd-2c54-4162-8b60-6b817472181b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.031473 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a86ccd-2c54-4162-8b60-6b817472181b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.032342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a86ccd-2c54-4162-8b60-6b817472181b None admin] RBAC: Adding query filter params (role.id=e67ab18ce1304dc28ac4e134bba5f8be, scope.project.id=4d3cac363d554bfa94a9c01f8c832e87, user.id=20992ce0ed594e3f92a948a56437a7c2) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:40.032653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a86ccd-2c54-4162-8b60-6b817472181b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:40.034163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a86ccd-2c54-4162-8b60-6b817472181b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:40.041116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 92/180] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:39 2022] GET /identity/v3/role_assignments?user.id=20992ce0ed594e3f92a948a56437a7c2&scope.project.id=4d3cac363d554bfa94a9c01f8c832e87&role.id=e67ab18ce1304dc28ac4e134bba5f8be => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:40.132385 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025974d-76d6-4260-a77a-dff4db1dc8c9 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.133084 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025974d-76d6-4260-a77a-dff4db1dc8c9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.133587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025974d-76d6-4260-a77a-dff4db1dc8c9 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.135508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 89/181] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:40.141702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fd5c5-4a08-465d-8dc9-e8efb57498b7 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.141991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fd5c5-4a08-465d-8dc9-e8efb57498b7 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.142268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fd5c5-4a08-465d-8dc9-e8efb57498b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.170206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-867fd5c5-4a08-465d-8dc9-e8efb57498b7 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:40.171507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-867fd5c5-4a08-465d-8dc9-e8efb57498b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:40.260968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 93/182] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:40.294709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025974d-76d6-4260-a77a-dff4db1dc8c9 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:40.431400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025974d-76d6-4260-a77a-dff4db1dc8c9 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:40.469435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d727e-8038-4cfc-baac-e5e9c2bb760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:40.470233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d727e-8038-4cfc-baac-e5e9c2bb760f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.470509 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d727e-8038-4cfc-baac-e5e9c2bb760f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.470777 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d727e-8038-4cfc-baac-e5e9c2bb760f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.476347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc66628-9655-4319-bfa6-1d46a84c4f2f None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.476941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc66628-9655-4319-bfa6-1d46a84c4f2f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.477424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc66628-9655-4319-bfa6-1d46a84c4f2f None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.479176 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 94/183] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:40.481804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d727e-8038-4cfc-baac-e5e9c2bb760f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:40.484748 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dda9e0-884a-44e2-99df-4365f9cf3c8d None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.488310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dda9e0-884a-44e2-99df-4365f9cf3c8d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.488310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dda9e0-884a-44e2-99df-4365f9cf3c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-a21d727e-8038-4cfc-baac-e5e9c2bb760f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:40.489715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:40.490575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:40.491342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 90/184] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:57:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:40.503808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d727e-8038-4cfc-baac-e5e9c2bb760f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:40.518674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b6dda9e0-884a-44e2-99df-4365f9cf3c8d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:40.520259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b6dda9e0-884a-44e2-99df-4365f9cf3c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:40.597130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 95/185] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:40.598740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0cc66-5122-430e-8bc9-cf6417d4c711 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.599033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0cc66-5122-430e-8bc9-cf6417d4c711 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.599312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0cc66-5122-430e-8bc9-cf6417d4c711 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.600714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 96/186] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:40.610354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec336c97-4950-42f5-869c-0702e1ec4fcf None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.610889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec336c97-4950-42f5-869c-0702e1ec4fcf None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.611385 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec336c97-4950-42f5-869c-0702e1ec4fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.618529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d727e-8038-4cfc-baac-e5e9c2bb760f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:40.629078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ec336c97-4950-42f5-869c-0702e1ec4fcf None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:40.630255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ec336c97-4950-42f5-869c-0702e1ec4fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:40.654550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff42f4-bfae-4fc0-94c1-2f0692bf9941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:40.655210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff42f4-bfae-4fc0-94c1-2f0692bf9941 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.655493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff42f4-bfae-4fc0-94c1-2f0692bf9941 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.656026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff42f4-bfae-4fc0-94c1-2f0692bf9941 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.656801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff42f4-bfae-4fc0-94c1-2f0692bf9941 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:40.657107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff42f4-bfae-4fc0-94c1-2f0692bf9941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:40.658463 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff42f4-bfae-4fc0-94c1-2f0692bf9941 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:40.666302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 91/187] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:40.667076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff42f4-bfae-4fc0-94c1-2f0692bf9941 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:40.701745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 97/188] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:40.701745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec336c97-4950-42f5-869c-0702e1ec4fcf None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:40.767424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff42f4-bfae-4fc0-94c1-2f0692bf9941 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:40.796830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec336c97-4950-42f5-869c-0702e1ec4fcf None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:40.798590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b35b8-fadd-4dd2-9738-867618d0e238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:40.799387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b35b8-fadd-4dd2-9738-867618d0e238 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.799665 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b35b8-fadd-4dd2-9738-867618d0e238 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.799945 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b35b8-fadd-4dd2-9738-867618d0e238 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.801147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b35b8-fadd-4dd2-9738-867618d0e238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:40.802591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b35b8-fadd-4dd2-9738-867618d0e238 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:40.804226 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 92/189] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:40.805522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b35b8-fadd-4dd2-9738-867618d0e238 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:40.834862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79b34e-fc32-45e3-af44-080a85784f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:40.835730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79b34e-fc32-45e3-af44-080a85784f14 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.836032 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79b34e-fc32-45e3-af44-080a85784f14 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.836339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79b34e-fc32-45e3-af44-080a85784f14 None admin] PATH_INFO: `/v3/users/db4114b17993454aabac45401181e890` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.849377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79b34e-fc32-45e3-af44-080a85784f14 None admin] RBAC: Authorizing `identity:get_user(user_id=db4114b17993454aabac45401181e890)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:40.850766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79b34e-fc32-45e3-af44-080a85784f14 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:40.852834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 98/190] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:40 2022] GET /identity/v3/users/db4114b17993454aabac45401181e890 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:40.853583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79b34e-fc32-45e3-af44-080a85784f14 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:40.901835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b35b8-fadd-4dd2-9738-867618d0e238 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:40.934394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c155f-58f8-4026-b38f-526bf475e94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:40.935194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c155f-58f8-4026-b38f-526bf475e94a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.935476 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c155f-58f8-4026-b38f-526bf475e94a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.935748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c155f-58f8-4026-b38f-526bf475e94a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.946119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c155f-58f8-4026-b38f-526bf475e94a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:40.949337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79b34e-fc32-45e3-af44-080a85784f14 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-c82c155f-58f8-4026-b38f-526bf475e94a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:40.954525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:40.955394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:40.956203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:40.956203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:40.956203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:40.956203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:40.956203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:40.956203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:40.956203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:40.956203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:40.956203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:40.956203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:40.956203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:57:40.956203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:40.960733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 93/191] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:57:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:40.961615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c155f-58f8-4026-b38f-526bf475e94a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:40.983980 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce87cb-b6bd-4bc9-8c27-ecc3ebc289e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:40.984926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce87cb-b6bd-4bc9-8c27-ecc3ebc289e2 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:40.985359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce87cb-b6bd-4bc9-8c27-ecc3ebc289e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:40.985778 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce87cb-b6bd-4bc9-8c27-ecc3ebc289e2 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:40.986630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce87cb-b6bd-4bc9-8c27-ecc3ebc289e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:40.988231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce87cb-b6bd-4bc9-8c27-ecc3ebc289e2 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:41.015917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 99/192] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:57:40 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:57:41.017005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce87cb-b6bd-4bc9-8c27-ecc3ebc289e2 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:41.086889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c155f-58f8-4026-b38f-526bf475e94a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:41.125368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1f360-0370-4b95-a761-be025989c4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:41.126161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1f360-0370-4b95-a761-be025989c4b3 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:41.126578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1f360-0370-4b95-a761-be025989c4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:41.126953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1f360-0370-4b95-a761-be025989c4b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:41.130260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce87cb-b6bd-4bc9-8c27-ecc3ebc289e2 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:41.165298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d9572-c552-421f-85ee-cfc9a1e5c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:41.166404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d9572-c552-421f-85ee-cfc9a1e5c89c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:41.166905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d9572-c552-421f-85ee-cfc9a1e5c89c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:41.167372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d9572-c552-421f-85ee-cfc9a1e5c89c None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:41.168360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d9572-c552-421f-85ee-cfc9a1e5c89c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:41.168866 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d9572-c552-421f-85ee-cfc9a1e5c89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:41.170614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d9572-c552-421f-85ee-cfc9a1e5c89c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:41.180545 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 100/193] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:57:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:41.186535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d9572-c552-421f-85ee-cfc9a1e5c89c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:41.205251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1f360-0370-4b95-a761-be025989c4b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:41.206833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1f360-0370-4b95-a761-be025989c4b3 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:41.311313 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d9572-c552-421f-85ee-cfc9a1e5c89c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:41.344366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 94/194] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:57:41.349239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1f360-0370-4b95-a761-be025989c4b3 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:41.364822 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb5ffc-c70c-4d5f-8bae-6406216061fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:41.365703 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb5ffc-c70c-4d5f-8bae-6406216061fd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:41.365980 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb5ffc-c70c-4d5f-8bae-6406216061fd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:41.366248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb5ffc-c70c-4d5f-8bae-6406216061fd None admin] PATH_INFO: `/v3/users/db4114b17993454aabac45401181e890` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:41.368517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb5ffc-c70c-4d5f-8bae-6406216061fd None admin] RBAC: Authorizing `identity:get_user(user_id=db4114b17993454aabac45401181e890)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:41.369964 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb5ffc-c70c-4d5f-8bae-6406216061fd None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:41.371578 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 101/195] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:41 2022] GET /identity/v3/users/db4114b17993454aabac45401181e890 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:41.378281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb5ffc-c70c-4d5f-8bae-6406216061fd None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:41.469501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1f360-0370-4b95-a761-be025989c4b3 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:41.499937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb5ffc-c70c-4d5f-8bae-6406216061fd None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:41.510257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06037981-e125-471c-ba6c-6e616c51a8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:41.511494 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037981-e125-471c-ba6c-6e616c51a8d2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:41.511776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037981-e125-471c-ba6c-6e616c51a8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:41.512381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037981-e125-471c-ba6c-6e616c51a8d2 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:41.513786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06037981-e125-471c-ba6c-6e616c51a8d2 None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:41.515741 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06037981-e125-471c-ba6c-6e616c51a8d2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:41.518065 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 95/196] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:41 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:41.519518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107485-8fc7-423d-bc66-413262e0f89c None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:41.519804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107485-8fc7-423d-bc66-413262e0f89c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:41.520077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107485-8fc7-423d-bc66-413262e0f89c None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:41.521823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 96/197] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:41.527072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4107485-8fc7-423d-bc66-413262e0f89c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:41.539111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2f3cd-7f17-483c-946a-daa14bffb452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:41.540679 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2f3cd-7f17-483c-946a-daa14bffb452 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:41.540964 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2f3cd-7f17-483c-946a-daa14bffb452 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:41.541233 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2f3cd-7f17-483c-946a-daa14bffb452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:41.634454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2f3cd-7f17-483c-946a-daa14bffb452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:41.634780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4107485-8fc7-423d-bc66-413262e0f89c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:41.635846 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2f3cd-7f17-483c-946a-daa14bffb452 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:41.669478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab72d1-4124-4c63-b466-3f1d198a8ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:41.670172 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab72d1-4124-4c63-b466-3f1d198a8ce1 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:41.670540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab72d1-4124-4c63-b466-3f1d198a8ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:41.670814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab72d1-4124-4c63-b466-3f1d198a8ce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:41.671692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab72d1-4124-4c63-b466-3f1d198a8ce1 None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=f51e80d377884c07b775ad9e99feb88a, user.id=db4114b17993454aabac45401181e890) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:41.672005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab72d1-4124-4c63-b466-3f1d198a8ce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:41.673518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab72d1-4124-4c63-b466-3f1d198a8ce1 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:41.679022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 97/198] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:41 2022] GET /identity/v3/role_assignments?user.id=db4114b17993454aabac45401181e890&scope.project.id=f51e80d377884c07b775ad9e99feb88a&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:41.680455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae804e-1ebf-4e63-83dd-81b4b83eef8c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:41.680797 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae804e-1ebf-4e63-83dd-81b4b83eef8c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:41.681072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae804e-1ebf-4e63-83dd-81b4b83eef8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:41.698111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0aae804e-1ebf-4e63-83dd-81b4b83eef8c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:41.699291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0aae804e-1ebf-4e63-83dd-81b4b83eef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:41.738666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 102/199] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:57:41.744583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2f3cd-7f17-483c-946a-daa14bffb452 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:41.769919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 98/200] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:41.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae804e-1ebf-4e63-83dd-81b4b83eef8c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:41.897656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae804e-1ebf-4e63-83dd-81b4b83eef8c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:41.915186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2f3cd-7f17-483c-946a-daa14bffb452 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:41.933121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad3a4a-e94c-4993-b94a-feaf8d499824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:41.933964 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad3a4a-e94c-4993-b94a-feaf8d499824 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:41.934247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad3a4a-e94c-4993-b94a-feaf8d499824 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:41.934502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad3a4a-e94c-4993-b94a-feaf8d499824 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:41.945147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad3a4a-e94c-4993-b94a-feaf8d499824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:41.950962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4890ba-044f-4694-936f-c95608609cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:41.951821 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4890ba-044f-4694-936f-c95608609cda None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:41.952132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4890ba-044f-4694-936f-c95608609cda None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:41.952398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4890ba-044f-4694-936f-c95608609cda None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:41.953605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4890ba-044f-4694-936f-c95608609cda None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:41.955047 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4890ba-044f-4694-936f-c95608609cda None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-30ad3a4a-e94c-4993-b94a-feaf8d499824 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:41.958367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:41.960709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:41.962958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 99/202] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:41.963779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 103/202] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:41 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:41.963864 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad3a4a-e94c-4993-b94a-feaf8d499824 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:41.969423 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4890ba-044f-4694-936f-c95608609cda None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:42.067868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad3a4a-e94c-4993-b94a-feaf8d499824 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:42.098101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4890ba-044f-4694-936f-c95608609cda None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:42.105928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f8899-7325-48be-a50f-2a8762de35f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:42.106948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f8899-7325-48be-a50f-2a8762de35f0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:42.107478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f8899-7325-48be-a50f-2a8762de35f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:42.107943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f8899-7325-48be-a50f-2a8762de35f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:42.109021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f8899-7325-48be-a50f-2a8762de35f0 None admin] RBAC: Adding query filter params (role.id=f12928ff609a47a9bef9cb8abc28932b, scope.project.id=f51e80d377884c07b775ad9e99feb88a, user.id=db4114b17993454aabac45401181e890) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:42.109528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f8899-7325-48be-a50f-2a8762de35f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:42.111169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f8899-7325-48be-a50f-2a8762de35f0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:42.117358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 100/203] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:41 2022] GET /identity/v3/role_assignments?user.id=db4114b17993454aabac45401181e890&scope.project.id=f51e80d377884c07b775ad9e99feb88a&role.id=f12928ff609a47a9bef9cb8abc28932b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:42.135220 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b3533-9886-4f71-a5ff-8f026ab50a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:42.135905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b3533-9886-4f71-a5ff-8f026ab50a25 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:42.136276 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b3533-9886-4f71-a5ff-8f026ab50a25 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:42.136554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b3533-9886-4f71-a5ff-8f026ab50a25 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:42.137320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b3533-9886-4f71-a5ff-8f026ab50a25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:42.137626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b3533-9886-4f71-a5ff-8f026ab50a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:42.139040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b3533-9886-4f71-a5ff-8f026ab50a25 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:42.153945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 104/204] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:42.155292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f8899-7325-48be-a50f-2a8762de35f0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:42.272926 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f8899-7325-48be-a50f-2a8762de35f0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:42.309486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3712d-15d3-4954-b5bd-1fb73568da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:42.310370 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3712d-15d3-4954-b5bd-1fb73568da4c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:42.310656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3712d-15d3-4954-b5bd-1fb73568da4c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:42.310924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3712d-15d3-4954-b5bd-1fb73568da4c None admin] PATH_INFO: `/v3/users/7f3f41e0303e40949987c7e50bbcb125` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:42.312159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3712d-15d3-4954-b5bd-1fb73568da4c None admin] RBAC: Authorizing `identity:get_user(user_id=7f3f41e0303e40949987c7e50bbcb125)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:42.313597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3712d-15d3-4954-b5bd-1fb73568da4c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:42.319813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 101/205] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:42 2022] GET /identity/v3/users/7f3f41e0303e40949987c7e50bbcb125 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:42.321727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b3533-9886-4f71-a5ff-8f026ab50a25 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:42.426357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b3533-9886-4f71-a5ff-8f026ab50a25 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:42.460033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76f80d-a3e2-45ec-842f-02804a9f0055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:42.460708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76f80d-a3e2-45ec-842f-02804a9f0055 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:42.461016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76f80d-a3e2-45ec-842f-02804a9f0055 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:42.461295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76f80d-a3e2-45ec-842f-02804a9f0055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:42.529699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76f80d-a3e2-45ec-842f-02804a9f0055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:42.531161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76f80d-a3e2-45ec-842f-02804a9f0055 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:42.627494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 105/206] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:57:42.633295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3712d-15d3-4954-b5bd-1fb73568da4c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:42.733440 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3712d-15d3-4954-b5bd-1fb73568da4c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:42.766142 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9569d9a-17a0-432d-a6e1-b3695b02dc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:42.766997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9569d9a-17a0-432d-a6e1-b3695b02dc68 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:42.767277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9569d9a-17a0-432d-a6e1-b3695b02dc68 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:42.767550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9569d9a-17a0-432d-a6e1-b3695b02dc68 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:42.768736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9569d9a-17a0-432d-a6e1-b3695b02dc68 None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:42.770169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9569d9a-17a0-432d-a6e1-b3695b02dc68 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:42.776200 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 102/207] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:42 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:42.778099 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76f80d-a3e2-45ec-842f-02804a9f0055 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:42.874021 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76f80d-a3e2-45ec-842f-02804a9f0055 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:42.906882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5105d-34a5-483a-bc87-32a6f8533045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:42.907549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5105d-34a5-483a-bc87-32a6f8533045 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:42.907817 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5105d-34a5-483a-bc87-32a6f8533045 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:42.908113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5105d-34a5-483a-bc87-32a6f8533045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:42.908945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5105d-34a5-483a-bc87-32a6f8533045 None admin] RBAC: Adding query filter params (role.id=4f6101138a274d1d8a67780808b9a71e, scope.project.id=01616978948a4ea094e1ee9190ac21f2, user.id=7f3f41e0303e40949987c7e50bbcb125) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:42.909252 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5105d-34a5-483a-bc87-32a6f8533045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:42.910683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5105d-34a5-483a-bc87-32a6f8533045 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:42.917194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 106/208] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:42 2022] GET /identity/v3/role_assignments?user.id=7f3f41e0303e40949987c7e50bbcb125&scope.project.id=01616978948a4ea094e1ee9190ac21f2&role.id=4f6101138a274d1d8a67780808b9a71e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:43.707458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1701-6b2b-47b8-a2bd-6517fccc6ac4 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:43.708332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1701-6b2b-47b8-a2bd-6517fccc6ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:43.708836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1701-6b2b-47b8-a2bd-6517fccc6ac4 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:43.710423 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 103/209] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:43.716198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce738-6098-4b9e-b3a5-ef163f327e04 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:43.716997 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce738-6098-4b9e-b3a5-ef163f327e04 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:43.717480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce738-6098-4b9e-b3a5-ef163f327e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:43.738022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-bc0ce738-6098-4b9e-b3a5-ef163f327e04 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:43.739559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-bc0ce738-6098-4b9e-b3a5-ef163f327e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:43.806969 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 107/210] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:43.830152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1701-6b2b-47b8-a2bd-6517fccc6ac4 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:43.930814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1701-6b2b-47b8-a2bd-6517fccc6ac4 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:43.967502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4cf3-c7d7-402b-ba2c-71bc532a6868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:43.968695 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4cf3-c7d7-402b-ba2c-71bc532a6868 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:43.969211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4cf3-c7d7-402b-ba2c-71bc532a6868 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:43.969678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4cf3-c7d7-402b-ba2c-71bc532a6868 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:43.971805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6c993-865c-45d9-a542-2f011e738ab9 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:43.972360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6c993-865c-45d9-a542-2f011e738ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:43.972865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6c993-865c-45d9-a542-2f011e738ab9 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:43.978891 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 108/211] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:43.980628 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38820cc-b640-4419-af92-3fc8e732d677 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:43.981116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38820cc-b640-4419-af92-3fc8e732d677 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:43.981588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38820cc-b640-4419-af92-3fc8e732d677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:43.981860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d4cf3-c7d7-402b-ba2c-71bc532a6868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-621d4cf3-c7d7-402b-ba2c-71bc532a6868 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:43.989500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:43.990375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:43.991587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 104/212] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:43.996692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4cf3-c7d7-402b-ba2c-71bc532a6868 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:44.002322 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-c38820cc-b640-4419-af92-3fc8e732d677 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:44.003760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c38820cc-b640-4419-af92-3fc8e732d677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:44.069829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 109/213] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:44.094737 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4cf3-c7d7-402b-ba2c-71bc532a6868 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:44.096415 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38820cc-b640-4419-af92-3fc8e732d677 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:44.127973 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad3880-3ad9-4ac6-89d0-c40f41a74eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:44.128662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad3880-3ad9-4ac6-89d0-c40f41a74eb2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:44.128938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad3880-3ad9-4ac6-89d0-c40f41a74eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:44.129209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad3880-3ad9-4ac6-89d0-c40f41a74eb2 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:44.129969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad3880-3ad9-4ac6-89d0-c40f41a74eb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:44.130242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad3880-3ad9-4ac6-89d0-c40f41a74eb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:44.131807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad3880-3ad9-4ac6-89d0-c40f41a74eb2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:44.140923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 105/214] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:44.149971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad3880-3ad9-4ac6-89d0-c40f41a74eb2 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:44.195905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38820cc-b640-4419-af92-3fc8e732d677 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:44.234062 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01187d5e-2ad3-46f8-a5e6-44573cdcf652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:44.235052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01187d5e-2ad3-46f8-a5e6-44573cdcf652 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:44.235481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01187d5e-2ad3-46f8-a5e6-44573cdcf652 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:44.235893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01187d5e-2ad3-46f8-a5e6-44573cdcf652 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:44.237934 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01187d5e-2ad3-46f8-a5e6-44573cdcf652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:44.240203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01187d5e-2ad3-46f8-a5e6-44573cdcf652 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:44.242585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 110/215] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:44.248306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01187d5e-2ad3-46f8-a5e6-44573cdcf652 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:44.252347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad3880-3ad9-4ac6-89d0-c40f41a74eb2 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:44.298389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458b905-83b8-4e5d-96f2-d3be1893c91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:44.299375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458b905-83b8-4e5d-96f2-d3be1893c91a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:44.299708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458b905-83b8-4e5d-96f2-d3be1893c91a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:44.300416 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458b905-83b8-4e5d-96f2-d3be1893c91a None admin] PATH_INFO: `/v3/users/5ba4da02e7db47c3a32358ac1a38d4b0` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:44.319361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458b905-83b8-4e5d-96f2-d3be1893c91a None admin] RBAC: Authorizing `identity:get_user(user_id=5ba4da02e7db47c3a32358ac1a38d4b0)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:44.321832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458b905-83b8-4e5d-96f2-d3be1893c91a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:44.329425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 106/216] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:44 2022] GET /identity/v3/users/5ba4da02e7db47c3a32358ac1a38d4b0 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:44.331156 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458b905-83b8-4e5d-96f2-d3be1893c91a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:44.365648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01187d5e-2ad3-46f8-a5e6-44573cdcf652 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:44.400711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36517e6a-16fa-404a-ba41-29c5d92e5059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:44.401766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517e6a-16fa-404a-ba41-29c5d92e5059 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:44.402244 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517e6a-16fa-404a-ba41-29c5d92e5059 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:44.402713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517e6a-16fa-404a-ba41-29c5d92e5059 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:44.403612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36517e6a-16fa-404a-ba41-29c5d92e5059 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:44.405377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36517e6a-16fa-404a-ba41-29c5d92e5059 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:44.430005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 111/217] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:57:44 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:57:44.431469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458b905-83b8-4e5d-96f2-d3be1893c91a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:44.476702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5bcbc-cceb-4f44-8fe3-aff384684538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:44.477331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5bcbc-cceb-4f44-8fe3-aff384684538 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:44.477656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5bcbc-cceb-4f44-8fe3-aff384684538 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:44.477928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5bcbc-cceb-4f44-8fe3-aff384684538 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:44.495646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73484727-a934-4610-ba41-b0cf8d0b7bb9 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:44.495960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73484727-a934-4610-ba41-b0cf8d0b7bb9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:44.496239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73484727-a934-4610-ba41-b0cf8d0b7bb9 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:44.497767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 112/218] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:44.505673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954377d-a2f8-4cd5-8348-d2e48fb1d5fd None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:44.506303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954377d-a2f8-4cd5-8348-d2e48fb1d5fd None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:44.506812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954377d-a2f8-4cd5-8348-d2e48fb1d5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:44.525113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-6954377d-a2f8-4cd5-8348-d2e48fb1d5fd None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:44.526683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6954377d-a2f8-4cd5-8348-d2e48fb1d5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:44.551477 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5bcbc-cceb-4f44-8fe3-aff384684538 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:44.552990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5bcbc-cceb-4f44-8fe3-aff384684538 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:44.605383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 113/219] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:44.628562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954377d-a2f8-4cd5-8348-d2e48fb1d5fd None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:44.673859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 107/220] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:57:44.679540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5bcbc-cceb-4f44-8fe3-aff384684538 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:44.759166 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954377d-a2f8-4cd5-8348-d2e48fb1d5fd None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:44.786743 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5bcbc-cceb-4f44-8fe3-aff384684538 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:44.795732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e983949-9cbc-4560-91e2-0ba26ed04bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:44.798005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983949-9cbc-4560-91e2-0ba26ed04bf9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:44.798005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983949-9cbc-4560-91e2-0ba26ed04bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:44.798005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983949-9cbc-4560-91e2-0ba26ed04bf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:44.808350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e983949-9cbc-4560-91e2-0ba26ed04bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-3e983949-9cbc-4560-91e2-0ba26ed04bf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:44.816835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:44.817749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:44.818571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 114/221] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:57:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:44.819728 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12854fb0-ad2c-4b08-906a-6a0cd9d99382 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:44.819887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12854fb0-ad2c-4b08-906a-6a0cd9d99382 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:44.820382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12854fb0-ad2c-4b08-906a-6a0cd9d99382 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:44.822244 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 115/222] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:44.825868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900977b9-f964-4adf-8af6-619324c2fd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:44.826027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12854fb0-ad2c-4b08-906a-6a0cd9d99382 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:44.826732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900977b9-f964-4adf-8af6-619324c2fd54 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:44.827010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900977b9-f964-4adf-8af6-619324c2fd54 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:44.827277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900977b9-f964-4adf-8af6-619324c2fd54 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:44.828654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900977b9-f964-4adf-8af6-619324c2fd54 None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:44.830109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900977b9-f964-4adf-8af6-619324c2fd54 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:44.831947 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 108/223] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:44 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:44.833079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a366a8e-1fdb-4c63-bcff-4d3b3f742e5e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:44.833346 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a366a8e-1fdb-4c63-bcff-4d3b3f742e5e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:44.833618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a366a8e-1fdb-4c63-bcff-4d3b3f742e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:44.851171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-3a366a8e-1fdb-4c63-bcff-4d3b3f742e5e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:44.852906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3a366a8e-1fdb-4c63-bcff-4d3b3f742e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:44.924841 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 109/224] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:44.926280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a366a8e-1fdb-4c63-bcff-4d3b3f742e5e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:44.964729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12854fb0-ad2c-4b08-906a-6a0cd9d99382 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:45.000324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbd2dd-bf19-49d3-b29e-b85a2e28d4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:45.001230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbd2dd-bf19-49d3-b29e-b85a2e28d4c5 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:45.001655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbd2dd-bf19-49d3-b29e-b85a2e28d4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:45.002069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbd2dd-bf19-49d3-b29e-b85a2e28d4c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:45.002958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbd2dd-bf19-49d3-b29e-b85a2e28d4c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:45.003432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbd2dd-bf19-49d3-b29e-b85a2e28d4c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:45.004978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbd2dd-bf19-49d3-b29e-b85a2e28d4c5 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:45.013769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 116/225] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:45.014985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbd2dd-bf19-49d3-b29e-b85a2e28d4c5 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:45.058905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a366a8e-1fdb-4c63-bcff-4d3b3f742e5e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:45.110822 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1cd28-a6b6-4f28-862a-ab822d873307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:45.111847 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1cd28-a6b6-4f28-862a-ab822d873307 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:45.112352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1cd28-a6b6-4f28-862a-ab822d873307 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:45.112851 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1cd28-a6b6-4f28-862a-ab822d873307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:45.113897 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1cd28-a6b6-4f28-862a-ab822d873307 None admin] RBAC: Adding query filter params (role.id=e67ab18ce1304dc28ac4e134bba5f8be, scope.project.id=f51e80d377884c07b775ad9e99feb88a, user.id=5ba4da02e7db47c3a32358ac1a38d4b0) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:45.114405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1cd28-a6b6-4f28-862a-ab822d873307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:45.116061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1cd28-a6b6-4f28-862a-ab822d873307 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:45.122505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 110/226] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:44 2022] GET /identity/v3/role_assignments?user.id=5ba4da02e7db47c3a32358ac1a38d4b0&scope.project.id=f51e80d377884c07b775ad9e99feb88a&role.id=e67ab18ce1304dc28ac4e134bba5f8be => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:45.123670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1cd28-a6b6-4f28-862a-ab822d873307 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:45.128179 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbd2dd-bf19-49d3-b29e-b85a2e28d4c5 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:45.163441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaa890-3379-4984-ba17-d0dcf8684573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:45.165172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaa890-3379-4984-ba17-d0dcf8684573 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:45.165657 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaa890-3379-4984-ba17-d0dcf8684573 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:45.166127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaa890-3379-4984-ba17-d0dcf8684573 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:45.177706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaa890-3379-4984-ba17-d0dcf8684573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-c2eaa890-3379-4984-ba17-d0dcf8684573 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:45.186715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:45.187576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:45.188746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:45.188746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:45.188746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:45.188746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:45.188746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:45.188746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:45.188746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:45.188746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:45.188746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:45.188746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:45.188746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:57:45.188746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:45.190866 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 117/227] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:57:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:45.201433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaa890-3379-4984-ba17-d0dcf8684573 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:45.251477 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1cd28-a6b6-4f28-862a-ab822d873307 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:45.291512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93b813-fd83-4b42-a523-d8fd2b3adbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:45.292341 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93b813-fd83-4b42-a523-d8fd2b3adbfd None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:45.292619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93b813-fd83-4b42-a523-d8fd2b3adbfd None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:45.292886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93b813-fd83-4b42-a523-d8fd2b3adbfd None admin] PATH_INFO: `/v3/users/db4114b17993454aabac45401181e890` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:45.294112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93b813-fd83-4b42-a523-d8fd2b3adbfd None admin] RBAC: Authorizing `identity:get_user(user_id=db4114b17993454aabac45401181e890)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:45.295564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93b813-fd83-4b42-a523-d8fd2b3adbfd None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:45.297773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 111/228] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:45 2022] GET /identity/v3/users/db4114b17993454aabac45401181e890 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:45.306995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93b813-fd83-4b42-a523-d8fd2b3adbfd None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:45.391841 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaa890-3379-4984-ba17-d0dcf8684573 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:45.438088 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb02c32-8276-4fa6-9932-2228d9786775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:45.439118 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb02c32-8276-4fa6-9932-2228d9786775 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:45.439595 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb02c32-8276-4fa6-9932-2228d9786775 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:45.440061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb02c32-8276-4fa6-9932-2228d9786775 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:45.441057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb02c32-8276-4fa6-9932-2228d9786775 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:45.441575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb02c32-8276-4fa6-9932-2228d9786775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:45.443572 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb02c32-8276-4fa6-9932-2228d9786775 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:45.455965 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 118/229] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:57:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:45.461565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb02c32-8276-4fa6-9932-2228d9786775 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:45.486885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93b813-fd83-4b42-a523-d8fd2b3adbfd None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:45.525580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05842590-04b5-4b70-8ddc-2bf5dccdb316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:45.526832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05842590-04b5-4b70-8ddc-2bf5dccdb316 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:45.527979 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05842590-04b5-4b70-8ddc-2bf5dccdb316 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:45.528932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05842590-04b5-4b70-8ddc-2bf5dccdb316 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:45.530569 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05842590-04b5-4b70-8ddc-2bf5dccdb316 None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:45.534819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05842590-04b5-4b70-8ddc-2bf5dccdb316 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:45.537388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 112/230] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:45 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:45.544288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05842590-04b5-4b70-8ddc-2bf5dccdb316 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:45.633257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb02c32-8276-4fa6-9932-2228d9786775 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:45.669684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180a449-28e6-4033-9722-cc2780e72c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:45.671011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180a449-28e6-4033-9722-cc2780e72c02 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:45.671487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180a449-28e6-4033-9722-cc2780e72c02 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:45.671969 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180a449-28e6-4033-9722-cc2780e72c02 None admin] PATH_INFO: `/v3/users/db4114b17993454aabac45401181e890` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:45.673601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180a449-28e6-4033-9722-cc2780e72c02 None admin] RBAC: Authorizing `identity:get_user(user_id=db4114b17993454aabac45401181e890)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:45.675410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180a449-28e6-4033-9722-cc2780e72c02 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:45.677331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 119/231] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:45 2022] GET /identity/v3/users/db4114b17993454aabac45401181e890 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:45.688101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180a449-28e6-4033-9722-cc2780e72c02 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:45.732832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05842590-04b5-4b70-8ddc-2bf5dccdb316 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:45.792161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9e6fa-d898-4ada-8241-2b7d18214f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:45.793046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9e6fa-d898-4ada-8241-2b7d18214f31 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:45.793321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9e6fa-d898-4ada-8241-2b7d18214f31 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:45.793590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9e6fa-d898-4ada-8241-2b7d18214f31 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a/users/db4114b17993454aabac45401181e890/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:45.797755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9e6fa-d898-4ada-8241-2b7d18214f31 None admin] RBAC: Authorizing `identity:create_grant(project_id=f51e80d377884c07b775ad9e99feb88a, user_id=db4114b17993454aabac45401181e890, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:45.799156 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9e6fa-d898-4ada-8241-2b7d18214f31 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:45.827720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 113/232] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:57:45 2022] PUT /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a/users/db4114b17993454aabac45401181e890/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:57:45.867875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180a449-28e6-4033-9722-cc2780e72c02 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:45.912042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3c592-426a-4920-a48f-1a59f1c098b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:45.913007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3c592-426a-4920-a48f-1a59f1c098b4 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:45.913285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3c592-426a-4920-a48f-1a59f1c098b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:45.913556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3c592-426a-4920-a48f-1a59f1c098b4 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:45.914922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3c592-426a-4920-a48f-1a59f1c098b4 None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:45.916820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3c592-426a-4920-a48f-1a59f1c098b4 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:45.918825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 120/233] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:45 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:45.925032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9e6fa-d898-4ada-8241-2b7d18214f31 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:46.043062 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9e6fa-d898-4ada-8241-2b7d18214f31 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:46.079001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248030d-d057-40cd-9b47-77a7db9364a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:46.080276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248030d-d057-40cd-9b47-77a7db9364a8 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:46.080772 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248030d-d057-40cd-9b47-77a7db9364a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:46.081249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248030d-d057-40cd-9b47-77a7db9364a8 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a/users/db4114b17993454aabac45401181e890/roles/f12928ff609a47a9bef9cb8abc28932b` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:46.083666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248030d-d057-40cd-9b47-77a7db9364a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f51e80d377884c07b775ad9e99feb88a, user_id=db4114b17993454aabac45401181e890, role_id=f12928ff609a47a9bef9cb8abc28932b)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:46.085326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248030d-d057-40cd-9b47-77a7db9364a8 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:46.105823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 114/234] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:57:45 2022] PUT /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a/users/db4114b17993454aabac45401181e890/roles/f12928ff609a47a9bef9cb8abc28932b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:57:47.168211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083f939-e2fd-4046-8c31-f2507f5da3f5 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:47.168723 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083f939-e2fd-4046-8c31-f2507f5da3f5 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:47.168798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083f939-e2fd-4046-8c31-f2507f5da3f5 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:47.170385 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 121/235] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:47.186017 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56a93a-bb35-4b34-a905-0683533c6e3a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:47.186489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56a93a-bb35-4b34-a905-0683533c6e3a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:47.186564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56a93a-bb35-4b34-a905-0683533c6e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:47.203963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5a56a93a-bb35-4b34-a905-0683533c6e3a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:47.205180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5a56a93a-bb35-4b34-a905-0683533c6e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:47.256781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fca9c-db69-4237-a55b-010cc8a8e34f None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:47.257086 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fca9c-db69-4237-a55b-010cc8a8e34f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:47.257327 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fca9c-db69-4237-a55b-010cc8a8e34f None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:47.258706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 122/236] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:47.263734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587a31-d3a4-40e4-8c37-6468f26b0a92 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:47.264021 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587a31-d3a4-40e4-8c37-6468f26b0a92 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:47.264321 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587a31-d3a4-40e4-8c37-6468f26b0a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:47.292895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-6c587a31-d3a4-40e4-8c37-6468f26b0a92 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:47.294430 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6c587a31-d3a4-40e4-8c37-6468f26b0a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:47.316456 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 115/237] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:47.339515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56a93a-bb35-4b34-a905-0683533c6e3a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:47.408750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 123/238] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:47.438441 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56a93a-bb35-4b34-a905-0683533c6e3a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:47.445128 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c587a31-d3a4-40e4-8c37-6468f26b0a92 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:47.482719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb24822-1723-41e8-ae52-0d0100832c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:47.483512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb24822-1723-41e8-ae52-0d0100832c4c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:47.483787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb24822-1723-41e8-ae52-0d0100832c4c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:47.484057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb24822-1723-41e8-ae52-0d0100832c4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:47.500750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb24822-1723-41e8-ae52-0d0100832c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-ecb24822-1723-41e8-ae52-0d0100832c4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:47.508540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:47.509426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:47.510211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:47.510211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:47.510211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:47.510211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:47.510211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:47.510211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:47.510211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:47.510211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:47.510211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:47.510211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:47.510211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:47.510211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:47.515767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 116/239] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:47.524550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb24822-1723-41e8-ae52-0d0100832c4c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:47.598161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c587a31-d3a4-40e4-8c37-6468f26b0a92 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:47.643029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5983e16-3376-45be-8f79-425b187c6a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:47.643766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5983e16-3376-45be-8f79-425b187c6a26 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:47.644035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5983e16-3376-45be-8f79-425b187c6a26 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:47.644321 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5983e16-3376-45be-8f79-425b187c6a26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:47.649311 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5983e16-3376-45be-8f79-425b187c6a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:47.650755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5983e16-3376-45be-8f79-425b187c6a26 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:47.652482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 124/240] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:47.657692 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5983e16-3376-45be-8f79-425b187c6a26 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:47.694051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb24822-1723-41e8-ae52-0d0100832c4c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:47.757953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db9d9c-34fb-435f-8589-b7c12efb22d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:47.758637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db9d9c-34fb-435f-8589-b7c12efb22d7 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:47.758920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db9d9c-34fb-435f-8589-b7c12efb22d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:47.759193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db9d9c-34fb-435f-8589-b7c12efb22d7 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:47.759962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db9d9c-34fb-435f-8589-b7c12efb22d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:47.760287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db9d9c-34fb-435f-8589-b7c12efb22d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:47.761678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db9d9c-34fb-435f-8589-b7c12efb22d7 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:47.774923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5983e16-3376-45be-8f79-425b187c6a26 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:47.780426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 117/241] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:47.794080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db9d9c-34fb-435f-8589-b7c12efb22d7 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:47.819306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107b28a-ccf9-4773-8a60-ed3f9b5d512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:47.819982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b28a-ccf9-4773-8a60-ed3f9b5d512a None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:47.820362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b28a-ccf9-4773-8a60-ed3f9b5d512a None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:47.820636 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b28a-ccf9-4773-8a60-ed3f9b5d512a None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:47.821354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107b28a-ccf9-4773-8a60-ed3f9b5d512a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:47.822802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107b28a-ccf9-4773-8a60-ed3f9b5d512a None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:47.855999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 125/242] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:57:47 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:57:47.919434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a85a7-aaf4-45ae-b178-c9975bbc6a62 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:47.920108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a85a7-aaf4-45ae-b178-c9975bbc6a62 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:47.920633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a85a7-aaf4-45ae-b178-c9975bbc6a62 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:47.922472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 126/243] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:47.928081 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed424f-9fdd-4f01-88f9-876b6ef50764 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:47.928669 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed424f-9fdd-4f01-88f9-876b6ef50764 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:47.929160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed424f-9fdd-4f01-88f9-876b6ef50764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:47.953833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b5ed424f-9fdd-4f01-88f9-876b6ef50764 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:47.955437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b5ed424f-9fdd-4f01-88f9-876b6ef50764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:47.963174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db9d9c-34fb-435f-8589-b7c12efb22d7 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:48.042139 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650810bb-0204-4ec5-996a-9978ee76176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:48.044447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650810bb-0204-4ec5-996a-9978ee76176f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:48.046065 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650810bb-0204-4ec5-996a-9978ee76176f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:48.047112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650810bb-0204-4ec5-996a-9978ee76176f None admin] PATH_INFO: `/v3/users/b27a3d25c4724cacaab2bb4fd36cef7f` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:48.079281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 127/244] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:48.084108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650810bb-0204-4ec5-996a-9978ee76176f None admin] RBAC: Authorizing `identity:get_user(user_id=b27a3d25c4724cacaab2bb4fd36cef7f)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:48.084108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650810bb-0204-4ec5-996a-9978ee76176f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:48.084108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 118/245] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:47 2022] GET /identity/v3/users/b27a3d25c4724cacaab2bb4fd36cef7f => generated 297 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:48.088521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed424f-9fdd-4f01-88f9-876b6ef50764 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:48.109144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650810bb-0204-4ec5-996a-9978ee76176f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:48.210198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed424f-9fdd-4f01-88f9-876b6ef50764 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:48.250906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650810bb-0204-4ec5-996a-9978ee76176f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:48.253136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3615834-9338-483c-9e3e-6ae719236984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:48.254828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3615834-9338-483c-9e3e-6ae719236984 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:48.255286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3615834-9338-483c-9e3e-6ae719236984 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:48.255706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3615834-9338-483c-9e3e-6ae719236984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:48.295422 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a4b93-dccd-453d-8898-661bea68f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:48.296449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a4b93-dccd-453d-8898-661bea68f9bc None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:48.296825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a4b93-dccd-453d-8898-661bea68f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:48.297845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a4b93-dccd-453d-8898-661bea68f9bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:48.309342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a4b93-dccd-453d-8898-661bea68f9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-cc0a4b93-dccd-453d-8898-661bea68f9bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:48.317310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:48.318317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:48.319110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 119/246] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:48.325835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a4b93-dccd-453d-8898-661bea68f9bc None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:48.337654 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3615834-9338-483c-9e3e-6ae719236984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:48.339985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3615834-9338-483c-9e3e-6ae719236984 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:48.442971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a4b93-dccd-453d-8898-661bea68f9bc None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:48.454768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 128/247] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:57:48.460134 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3615834-9338-483c-9e3e-6ae719236984 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:48.488505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbcf7a-a31c-44ad-b04e-4e14d86ac4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:48.488505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbcf7a-a31c-44ad-b04e-4e14d86ac4ce None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:48.488505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbcf7a-a31c-44ad-b04e-4e14d86ac4ce None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:48.488505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbcf7a-a31c-44ad-b04e-4e14d86ac4ce None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:48.488906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbcf7a-a31c-44ad-b04e-4e14d86ac4ce None admin] RBAC: Adding query filter params (name=member) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:48.488906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbcf7a-a31c-44ad-b04e-4e14d86ac4ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:48.488906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbcf7a-a31c-44ad-b04e-4e14d86ac4ce None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:48.495860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 120/248] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:48.501622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbcf7a-a31c-44ad-b04e-4e14d86ac4ce None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:48.567553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3615834-9338-483c-9e3e-6ae719236984 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:48.602765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df3f53-4222-4882-9bad-27f7f4caebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:48.603632 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df3f53-4222-4882-9bad-27f7f4caebab None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:48.603736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbcf7a-a31c-44ad-b04e-4e14d86ac4ce None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:48.603915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df3f53-4222-4882-9bad-27f7f4caebab None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:48.604223 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df3f53-4222-4882-9bad-27f7f4caebab None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:48.605597 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df3f53-4222-4882-9bad-27f7f4caebab None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:48.607864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df3f53-4222-4882-9bad-27f7f4caebab None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:48.609839 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 129/249] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:48 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:48.616033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df3f53-4222-4882-9bad-27f7f4caebab None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:48.645003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7583457-d105-4e13-aeff-bc5bb0b25e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:48.646642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7583457-d105-4e13-aeff-bc5bb0b25e57 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:48.646642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7583457-d105-4e13-aeff-bc5bb0b25e57 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:48.646905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7583457-d105-4e13-aeff-bc5bb0b25e57 None admin] PATH_INFO: `/v3/users/5ba4da02e7db47c3a32358ac1a38d4b0` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:48.649818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7583457-d105-4e13-aeff-bc5bb0b25e57 None admin] RBAC: Authorizing `identity:get_user(user_id=5ba4da02e7db47c3a32358ac1a38d4b0)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:48.651880 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7583457-d105-4e13-aeff-bc5bb0b25e57 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:48.653870 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 121/250] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:48 2022] GET /identity/v3/users/5ba4da02e7db47c3a32358ac1a38d4b0 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:48.661002 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7583457-d105-4e13-aeff-bc5bb0b25e57 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:48.748576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df3f53-4222-4882-9bad-27f7f4caebab None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:48.793712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc053e60-5407-4e07-80be-8b2049f7407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:48.794373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc053e60-5407-4e07-80be-8b2049f7407d None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:48.794608 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7583457-d105-4e13-aeff-bc5bb0b25e57 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:48.794710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc053e60-5407-4e07-80be-8b2049f7407d None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:48.794912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc053e60-5407-4e07-80be-8b2049f7407d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:48.795752 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc053e60-5407-4e07-80be-8b2049f7407d None admin] RBAC: Adding query filter params (role.id=4f6101138a274d1d8a67780808b9a71e, scope.project.id=f51e80d377884c07b775ad9e99feb88a, user.id=b27a3d25c4724cacaab2bb4fd36cef7f) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:48.796060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc053e60-5407-4e07-80be-8b2049f7407d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:48.797544 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc053e60-5407-4e07-80be-8b2049f7407d None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:48.814199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 130/251] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:48 2022] GET /identity/v3/role_assignments?user.id=b27a3d25c4724cacaab2bb4fd36cef7f&scope.project.id=f51e80d377884c07b775ad9e99feb88a&role.id=4f6101138a274d1d8a67780808b9a71e => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:48.815322 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f4760-3588-4e90-94e2-aeb9aeeb3e74 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:48.815605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f4760-3588-4e90-94e2-aeb9aeeb3e74 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:48.815883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f4760-3588-4e90-94e2-aeb9aeeb3e74 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:48.817169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 131/252] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:48.826988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ace17-3c69-4ff1-84a6-073bb7687c23 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:48.827290 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ace17-3c69-4ff1-84a6-073bb7687c23 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:48.827566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ace17-3c69-4ff1-84a6-073bb7687c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:48.835243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d2da5-4f7f-48b2-8894-899d6dab98e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:48.837088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d2da5-4f7f-48b2-8894-899d6dab98e0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:48.837577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d2da5-4f7f-48b2-8894-899d6dab98e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:48.838138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d2da5-4f7f-48b2-8894-899d6dab98e0 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:48.840022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d2da5-4f7f-48b2-8894-899d6dab98e0 None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:48.841792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d2da5-4f7f-48b2-8894-899d6dab98e0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:48.843899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 122/253] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:48 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:48.856183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d2da5-4f7f-48b2-8894-899d6dab98e0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:48.861098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-1a9ace17-3c69-4ff1-84a6-073bb7687c23 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:48.861812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-1a9ace17-3c69-4ff1-84a6-073bb7687c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:48.981893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d2da5-4f7f-48b2-8894-899d6dab98e0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:49.035599 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 132/254] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:49.056137 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ea854-b4ef-4f02-a1ee-79a2502f7a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:49.057056 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ea854-b4ef-4f02-a1ee-79a2502f7a8c None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:49.057384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ea854-b4ef-4f02-a1ee-79a2502f7a8c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:49.057657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ea854-b4ef-4f02-a1ee-79a2502f7a8c None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a/users/5ba4da02e7db47c3a32358ac1a38d4b0/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:49.059790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ea854-b4ef-4f02-a1ee-79a2502f7a8c None admin] RBAC: Authorizing `identity:create_grant(project_id=f51e80d377884c07b775ad9e99feb88a, user_id=5ba4da02e7db47c3a32358ac1a38d4b0, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:49.061289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ea854-b4ef-4f02-a1ee-79a2502f7a8c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:49.076982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ace17-3c69-4ff1-84a6-073bb7687c23 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:49.093671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 123/255] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:57:48 2022] PUT /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a/users/5ba4da02e7db47c3a32358ac1a38d4b0/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:57:49.193323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ace17-3c69-4ff1-84a6-073bb7687c23 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:49.220619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9363-e228-4eb4-b9db-12bd09e2cd93 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:49.220920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9363-e228-4eb4-b9db-12bd09e2cd93 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:49.221179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9363-e228-4eb4-b9db-12bd09e2cd93 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:49.222689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 124/256] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:49.235964 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308c16-f447-4ddc-bb86-8cf39b8c10c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:49.237012 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308c16-f447-4ddc-bb86-8cf39b8c10c6 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:49.237296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308c16-f447-4ddc-bb86-8cf39b8c10c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:49.237566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308c16-f447-4ddc-bb86-8cf39b8c10c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:49.245532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6ac17-ce6b-42ce-8e33-855ed4f21c6d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:49.245810 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6ac17-ce6b-42ce-8e33-855ed4f21c6d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:49.246086 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6ac17-ce6b-42ce-8e33-855ed4f21c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:49.250315 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8308c16-f447-4ddc-bb86-8cf39b8c10c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-d8308c16-f447-4ddc-bb86-8cf39b8c10c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:49.259507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:49.260702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:49.261702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:49.261702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:49.261702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:49.261702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:49.261702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:49.261702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:49.261702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:49.261702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:49.261702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:49.261702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:49.261702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:57:49.261702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:49.265338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 133/257] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:57:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:49.273044 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308c16-f447-4ddc-bb86-8cf39b8c10c6 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:49.282358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-abb6ac17-ce6b-42ce-8e33-855ed4f21c6d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:49.283565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-abb6ac17-ce6b-42ce-8e33-855ed4f21c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:49.418525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308c16-f447-4ddc-bb86-8cf39b8c10c6 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:49.457057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3684b-d1a1-4387-a466-fc14a7616340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:49.458037 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3684b-d1a1-4387-a466-fc14a7616340 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:49.458460 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3684b-d1a1-4387-a466-fc14a7616340 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:49.458851 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 125/258] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:49.459323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3684b-d1a1-4387-a466-fc14a7616340 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:49.460789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3684b-d1a1-4387-a466-fc14a7616340 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:49.461242 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3684b-d1a1-4387-a466-fc14a7616340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:49.463154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3684b-d1a1-4387-a466-fc14a7616340 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:49.475727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 134/259] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:49.482105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6ac17-ce6b-42ce-8e33-855ed4f21c6d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:49.499133 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3684b-d1a1-4387-a466-fc14a7616340 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:49.623863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6ac17-ce6b-42ce-8e33-855ed4f21c6d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:49.647500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3684b-d1a1-4387-a466-fc14a7616340 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:49.684838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675e07-b439-4edf-979d-ff471f58fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:49.685635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675e07-b439-4edf-979d-ff471f58fb27 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:49.685908 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675e07-b439-4edf-979d-ff471f58fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:49.686174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675e07-b439-4edf-979d-ff471f58fb27 None admin] PATH_INFO: `/v3/users/db4114b17993454aabac45401181e890` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:49.688322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99675e07-b439-4edf-979d-ff471f58fb27 None admin] RBAC: Authorizing `identity:get_user(user_id=db4114b17993454aabac45401181e890)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:49.689761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99675e07-b439-4edf-979d-ff471f58fb27 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:49.691366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 126/260] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:49 2022] GET /identity/v3/users/db4114b17993454aabac45401181e890 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:49.706479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675e07-b439-4edf-979d-ff471f58fb27 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:49.716369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042980a9-81dd-474b-b0d4-208b9d9de278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:49.717186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042980a9-81dd-474b-b0d4-208b9d9de278 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:49.717458 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042980a9-81dd-474b-b0d4-208b9d9de278 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:49.717722 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042980a9-81dd-474b-b0d4-208b9d9de278 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:49.739322 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042980a9-81dd-474b-b0d4-208b9d9de278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-042980a9-81dd-474b-b0d4-208b9d9de278 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:49.747369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:49.748269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:49.749061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:49.749061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:49.749061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:49.749061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:49.749061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:49.749061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:49.749061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:49.749061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:49.749061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:49.749061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:49.749061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:57:49.749061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:49.750198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 135/261] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:57:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:49.759681 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042980a9-81dd-474b-b0d4-208b9d9de278 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:49.900081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675e07-b439-4edf-979d-ff471f58fb27 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:49.962587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f57c52-5e9c-486a-902d-75fb91603e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:49.963169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f57c52-5e9c-486a-902d-75fb91603e5c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:49.963448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f57c52-5e9c-486a-902d-75fb91603e5c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:49.963717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f57c52-5e9c-486a-902d-75fb91603e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:49.964511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042980a9-81dd-474b-b0d4-208b9d9de278 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:50.053662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad051c5-4696-48a4-aeab-40d7673a9944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:50.054337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad051c5-4696-48a4-aeab-40d7673a9944 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:50.054668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad051c5-4696-48a4-aeab-40d7673a9944 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:50.054940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad051c5-4696-48a4-aeab-40d7673a9944 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:50.055682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad051c5-4696-48a4-aeab-40d7673a9944 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:50.060606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad051c5-4696-48a4-aeab-40d7673a9944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:50.061984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad051c5-4696-48a4-aeab-40d7673a9944 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:50.074965 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 136/262] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:57:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:50.080742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad051c5-4696-48a4-aeab-40d7673a9944 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:50.105178 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f57c52-5e9c-486a-902d-75fb91603e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:50.106823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f57c52-5e9c-486a-902d-75fb91603e5c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:50.300546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 127/263] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:57:50.306414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f57c52-5e9c-486a-902d-75fb91603e5c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:50.315624 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad051c5-4696-48a4-aeab-40d7673a9944 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:50.381853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910393-5a5d-4e37-9be5-a282dd93c6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:50.384110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910393-5a5d-4e37-9be5-a282dd93c6b8 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:50.384673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910393-5a5d-4e37-9be5-a282dd93c6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:50.385144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910393-5a5d-4e37-9be5-a282dd93c6b8 None admin] PATH_INFO: `/v3/users/db4114b17993454aabac45401181e890` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:50.388726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e910393-5a5d-4e37-9be5-a282dd93c6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=db4114b17993454aabac45401181e890)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:50.390999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e910393-5a5d-4e37-9be5-a282dd93c6b8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:50.393065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 137/264] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:50 2022] GET /identity/v3/users/db4114b17993454aabac45401181e890 => generated 283 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:50.399465 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910393-5a5d-4e37-9be5-a282dd93c6b8 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:50.473986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f57c52-5e9c-486a-902d-75fb91603e5c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:50.523461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7e444-9289-46f6-b660-7753f436be51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:50.524425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7e444-9289-46f6-b660-7753f436be51 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:50.524713 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7e444-9289-46f6-b660-7753f436be51 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:50.524985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7e444-9289-46f6-b660-7753f436be51 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:50.528826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7e444-9289-46f6-b660-7753f436be51 None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:50.530303 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7e444-9289-46f6-b660-7753f436be51 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:50.532255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 128/265] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:50 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:50.538154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7e444-9289-46f6-b660-7753f436be51 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:50.657226 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910393-5a5d-4e37-9be5-a282dd93c6b8 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:50.737776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007993f2-92c4-4c8d-8d93-cc51f31ddd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:50.738439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007993f2-92c4-4c8d-8d93-cc51f31ddd51 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:50.738717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007993f2-92c4-4c8d-8d93-cc51f31ddd51 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:50.738989 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007993f2-92c4-4c8d-8d93-cc51f31ddd51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:50.776072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7e444-9289-46f6-b660-7753f436be51 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:50.841327 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe15b8a-670a-4e00-976c-8dcb607bac2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:50.842402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe15b8a-670a-4e00-976c-8dcb607bac2c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:50.842930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe15b8a-670a-4e00-976c-8dcb607bac2c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:50.843399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe15b8a-670a-4e00-976c-8dcb607bac2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:50.844479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe15b8a-670a-4e00-976c-8dcb607bac2c None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=f51e80d377884c07b775ad9e99feb88a, user.id=db4114b17993454aabac45401181e890) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:50.844987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe15b8a-670a-4e00-976c-8dcb607bac2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:50.846620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe15b8a-670a-4e00-976c-8dcb607bac2c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:50.856953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 129/266] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:50 2022] GET /identity/v3/role_assignments?user.id=db4114b17993454aabac45401181e890&scope.project.id=f51e80d377884c07b775ad9e99feb88a&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:50.894247 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007993f2-92c4-4c8d-8d93-cc51f31ddd51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:50.895753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007993f2-92c4-4c8d-8d93-cc51f31ddd51 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:51.035065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 138/267] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:57:51.041519 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe15b8a-670a-4e00-976c-8dcb607bac2c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:51.158948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe15b8a-670a-4e00-976c-8dcb607bac2c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:51.194426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b263d8-430f-47a9-8de8-cf9cc7041508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:51.195342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b263d8-430f-47a9-8de8-cf9cc7041508 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:51.195626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b263d8-430f-47a9-8de8-cf9cc7041508 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:51.195899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b263d8-430f-47a9-8de8-cf9cc7041508 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:51.197154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b263d8-430f-47a9-8de8-cf9cc7041508 None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:51.198621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b263d8-430f-47a9-8de8-cf9cc7041508 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:51.201003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 130/268] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:51 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:51.209205 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007993f2-92c4-4c8d-8d93-cc51f31ddd51 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:51.340262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007993f2-92c4-4c8d-8d93-cc51f31ddd51 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:51.389752 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632d27b-070e-4afa-bfd5-bb018f17d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:51.390421 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632d27b-070e-4afa-bfd5-bb018f17d2bb None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:51.390698 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632d27b-070e-4afa-bfd5-bb018f17d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:51.390965 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632d27b-070e-4afa-bfd5-bb018f17d2bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:51.391797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632d27b-070e-4afa-bfd5-bb018f17d2bb None admin] RBAC: Adding query filter params (role.id=f12928ff609a47a9bef9cb8abc28932b, scope.project.id=f51e80d377884c07b775ad9e99feb88a, user.id=db4114b17993454aabac45401181e890) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:51.392115 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632d27b-070e-4afa-bfd5-bb018f17d2bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:51.393553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632d27b-070e-4afa-bfd5-bb018f17d2bb None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:51.404594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 139/269] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:51 2022] GET /identity/v3/role_assignments?user.id=db4114b17993454aabac45401181e890&scope.project.id=f51e80d377884c07b775ad9e99feb88a&role.id=f12928ff609a47a9bef9cb8abc28932b => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:51.689107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82459c-3a91-4c10-a0b4-d6449fbd8d82 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:51.689603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82459c-3a91-4c10-a0b4-d6449fbd8d82 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:51.689603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82459c-3a91-4c10-a0b4-d6449fbd8d82 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:51.691294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 131/270] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:51.697209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61738680-4cb9-4547-8f60-55b9e2a8d94c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:51.697491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61738680-4cb9-4547-8f60-55b9e2a8d94c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:51.697760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61738680-4cb9-4547-8f60-55b9e2a8d94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:51.721217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-61738680-4cb9-4547-8f60-55b9e2a8d94c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:51.722426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-61738680-4cb9-4547-8f60-55b9e2a8d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:51.772987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5a133-6152-4773-8f0d-af5d7beedd72 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:51.773316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5a133-6152-4773-8f0d-af5d7beedd72 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:51.773583 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5a133-6152-4773-8f0d-af5d7beedd72 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:51.775201 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 132/271] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:51.780400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62b807-dc3a-4113-bc67-73c4dcd121a9 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:51.780686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62b807-dc3a-4113-bc67-73c4dcd121a9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:51.780968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62b807-dc3a-4113-bc67-73c4dcd121a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:51.798301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 140/272] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:51.798496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-3b62b807-dc3a-4113-bc67-73c4dcd121a9 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:51.799655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3b62b807-dc3a-4113-bc67-73c4dcd121a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:51.824524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61738680-4cb9-4547-8f60-55b9e2a8d94c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:51.875171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 133/273] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:51.901820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62b807-dc3a-4113-bc67-73c4dcd121a9 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:51.943723 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61738680-4cb9-4547-8f60-55b9e2a8d94c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:51.996391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc953d-7cc2-43ff-9f18-a3cf94c39632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:51.997363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc953d-7cc2-43ff-9f18-a3cf94c39632 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:51.997704 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc953d-7cc2-43ff-9f18-a3cf94c39632 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:51.998052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc953d-7cc2-43ff-9f18-a3cf94c39632 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.012073 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc953d-7cc2-43ff-9f18-a3cf94c39632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-dadc953d-7cc2-43ff-9f18-a3cf94c39632 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:52.020453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:52.021409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:52.022200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 141/274] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:52.028229 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc953d-7cc2-43ff-9f18-a3cf94c39632 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:52.033783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62b807-dc3a-4113-bc67-73c4dcd121a9 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:52.081438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfea8f2-a443-40ca-b0dd-87ee1c7cd885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:52.082754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfea8f2-a443-40ca-b0dd-87ee1c7cd885 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.083229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfea8f2-a443-40ca-b0dd-87ee1c7cd885 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.084016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfea8f2-a443-40ca-b0dd-87ee1c7cd885 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.085767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfea8f2-a443-40ca-b0dd-87ee1c7cd885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:52.087834 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfea8f2-a443-40ca-b0dd-87ee1c7cd885 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:52.090405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 134/275] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:52.096845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfea8f2-a443-40ca-b0dd-87ee1c7cd885 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:52.145647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc953d-7cc2-43ff-9f18-a3cf94c39632 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:52.178925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8b39-66c4-4042-87f9-4d49ec22c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:52.180371 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8b39-66c4-4042-87f9-4d49ec22c0e5 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.180724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8b39-66c4-4042-87f9-4d49ec22c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.181066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8b39-66c4-4042-87f9-4d49ec22c0e5 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.181887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc8b39-66c4-4042-87f9-4d49ec22c0e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:52.182265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc8b39-66c4-4042-87f9-4d49ec22c0e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:52.183738 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc8b39-66c4-4042-87f9-4d49ec22c0e5 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:52.192789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 142/276] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:52.195901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a71fce-45b1-4730-93b4-1a7c04509a50 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.196192 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a71fce-45b1-4730-93b4-1a7c04509a50 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.196477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a71fce-45b1-4730-93b4-1a7c04509a50 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.197834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 143/277] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:52.199318 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a71fce-45b1-4730-93b4-1a7c04509a50 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:52.206458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfea8f2-a443-40ca-b0dd-87ee1c7cd885 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:52.244111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f5d1c-e89b-4b9a-a533-d904de5d5a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:52.244791 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f5d1c-e89b-4b9a-a533-d904de5d5a26 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.245067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f5d1c-e89b-4b9a-a533-d904de5d5a26 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.245335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f5d1c-e89b-4b9a-a533-d904de5d5a26 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.246037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f5d1c-e89b-4b9a-a533-d904de5d5a26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:52.247518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f5d1c-e89b-4b9a-a533-d904de5d5a26 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:52.268005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 135/278] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:57:52 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:57:52.269238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1124d4a-9a97-4312-abdb-268d3aba4ff3 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.269513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1124d4a-9a97-4312-abdb-268d3aba4ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.269784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1124d4a-9a97-4312-abdb-268d3aba4ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.292115 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-d1124d4a-9a97-4312-abdb-268d3aba4ff3 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:52.293909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d1124d4a-9a97-4312-abdb-268d3aba4ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:52.307341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a71fce-45b1-4730-93b4-1a7c04509a50 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:52.343491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496151a2-5083-4966-a3e3-29bc2b837f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:52.344419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496151a2-5083-4966-a3e3-29bc2b837f9d None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.344703 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496151a2-5083-4966-a3e3-29bc2b837f9d None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.344977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496151a2-5083-4966-a3e3-29bc2b837f9d None admin] PATH_INFO: `/v3/users/9dfc16bc549f4e5eb5b27c5b1b46d0fd` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.359541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496151a2-5083-4966-a3e3-29bc2b837f9d None admin] RBAC: Authorizing `identity:get_user(user_id=9dfc16bc549f4e5eb5b27c5b1b46d0fd)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:52.361055 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496151a2-5083-4966-a3e3-29bc2b837f9d None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:52.362986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 144/279] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:52 2022] GET /identity/v3/users/9dfc16bc549f4e5eb5b27c5b1b46d0fd => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:52.364351 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07539da2-30ee-4153-9698-3e294e8f03fe None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.364631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07539da2-30ee-4153-9698-3e294e8f03fe None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.364898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07539da2-30ee-4153-9698-3e294e8f03fe None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.366246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 145/280] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:52.373797 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 136/281] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:52.374006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07539da2-30ee-4153-9698-3e294e8f03fe None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:52.374130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d60e2-9540-4efa-aa13-0e176db37482 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.374130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d60e2-9540-4efa-aa13-0e176db37482 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.374130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d60e2-9540-4efa-aa13-0e176db37482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.393086 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-cf6d60e2-9540-4efa-aa13-0e176db37482 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:52.394354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-cf6d60e2-9540-4efa-aa13-0e176db37482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:52.463324 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 137/282] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:52.464118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d60e2-9540-4efa-aa13-0e176db37482 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:52.482095 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07539da2-30ee-4153-9698-3e294e8f03fe None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:52.521598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328a7f4-2bb5-4735-a77b-350a088ebd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:52.522592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328a7f4-2bb5-4735-a77b-350a088ebd98 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.523088 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328a7f4-2bb5-4735-a77b-350a088ebd98 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.523581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328a7f4-2bb5-4735-a77b-350a088ebd98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.524638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328a7f4-2bb5-4735-a77b-350a088ebd98 None admin] RBAC: Adding query filter params (role.id=e67ab18ce1304dc28ac4e134bba5f8be, user.id=9dfc16bc549f4e5eb5b27c5b1b46d0fd, scope.system=all) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:52.525121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328a7f4-2bb5-4735-a77b-350a088ebd98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:52.526711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328a7f4-2bb5-4735-a77b-350a088ebd98 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:52.532180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 146/283] 10.222.0.23 () {56 vars in 1308 bytes} [Tue May 3 08:57:52 2022] GET /identity/v3/role_assignments?user.id=9dfc16bc549f4e5eb5b27c5b1b46d0fd&scope.system=all&role.id=e67ab18ce1304dc28ac4e134bba5f8be => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:52.533192 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328a7f4-2bb5-4735-a77b-350a088ebd98 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:52.581181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d60e2-9540-4efa-aa13-0e176db37482 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:52.632391 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5be68-3993-4477-a140-9de6f50ad8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:52.633859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5be68-3993-4477-a140-9de6f50ad8ae None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.633859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5be68-3993-4477-a140-9de6f50ad8ae None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.633859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5be68-3993-4477-a140-9de6f50ad8ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.649075 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5be68-3993-4477-a140-9de6f50ad8ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-96c5be68-3993-4477-a140-9de6f50ad8ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:52.656997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:52.657962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:52.658731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 138/284] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:52.666766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5be68-3993-4477-a140-9de6f50ad8ae None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:52.675857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328a7f4-2bb5-4735-a77b-350a088ebd98 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:52.716446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edd750-dce2-48d8-8ede-3c4085f6b0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:52.717625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edd750-dce2-48d8-8ede-3c4085f6b0e4 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.718127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edd750-dce2-48d8-8ede-3c4085f6b0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.718599 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edd750-dce2-48d8-8ede-3c4085f6b0e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.730961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edd750-dce2-48d8-8ede-3c4085f6b0e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-f2edd750-dce2-48d8-8ede-3c4085f6b0e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:52.739394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:52.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:52.741232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:52.741232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:52.741232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:52.741232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:52.741232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:52.741232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:52.741232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:52.741232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:52.741232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:52.741232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:52.741232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:52.741232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:52.743961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 147/285] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:52.749942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edd750-dce2-48d8-8ede-3c4085f6b0e4 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:52.784736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5be68-3993-4477-a140-9de6f50ad8ae None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:52.823427 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31167c9-53af-45d1-a083-3fb2ef7cd1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:52.824107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31167c9-53af-45d1-a083-3fb2ef7cd1d7 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.824549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31167c9-53af-45d1-a083-3fb2ef7cd1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.824828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31167c9-53af-45d1-a083-3fb2ef7cd1d7 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.826160 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31167c9-53af-45d1-a083-3fb2ef7cd1d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:52.826470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31167c9-53af-45d1-a083-3fb2ef7cd1d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:52.828287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31167c9-53af-45d1-a083-3fb2ef7cd1d7 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:52.839687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 139/286] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:52.845581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31167c9-53af-45d1-a083-3fb2ef7cd1d7 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:52.885495 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edd750-dce2-48d8-8ede-3c4085f6b0e4 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:52.949192 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa92cb0-ec93-4853-91b5-8d7caeb1a041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:52.949862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa92cb0-ec93-4853-91b5-8d7caeb1a041 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:52.950143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa92cb0-ec93-4853-91b5-8d7caeb1a041 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:52.950679 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa92cb0-ec93-4853-91b5-8d7caeb1a041 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:52.951424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa92cb0-ec93-4853-91b5-8d7caeb1a041 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:52.951732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa92cb0-ec93-4853-91b5-8d7caeb1a041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:52.953118 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa92cb0-ec93-4853-91b5-8d7caeb1a041 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:52.969924 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 148/287] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:52.979798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa92cb0-ec93-4853-91b5-8d7caeb1a041 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:53.024483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31167c9-53af-45d1-a083-3fb2ef7cd1d7 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:53.066649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378604be-564a-4376-ba41-2917332c243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:53.067873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378604be-564a-4376-ba41-2917332c243f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:53.068443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378604be-564a-4376-ba41-2917332c243f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:53.068914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378604be-564a-4376-ba41-2917332c243f None admin] PATH_INFO: `/v3/users/5ba4da02e7db47c3a32358ac1a38d4b0` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:53.070370 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378604be-564a-4376-ba41-2917332c243f None admin] RBAC: Authorizing `identity:get_user(user_id=5ba4da02e7db47c3a32358ac1a38d4b0)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:53.071998 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378604be-564a-4376-ba41-2917332c243f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:53.074128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 140/288] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:52 2022] GET /identity/v3/users/5ba4da02e7db47c3a32358ac1a38d4b0 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:53.084125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa92cb0-ec93-4853-91b5-8d7caeb1a041 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:53.089928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378604be-564a-4376-ba41-2917332c243f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:53.114952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d24c6-2a30-406e-8c5a-848982b44180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:53.115828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d24c6-2a30-406e-8c5a-848982b44180 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:53.116123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d24c6-2a30-406e-8c5a-848982b44180 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:53.116489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d24c6-2a30-406e-8c5a-848982b44180 None admin] PATH_INFO: `/v3/users/b27a3d25c4724cacaab2bb4fd36cef7f` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:53.117606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d24c6-2a30-406e-8c5a-848982b44180 None admin] RBAC: Authorizing `identity:get_user(user_id=b27a3d25c4724cacaab2bb4fd36cef7f)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:53.119044 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d24c6-2a30-406e-8c5a-848982b44180 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:53.124115 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 149/289] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:52 2022] GET /identity/v3/users/b27a3d25c4724cacaab2bb4fd36cef7f => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:53.126049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d24c6-2a30-406e-8c5a-848982b44180 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:53.243905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378604be-564a-4376-ba41-2917332c243f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:53.292352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83446b-9aee-46ba-9e99-66d2bbca74af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:53.293101 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83446b-9aee-46ba-9e99-66d2bbca74af None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:53.293387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83446b-9aee-46ba-9e99-66d2bbca74af None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:53.293667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83446b-9aee-46ba-9e99-66d2bbca74af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:53.342200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d24c6-2a30-406e-8c5a-848982b44180 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:53.408364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7983412-4a0d-49fc-9318-1bccebe77b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:53.409227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983412-4a0d-49fc-9318-1bccebe77b43 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:53.409502 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983412-4a0d-49fc-9318-1bccebe77b43 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:53.409777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983412-4a0d-49fc-9318-1bccebe77b43 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:53.411762 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7983412-4a0d-49fc-9318-1bccebe77b43 None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:53.413282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7983412-4a0d-49fc-9318-1bccebe77b43 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:53.415191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 150/290] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:53 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:53.416277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83446b-9aee-46ba-9e99-66d2bbca74af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:53.417750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83446b-9aee-46ba-9e99-66d2bbca74af None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:53.421119 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7983412-4a0d-49fc-9318-1bccebe77b43 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:53.539087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7983412-4a0d-49fc-9318-1bccebe77b43 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:53.577718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab990f-205f-4582-832c-a28e8ae57e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:53.578610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab990f-205f-4582-832c-a28e8ae57e36 None admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:53.578887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab990f-205f-4582-832c-a28e8ae57e36 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:53.579157 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab990f-205f-4582-832c-a28e8ae57e36 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a/users/b27a3d25c4724cacaab2bb4fd36cef7f/roles/4f6101138a274d1d8a67780808b9a71e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:53.583347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab990f-205f-4582-832c-a28e8ae57e36 None admin] RBAC: Authorizing `identity:create_grant(project_id=f51e80d377884c07b775ad9e99feb88a, user_id=b27a3d25c4724cacaab2bb4fd36cef7f, role_id=4f6101138a274d1d8a67780808b9a71e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:53.584914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab990f-205f-4582-832c-a28e8ae57e36 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:53.610833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 151/291] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:57:53 2022] PUT /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a/users/b27a3d25c4724cacaab2bb4fd36cef7f/roles/4f6101138a274d1d8a67780808b9a71e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:57:53.618037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 141/292] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:57:53.619480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab990f-205f-4582-832c-a28e8ae57e36 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:53.729496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab990f-205f-4582-832c-a28e8ae57e36 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:53.766416 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f9340-1e4b-4f8d-9ed6-af2556ebcebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:53.767760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f9340-1e4b-4f8d-9ed6-af2556ebcebd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:53.768263 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f9340-1e4b-4f8d-9ed6-af2556ebcebd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:53.768734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f9340-1e4b-4f8d-9ed6-af2556ebcebd None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:53.770277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f9340-1e4b-4f8d-9ed6-af2556ebcebd None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:53.772010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f9340-1e4b-4f8d-9ed6-af2556ebcebd None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:53.774061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 152/293] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:53 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:53.780284 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83446b-9aee-46ba-9e99-66d2bbca74af None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:53.889119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83446b-9aee-46ba-9e99-66d2bbca74af None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:53.927494 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23695e2-3fa4-4adb-b1c7-3110928be14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:53.928165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23695e2-3fa4-4adb-b1c7-3110928be14f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:53.928449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23695e2-3fa4-4adb-b1c7-3110928be14f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:53.928720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23695e2-3fa4-4adb-b1c7-3110928be14f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:53.930162 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23695e2-3fa4-4adb-b1c7-3110928be14f None admin] RBAC: Adding query filter params (role.id=e67ab18ce1304dc28ac4e134bba5f8be, scope.project.id=f51e80d377884c07b775ad9e99feb88a, user.id=5ba4da02e7db47c3a32358ac1a38d4b0) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:53.930467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23695e2-3fa4-4adb-b1c7-3110928be14f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:53.931887 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23695e2-3fa4-4adb-b1c7-3110928be14f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:53.937927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 142/294] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:53 2022] GET /identity/v3/role_assignments?user.id=5ba4da02e7db47c3a32358ac1a38d4b0&scope.project.id=f51e80d377884c07b775ad9e99feb88a&role.id=e67ab18ce1304dc28ac4e134bba5f8be => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:55.034635 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c993ab-341a-4453-8bc8-d55221083b5f None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.035644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c993ab-341a-4453-8bc8-d55221083b5f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.036175 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c993ab-341a-4453-8bc8-d55221083b5f None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.038041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 153/295] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:55.044372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357c8f6-a413-4dc0-8865-0dde9da5d832 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.045194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357c8f6-a413-4dc0-8865-0dde9da5d832 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.045998 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357c8f6-a413-4dc0-8865-0dde9da5d832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.047248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1197a58-18a3-4634-8786-9e58a62df126 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.047539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1197a58-18a3-4634-8786-9e58a62df126 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.047818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1197a58-18a3-4634-8786-9e58a62df126 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.049405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 154/296] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:55.054273 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d426-c604-4515-86b4-50e72a98b77c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.054594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d426-c604-4515-86b4-50e72a98b77c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.054879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d426-c604-4515-86b4-50e72a98b77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.067471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-d357c8f6-a413-4dc0-8865-0dde9da5d832 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:55.068985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d357c8f6-a413-4dc0-8865-0dde9da5d832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:55.071021 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-6434d426-c604-4515-86b4-50e72a98b77c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:55.072184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6434d426-c604-4515-86b4-50e72a98b77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:55.139963 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 155/297] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:55.141765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141ffd9-c2b0-416a-8214-c541890f75d9 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.142260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141ffd9-c2b0-416a-8214-c541890f75d9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.142730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141ffd9-c2b0-416a-8214-c541890f75d9 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.144472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 156/298] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:55.150224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c5f02-b8e9-40f3-b4df-6985b471291b None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.150505 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c5f02-b8e9-40f3-b4df-6985b471291b None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.150773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c5f02-b8e9-40f3-b4df-6985b471291b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.153343 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 143/299] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:55.163592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357c8f6-a413-4dc0-8865-0dde9da5d832 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:55.171877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-486c5f02-b8e9-40f3-b4df-6985b471291b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:55.173660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-486c5f02-b8e9-40f3-b4df-6985b471291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:55.247403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 157/300] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:55.248510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c5f02-b8e9-40f3-b4df-6985b471291b None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:55.275400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357c8f6-a413-4dc0-8865-0dde9da5d832 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:55.309279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07e02a-f507-4919-b9cd-9ca182ff4f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:55.309982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07e02a-f507-4919-b9cd-9ca182ff4f25 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.310270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07e02a-f507-4919-b9cd-9ca182ff4f25 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.310537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07e02a-f507-4919-b9cd-9ca182ff4f25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.311692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07e02a-f507-4919-b9cd-9ca182ff4f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:55.313171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07e02a-f507-4919-b9cd-9ca182ff4f25 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:55.314948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 144/301] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:55.315515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07e02a-f507-4919-b9cd-9ca182ff4f25 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:55.344726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c5f02-b8e9-40f3-b4df-6985b471291b None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:55.376954 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44401-4820-4b19-8a61-719e0cacf137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:55.377746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44401-4820-4b19-8a61-719e0cacf137 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.378028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44401-4820-4b19-8a61-719e0cacf137 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.378305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44401-4820-4b19-8a61-719e0cacf137 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.388506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e44401-4820-4b19-8a61-719e0cacf137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-01e44401-4820-4b19-8a61-719e0cacf137 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:55.396167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:55.397054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 158/302] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:55.403675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44401-4820-4b19-8a61-719e0cacf137 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:55.410298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07e02a-f507-4919-b9cd-9ca182ff4f25 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:55.442116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208bb7-7f8b-423f-a89b-1cf14a06cf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:55.442894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208bb7-7f8b-423f-a89b-1cf14a06cf93 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.443171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208bb7-7f8b-423f-a89b-1cf14a06cf93 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.443431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208bb7-7f8b-423f-a89b-1cf14a06cf93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.453996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd208bb7-7f8b-423f-a89b-1cf14a06cf93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-cd208bb7-7f8b-423f-a89b-1cf14a06cf93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:55.462331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:55.463194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:55.463980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 145/303] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:55.468854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208bb7-7f8b-423f-a89b-1cf14a06cf93 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:55.506283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44401-4820-4b19-8a61-719e0cacf137 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:55.542299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae0c96-769f-430e-8f52-c2c77f3a86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:55.542965 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae0c96-769f-430e-8f52-c2c77f3a86aa None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.543245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae0c96-769f-430e-8f52-c2c77f3a86aa None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.543520 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae0c96-769f-430e-8f52-c2c77f3a86aa None admin] PATH_INFO: `/v3/groups` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.544228 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae0c96-769f-430e-8f52-c2c77f3a86aa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:55.545667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae0c96-769f-430e-8f52-c2c77f3a86aa None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:55.560668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 159/304] 10.222.0.23 () {60 vars in 1134 bytes} [Tue May 3 08:57:55 2022] POST /identity/v3/groups => generated 229 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:57:55.568879 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208bb7-7f8b-423f-a89b-1cf14a06cf93 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:55.569068 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae0c96-769f-430e-8f52-c2c77f3a86aa None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:55.614410 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd38bd-2361-4bf8-a97f-8de3cea1c382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:55.615099 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd38bd-2361-4bf8-a97f-8de3cea1c382 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.615439 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd38bd-2361-4bf8-a97f-8de3cea1c382 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.615718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd38bd-2361-4bf8-a97f-8de3cea1c382 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.616582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd38bd-2361-4bf8-a97f-8de3cea1c382 None admin] RBAC: Adding query filter params (name=member) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:55.617209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd38bd-2361-4bf8-a97f-8de3cea1c382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:55.619675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd38bd-2361-4bf8-a97f-8de3cea1c382 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:55.630943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 146/305] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:55.637447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd38bd-2361-4bf8-a97f-8de3cea1c382 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:55.711921 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae0c96-769f-430e-8f52-c2c77f3a86aa None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:55.747159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd38bd-2361-4bf8-a97f-8de3cea1c382 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:55.760909 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60d808-89d3-4c81-bef9-ee00866fe634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:55.762343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60d808-89d3-4c81-bef9-ee00866fe634 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.762633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60d808-89d3-4c81-bef9-ee00866fe634 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.762911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60d808-89d3-4c81-bef9-ee00866fe634 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.763666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60d808-89d3-4c81-bef9-ee00866fe634 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:55.763975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60d808-89d3-4c81-bef9-ee00866fe634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:55.765383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60d808-89d3-4c81-bef9-ee00866fe634 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:55.774750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 160/306] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:55.782347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60d808-89d3-4c81-bef9-ee00866fe634 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:55.787046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b5006-7d4c-4e80-8b61-c61b16fd8f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:55.787929 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5006-7d4c-4e80-8b61-c61b16fd8f34 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.788248 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5006-7d4c-4e80-8b61-c61b16fd8f34 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.788524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5006-7d4c-4e80-8b61-c61b16fd8f34 None admin] PATH_INFO: `/v3/users/9dfc16bc549f4e5eb5b27c5b1b46d0fd` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.789759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b5006-7d4c-4e80-8b61-c61b16fd8f34 None admin] RBAC: Authorizing `identity:get_user(user_id=9dfc16bc549f4e5eb5b27c5b1b46d0fd)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:55.791218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b5006-7d4c-4e80-8b61-c61b16fd8f34 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:55.792912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 147/307] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:55 2022] GET /identity/v3/users/9dfc16bc549f4e5eb5b27c5b1b46d0fd => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:55.799467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b5006-7d4c-4e80-8b61-c61b16fd8f34 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:55.904489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b5006-7d4c-4e80-8b61-c61b16fd8f34 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:55.910521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60d808-89d3-4c81-bef9-ee00866fe634 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:55.938565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d9c74-2b1c-4353-9599-3a71381d2537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:55.939503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9c74-2b1c-4353-9599-3a71381d2537 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.939788 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9c74-2b1c-4353-9599-3a71381d2537 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.940060 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9c74-2b1c-4353-9599-3a71381d2537 None admin] PATH_INFO: `/v3/system/users/9dfc16bc549f4e5eb5b27c5b1b46d0fd/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.941577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d9c74-2b1c-4353-9599-3a71381d2537 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9dfc16bc549f4e5eb5b27c5b1b46d0fd, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:55.942948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d9c74-2b1c-4353-9599-3a71381d2537 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:55.952618 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19de400-86fc-457c-90ce-0acd3f9ca957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:55.953578 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de400-86fc-457c-90ce-0acd3f9ca957 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:55.953858 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de400-86fc-457c-90ce-0acd3f9ca957 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:55.954295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de400-86fc-457c-90ce-0acd3f9ca957 None admin] PATH_INFO: `/v3/users/d8bb4875e84f4d37951fd8059862d7e1` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:55.956580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 148/308] 10.222.0.23 () {58 vars in 1334 bytes} [Tue May 3 08:57:55 2022] PUT /identity/v3/system/users/9dfc16bc549f4e5eb5b27c5b1b46d0fd/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:57:55.969711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19de400-86fc-457c-90ce-0acd3f9ca957 None admin] RBAC: Authorizing `identity:get_user(user_id=d8bb4875e84f4d37951fd8059862d7e1)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:55.971200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19de400-86fc-457c-90ce-0acd3f9ca957 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:55.973423 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 161/309] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:55 2022] GET /identity/v3/users/d8bb4875e84f4d37951fd8059862d7e1 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:55.981463 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d9c74-2b1c-4353-9599-3a71381d2537 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:56.110832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d9c74-2b1c-4353-9599-3a71381d2537 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:56.149105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6314ee-c2d3-4413-b090-7769110f3de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:56.150192 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6314ee-c2d3-4413-b090-7769110f3de4 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:56.150664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6314ee-c2d3-4413-b090-7769110f3de4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:56.151146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6314ee-c2d3-4413-b090-7769110f3de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:56.152226 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6314ee-c2d3-4413-b090-7769110f3de4 None admin] RBAC: Adding query filter params (role.id=4f6101138a274d1d8a67780808b9a71e, user.id=d8bb4875e84f4d37951fd8059862d7e1, scope.system=all) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:56.152736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6314ee-c2d3-4413-b090-7769110f3de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:56.154446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6314ee-c2d3-4413-b090-7769110f3de4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:56.160856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 149/310] 10.222.0.23 () {56 vars in 1308 bytes} [Tue May 3 08:57:55 2022] GET /identity/v3/role_assignments?user.id=d8bb4875e84f4d37951fd8059862d7e1&scope.system=all&role.id=4f6101138a274d1d8a67780808b9a71e => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:56.267970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596e55-c4c2-430a-91a1-b386e02b18a3 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:56.268536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596e55-c4c2-430a-91a1-b386e02b18a3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:56.268536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596e55-c4c2-430a-91a1-b386e02b18a3 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:56.270023 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 162/311] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:56.275741 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8976f83-2423-4f1d-ae0b-1eefb9757aaf None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:56.276329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8976f83-2423-4f1d-ae0b-1eefb9757aaf None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:56.276811 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8976f83-2423-4f1d-ae0b-1eefb9757aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:56.294969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-b8976f83-2423-4f1d-ae0b-1eefb9757aaf None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:56.296548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b8976f83-2423-4f1d-ae0b-1eefb9757aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:56.372035 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 150/312] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:56.395325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da596e55-c4c2-430a-91a1-b386e02b18a3 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:56.502244 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da596e55-c4c2-430a-91a1-b386e02b18a3 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:56.535744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7bfcf-1eb3-4d1f-99f4-f7f2c00eb97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:56.536571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7bfcf-1eb3-4d1f-99f4-f7f2c00eb97f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:56.536849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7bfcf-1eb3-4d1f-99f4-f7f2c00eb97f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:56.537124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7bfcf-1eb3-4d1f-99f4-f7f2c00eb97f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:56.547910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7bfcf-1eb3-4d1f-99f4-f7f2c00eb97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-eae7bfcf-1eb3-4d1f-99f4-f7f2c00eb97f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:56.556015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:56.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:56.557735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 163/313] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:56.563567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8976f83-2423-4f1d-ae0b-1eefb9757aaf None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:56.663588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8976f83-2423-4f1d-ae0b-1eefb9757aaf None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:56.698218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a060-ef48-4e88-8f93-95c50812fdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:56.699231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a060-ef48-4e88-8f93-95c50812fdc9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:56.699745 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a060-ef48-4e88-8f93-95c50812fdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:56.700238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a060-ef48-4e88-8f93-95c50812fdc9 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:56.701455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349a060-ef48-4e88-8f93-95c50812fdc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:56.701949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349a060-ef48-4e88-8f93-95c50812fdc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:56.703527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349a060-ef48-4e88-8f93-95c50812fdc9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:56.713179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 151/314] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:56.718796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7bfcf-1eb3-4d1f-99f4-f7f2c00eb97f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:56.828194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7bfcf-1eb3-4d1f-99f4-f7f2c00eb97f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:56.862157 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0af12-55f1-4de6-944b-eff643582841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:56.863086 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0af12-55f1-4de6-944b-eff643582841 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:56.863364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0af12-55f1-4de6-944b-eff643582841 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:56.863685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0af12-55f1-4de6-944b-eff643582841 None admin] PATH_INFO: `/v3/users/b27a3d25c4724cacaab2bb4fd36cef7f` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:56.864927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0af12-55f1-4de6-944b-eff643582841 None admin] RBAC: Authorizing `identity:get_user(user_id=b27a3d25c4724cacaab2bb4fd36cef7f)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:56.866373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0af12-55f1-4de6-944b-eff643582841 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:56.868112 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 164/315] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:56 2022] GET /identity/v3/users/b27a3d25c4724cacaab2bb4fd36cef7f => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:56.873729 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a060-ef48-4e88-8f93-95c50812fdc9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:56.976368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a060-ef48-4e88-8f93-95c50812fdc9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:57.009739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca71f-602d-417f-8598-2f113b1b7fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:57.010735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca71f-602d-417f-8598-2f113b1b7fc8 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:57.011209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca71f-602d-417f-8598-2f113b1b7fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:57.011674 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca71f-602d-417f-8598-2f113b1b7fc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:57.080288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ca71f-602d-417f-8598-2f113b1b7fc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:57.081646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ca71f-602d-417f-8598-2f113b1b7fc8 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:57.180585 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 152/316] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:57:57.186123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0af12-55f1-4de6-944b-eff643582841 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:57.286922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0af12-55f1-4de6-944b-eff643582841 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:57.319574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb52ba-3034-4787-a6fd-324bf1c15495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:57.321034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb52ba-3034-4787-a6fd-324bf1c15495 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:57.321313 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb52ba-3034-4787-a6fd-324bf1c15495 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:57.321740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb52ba-3034-4787-a6fd-324bf1c15495 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:57.322931 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb52ba-3034-4787-a6fd-324bf1c15495 None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:57.324387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb52ba-3034-4787-a6fd-324bf1c15495 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:57.326620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 165/317] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:57:57 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:57.332429 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca71f-602d-417f-8598-2f113b1b7fc8 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:57.432635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca71f-602d-417f-8598-2f113b1b7fc8 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:57.467088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e83c9f-0f5b-4f30-b7ef-8d65958eac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:57.467742 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e83c9f-0f5b-4f30-b7ef-8d65958eac65 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:57.468022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e83c9f-0f5b-4f30-b7ef-8d65958eac65 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:57.468320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e83c9f-0f5b-4f30-b7ef-8d65958eac65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:57.469146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e83c9f-0f5b-4f30-b7ef-8d65958eac65 None admin] RBAC: Adding query filter params (role.id=4f6101138a274d1d8a67780808b9a71e, scope.project.id=f51e80d377884c07b775ad9e99feb88a, user.id=b27a3d25c4724cacaab2bb4fd36cef7f) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:57.469455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e83c9f-0f5b-4f30-b7ef-8d65958eac65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:57.470873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e83c9f-0f5b-4f30-b7ef-8d65958eac65 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:57.477257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 153/318] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:57:57 2022] GET /identity/v3/role_assignments?user.id=b27a3d25c4724cacaab2bb4fd36cef7f&scope.project.id=f51e80d377884c07b775ad9e99feb88a&role.id=4f6101138a274d1d8a67780808b9a71e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:57.956798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e701932-6247-4aa1-bef8-ec6fa147f1a3 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:57.957166 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e701932-6247-4aa1-bef8-ec6fa147f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:57.957359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e701932-6247-4aa1-bef8-ec6fa147f1a3 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:57.958748 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 166/319] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:57:57.964358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dfbe3-8f91-4bcb-a4e1-a50b417bd6fe None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:57.964653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dfbe3-8f91-4bcb-a4e1-a50b417bd6fe None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:57.964930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dfbe3-8f91-4bcb-a4e1-a50b417bd6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:57.981176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-779dfbe3-8f91-4bcb-a4e1-a50b417bd6fe None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:57.982354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-779dfbe3-8f91-4bcb-a4e1-a50b417bd6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:58.049552 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 154/320] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:57:58.072739 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e701932-6247-4aa1-bef8-ec6fa147f1a3 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:58.173408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e701932-6247-4aa1-bef8-ec6fa147f1a3 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:58.209221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6659c9-1760-47ea-b3f0-268891b20f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:58.209221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6659c9-1760-47ea-b3f0-268891b20f1f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:58.209221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6659c9-1760-47ea-b3f0-268891b20f1f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:58.209221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6659c9-1760-47ea-b3f0-268891b20f1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:58.211940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6659c9-1760-47ea-b3f0-268891b20f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:58.213426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6659c9-1760-47ea-b3f0-268891b20f1f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:58.215210 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 167/321] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:57:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:58.220647 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dfbe3-8f91-4bcb-a4e1-a50b417bd6fe None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:58.287342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52923d9-27ec-4a93-8e91-297e128b5525 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:58.287860 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52923d9-27ec-4a93-8e91-297e128b5525 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:58.287978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52923d9-27ec-4a93-8e91-297e128b5525 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:58.289291 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 168/322] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:58.294237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991f92c-fbca-4a9b-8d5c-d9dc0e28f52d None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:58.294531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991f92c-fbca-4a9b-8d5c-d9dc0e28f52d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:58.294808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991f92c-fbca-4a9b-8d5c-d9dc0e28f52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:58.311365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-c991f92c-fbca-4a9b-8d5c-d9dc0e28f52d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:58.312560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c991f92c-fbca-4a9b-8d5c-d9dc0e28f52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:58.317997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dfbe3-8f91-4bcb-a4e1-a50b417bd6fe None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:58.353944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4693b9-847c-4512-9c8c-8ead8690f603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:58.354632 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4693b9-847c-4512-9c8c-8ead8690f603 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:58.354913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4693b9-847c-4512-9c8c-8ead8690f603 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:58.355187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4693b9-847c-4512-9c8c-8ead8690f603 None admin] PATH_INFO: `/v3/groups` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:58.355907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4693b9-847c-4512-9c8c-8ead8690f603 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:58.357478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4693b9-847c-4512-9c8c-8ead8690f603 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:58.376374 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 155/323] 10.222.0.23 () {60 vars in 1134 bytes} [Tue May 3 08:57:58 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:57:58.391759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 169/324] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:58.415795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4693b9-847c-4512-9c8c-8ead8690f603 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:58.519763 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4693b9-847c-4512-9c8c-8ead8690f603 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:58.535862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1d7d9-07d2-4f69-9690-19aefff99636 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:58.536171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1d7d9-07d2-4f69-9690-19aefff99636 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:58.536638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1d7d9-07d2-4f69-9690-19aefff99636 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:58.538270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 170/325] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:57:58.545755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef2ce0-ca0b-4ea9-9cd5-503882f973d9 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:58.546107 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef2ce0-ca0b-4ea9-9cd5-503882f973d9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:58.546457 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef2ce0-ca0b-4ea9-9cd5-503882f973d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:58.558160 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f563a-f0a1-4b5b-890b-f7bc3b6f6e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:58.559048 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f563a-f0a1-4b5b-890b-f7bc3b6f6e65 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:58.559333 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f563a-f0a1-4b5b-890b-f7bc3b6f6e65 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:58.559604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f563a-f0a1-4b5b-890b-f7bc3b6f6e65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:58.564709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-d0ef2ce0-ca0b-4ea9-9cd5-503882f973d9 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:57:58.565947 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d0ef2ce0-ca0b-4ea9-9cd5-503882f973d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:57:58.572652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f563a-f0a1-4b5b-890b-f7bc3b6f6e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-2e7f563a-f0a1-4b5b-890b-f7bc3b6f6e65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:58.580986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:58.581888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:57:58.582862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 156/326] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:57:58.587830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f563a-f0a1-4b5b-890b-f7bc3b6f6e65 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:58.641398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 171/327] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:57:58.663545 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef2ce0-ca0b-4ea9-9cd5-503882f973d9 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:58.702980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f563a-f0a1-4b5b-890b-f7bc3b6f6e65 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:58.750909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd4c5-3209-4113-8255-7e62087a1ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:58.751711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd4c5-3209-4113-8255-7e62087a1ac0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:58.752251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd4c5-3209-4113-8255-7e62087a1ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:58.752718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd4c5-3209-4113-8255-7e62087a1ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:58.753657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd4c5-3209-4113-8255-7e62087a1ac0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:58.754169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd4c5-3209-4113-8255-7e62087a1ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:58.756181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd4c5-3209-4113-8255-7e62087a1ac0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:58.765642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 157/328] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:58.771297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd4c5-3209-4113-8255-7e62087a1ac0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:58.772804 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef2ce0-ca0b-4ea9-9cd5-503882f973d9 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:58.819555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e3320-0b89-4cf3-894b-abd8c93b4593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:58.821063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e3320-0b89-4cf3-894b-abd8c93b4593 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:58.821713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e3320-0b89-4cf3-894b-abd8c93b4593 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:58.822344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e3320-0b89-4cf3-894b-abd8c93b4593 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:58.837832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e3320-0b89-4cf3-894b-abd8c93b4593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-592e3320-0b89-4cf3-894b-abd8c93b4593 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:57:58.845659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:57:58.846555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:57:58.847361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 172/329] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:57:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:57:58.853574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e3320-0b89-4cf3-894b-abd8c93b4593 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:58.907808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd4c5-3209-4113-8255-7e62087a1ac0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:58.949081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a2cae-c007-4332-b7a0-b0aa54ba6665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:58.951193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a2cae-c007-4332-b7a0-b0aa54ba6665 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:58.951651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a2cae-c007-4332-b7a0-b0aa54ba6665 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:58.952122 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a2cae-c007-4332-b7a0-b0aa54ba6665 None admin] PATH_INFO: `/v3/users/9dfc16bc549f4e5eb5b27c5b1b46d0fd` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:58.953907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a2cae-c007-4332-b7a0-b0aa54ba6665 None admin] RBAC: Authorizing `identity:get_user(user_id=9dfc16bc549f4e5eb5b27c5b1b46d0fd)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:58.955580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a2cae-c007-4332-b7a0-b0aa54ba6665 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:58.958114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 158/330] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:58 2022] GET /identity/v3/users/9dfc16bc549f4e5eb5b27c5b1b46d0fd => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:58.964743 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a2cae-c007-4332-b7a0-b0aa54ba6665 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:58.974368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e3320-0b89-4cf3-894b-abd8c93b4593 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:59.008306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e41986-bccf-4dbb-b312-0570c42ad242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:59.008984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e41986-bccf-4dbb-b312-0570c42ad242 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:59.009336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e41986-bccf-4dbb-b312-0570c42ad242 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:59.009701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e41986-bccf-4dbb-b312-0570c42ad242 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:59.010515 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e41986-bccf-4dbb-b312-0570c42ad242 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:59.010886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e41986-bccf-4dbb-b312-0570c42ad242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:59.012410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e41986-bccf-4dbb-b312-0570c42ad242 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:59.022105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 173/331] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:57:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:59.027412 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e41986-bccf-4dbb-b312-0570c42ad242 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:59.088162 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a2cae-c007-4332-b7a0-b0aa54ba6665 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:59.130500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dc4ff-ecaf-4186-a46b-856281235a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:59.131676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dc4ff-ecaf-4186-a46b-856281235a70 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:59.132118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dc4ff-ecaf-4186-a46b-856281235a70 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:59.133067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dc4ff-ecaf-4186-a46b-856281235a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:59.134450 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820dc4ff-ecaf-4186-a46b-856281235a70 None admin] RBAC: Adding query filter params (role.id=e67ab18ce1304dc28ac4e134bba5f8be, user.id=9dfc16bc549f4e5eb5b27c5b1b46d0fd, scope.system=all) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:57:59.134922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820dc4ff-ecaf-4186-a46b-856281235a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:59.136549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820dc4ff-ecaf-4186-a46b-856281235a70 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:59.155687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 159/332] 10.222.0.23 () {56 vars in 1308 bytes} [Tue May 3 08:57:58 2022] GET /identity/v3/role_assignments?user.id=9dfc16bc549f4e5eb5b27c5b1b46d0fd&scope.system=all&role.id=e67ab18ce1304dc28ac4e134bba5f8be => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:57:59.163142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e41986-bccf-4dbb-b312-0570c42ad242 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:59.200641 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0590750-7bcc-49b1-bfbd-38ef599c417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:59.201530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0590750-7bcc-49b1-bfbd-38ef599c417a None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:59.201808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0590750-7bcc-49b1-bfbd-38ef599c417a None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:59.202077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0590750-7bcc-49b1-bfbd-38ef599c417a None admin] PATH_INFO: `/v3/users/d8bb4875e84f4d37951fd8059862d7e1` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:59.203317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0590750-7bcc-49b1-bfbd-38ef599c417a None admin] RBAC: Authorizing `identity:get_user(user_id=d8bb4875e84f4d37951fd8059862d7e1)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:59.204895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0590750-7bcc-49b1-bfbd-38ef599c417a None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:59.207203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 174/333] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:57:59 2022] GET /identity/v3/users/d8bb4875e84f4d37951fd8059862d7e1 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:57:59.213128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dc4ff-ecaf-4186-a46b-856281235a70 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:57:59.344013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dc4ff-ecaf-4186-a46b-856281235a70 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:57:59.385375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a454c98-8340-41d7-8ae7-2de35fe8c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:57:59.386258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a454c98-8340-41d7-8ae7-2de35fe8c308 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:57:59.386538 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a454c98-8340-41d7-8ae7-2de35fe8c308 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:57:59.386812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a454c98-8340-41d7-8ae7-2de35fe8c308 None admin] PATH_INFO: `/v3/system/users/d8bb4875e84f4d37951fd8059862d7e1/roles/4f6101138a274d1d8a67780808b9a71e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:57:59.388365 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a454c98-8340-41d7-8ae7-2de35fe8c308 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d8bb4875e84f4d37951fd8059862d7e1, role_id=4f6101138a274d1d8a67780808b9a71e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:57:59.389742 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a454c98-8340-41d7-8ae7-2de35fe8c308 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:57:59.403004 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 160/334] 10.222.0.23 () {58 vars in 1334 bytes} [Tue May 3 08:57:59 2022] PUT /identity/v3/system/users/d8bb4875e84f4d37951fd8059862d7e1/roles/4f6101138a274d1d8a67780808b9a71e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:58:01.218585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57741a6b-c3f3-469f-920c-cf29513c0c7d None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:01.219089 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57741a6b-c3f3-469f-920c-cf29513c0c7d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:01.219162 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57741a6b-c3f3-469f-920c-cf29513c0c7d None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:01.220841 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 175/335] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:01.230765 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ef3db-ecd5-4d54-a1d0-aae5f21e8105 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:01.231578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ef3db-ecd5-4d54-a1d0-aae5f21e8105 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:01.232068 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ef3db-ecd5-4d54-a1d0-aae5f21e8105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:01.249033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-802ef3db-ecd5-4d54-a1d0-aae5f21e8105 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:01.250522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-802ef3db-ecd5-4d54-a1d0-aae5f21e8105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:01.328193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 161/336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:01.348320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57741a6b-c3f3-469f-920c-cf29513c0c7d None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:01.474434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57741a6b-c3f3-469f-920c-cf29513c0c7d None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:01.484739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee716-5fec-4925-a607-03db43cee97d None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:01.485023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee716-5fec-4925-a607-03db43cee97d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:01.485304 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee716-5fec-4925-a607-03db43cee97d None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:01.486994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 162/337] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:01.492454 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91447a59-a186-41e8-8ef2-7435570da426 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:01.492736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91447a59-a186-41e8-8ef2-7435570da426 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:01.493008 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91447a59-a186-41e8-8ef2-7435570da426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:01.525120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-91447a59-a186-41e8-8ef2-7435570da426 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:01.526542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-91447a59-a186-41e8-8ef2-7435570da426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:01.545403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c39488-45d0-4b2c-bce0-8da408a9c1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:01.546288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c39488-45d0-4b2c-bce0-8da408a9c1eb None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:01.546497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c39488-45d0-4b2c-bce0-8da408a9c1eb None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:01.546768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c39488-45d0-4b2c-bce0-8da408a9c1eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:01.567158 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c39488-45d0-4b2c-bce0-8da408a9c1eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-27c39488-45d0-4b2c-bce0-8da408a9c1eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:01.576397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:01.577269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:01.578045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 176/338] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:58:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:01.584374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c39488-45d0-4b2c-bce0-8da408a9c1eb None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:01.670439 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 163/339] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:01.708550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91447a59-a186-41e8-8ef2-7435570da426 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:01.759271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c39488-45d0-4b2c-bce0-8da408a9c1eb None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:01.831234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da134806-8da3-4937-9830-045b2830ea7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:01.832215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da134806-8da3-4937-9830-045b2830ea7e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:01.832641 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da134806-8da3-4937-9830-045b2830ea7e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:01.833059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da134806-8da3-4937-9830-045b2830ea7e None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:01.833955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da134806-8da3-4937-9830-045b2830ea7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:01.834406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da134806-8da3-4937-9830-045b2830ea7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:01.835997 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da134806-8da3-4937-9830-045b2830ea7e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:01.851586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 177/340] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:01.856873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da134806-8da3-4937-9830-045b2830ea7e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:01.887873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91447a59-a186-41e8-8ef2-7435570da426 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:01.933355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9ff0c-be6c-4be1-8063-9c955df854cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:01.934432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ff0c-be6c-4be1-8063-9c955df854cc None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:01.934850 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ff0c-be6c-4be1-8063-9c955df854cc None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:01.935257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ff0c-be6c-4be1-8063-9c955df854cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:01.955184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9ff0c-be6c-4be1-8063-9c955df854cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-dba9ff0c-be6c-4be1-8063-9c955df854cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:01.964330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:01.965432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:01.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:01.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:01.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:01.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:01.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:01.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:01.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:01.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:01.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:01.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:01.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:58:01.966402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:01.976932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 164/341] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:01.981689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9ff0c-be6c-4be1-8063-9c955df854cc None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:02.061118 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da134806-8da3-4937-9830-045b2830ea7e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:02.125836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91ca09-31a7-43fc-8909-484a130d11a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:02.126888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ca09-31a7-43fc-8909-484a130d11a4 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:02.127418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ca09-31a7-43fc-8909-484a130d11a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:02.127889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ca09-31a7-43fc-8909-484a130d11a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:02.149502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9ff0c-be6c-4be1-8063-9c955df854cc None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:02.197554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e275a28-b7c4-4833-92fb-74eb7817c9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:02.198507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e275a28-b7c4-4833-92fb-74eb7817c9ed None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:02.198927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e275a28-b7c4-4833-92fb-74eb7817c9ed None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:02.199336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e275a28-b7c4-4833-92fb-74eb7817c9ed None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:02.200512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e275a28-b7c4-4833-92fb-74eb7817c9ed None admin] RBAC: Adding query filter params (name=member) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:02.200972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e275a28-b7c4-4833-92fb-74eb7817c9ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:02.202488 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e275a28-b7c4-4833-92fb-74eb7817c9ed None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:02.221281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 165/342] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:58:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:02.230389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e275a28-b7c4-4833-92fb-74eb7817c9ed None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:02.263541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91ca09-31a7-43fc-8909-484a130d11a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:02.265713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91ca09-31a7-43fc-8909-484a130d11a4 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:02.368111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e275a28-b7c4-4833-92fb-74eb7817c9ed None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:02.402615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 178/343] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:58:02.409697 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91ca09-31a7-43fc-8909-484a130d11a4 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:02.412376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05265c96-21fb-4a8d-a42c-500a7375adf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:02.413391 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05265c96-21fb-4a8d-a42c-500a7375adf9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:02.414426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05265c96-21fb-4a8d-a42c-500a7375adf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:02.414881 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05265c96-21fb-4a8d-a42c-500a7375adf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:02.514622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05265c96-21fb-4a8d-a42c-500a7375adf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:02.516428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05265c96-21fb-4a8d-a42c-500a7375adf9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:02.537962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91ca09-31a7-43fc-8909-484a130d11a4 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:02.581688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25bf3b-74ef-4029-81a6-6ddda007845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:02.582832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25bf3b-74ef-4029-81a6-6ddda007845d None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:02.583304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25bf3b-74ef-4029-81a6-6ddda007845d None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:02.583657 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25bf3b-74ef-4029-81a6-6ddda007845d None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:02.588850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25bf3b-74ef-4029-81a6-6ddda007845d None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:02.590399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25bf3b-74ef-4029-81a6-6ddda007845d None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:02.596114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 179/344] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:02 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:02.614304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25bf3b-74ef-4029-81a6-6ddda007845d None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:02.633063 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 166/345] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:02.638170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05265c96-21fb-4a8d-a42c-500a7375adf9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:02.754358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05265c96-21fb-4a8d-a42c-500a7375adf9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:02.762086 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25bf3b-74ef-4029-81a6-6ddda007845d None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:02.797335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86db73a-b42d-479c-87a5-4f65cca79148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:02.798312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983302ce-b04d-40de-bd46-79b2f387f08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:02.798803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86db73a-b42d-479c-87a5-4f65cca79148 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:02.799262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86db73a-b42d-479c-87a5-4f65cca79148 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:02.799374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983302ce-b04d-40de-bd46-79b2f387f08b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:02.799632 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983302ce-b04d-40de-bd46-79b2f387f08b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:02.799971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983302ce-b04d-40de-bd46-79b2f387f08b None admin] PATH_INFO: `/v3/groups/1321029487ce449ea247e68555d11328` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:02.800189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86db73a-b42d-479c-87a5-4f65cca79148 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:02.801842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86db73a-b42d-479c-87a5-4f65cca79148 None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:02.804917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86db73a-b42d-479c-87a5-4f65cca79148 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:02.806145 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983302ce-b04d-40de-bd46-79b2f387f08b None admin] RBAC: Authorizing `identity:get_group(group_id=1321029487ce449ea247e68555d11328)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:02.807607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983302ce-b04d-40de-bd46-79b2f387f08b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:02.807849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 167/346] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:02 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:02.809254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 180/347] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:02 2022] GET /identity/v3/groups/1321029487ce449ea247e68555d11328 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:02.811978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c31545-3286-4307-baad-82471899877d None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:02.811978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c31545-3286-4307-baad-82471899877d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:02.811978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c31545-3286-4307-baad-82471899877d None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:02.812416 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 181/348] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:02.812788 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d9149-a6d6-4e71-bb2e-ef0b7ee35ed8 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:02.813109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c31545-3286-4307-baad-82471899877d None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:02.815638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d9149-a6d6-4e71-bb2e-ef0b7ee35ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:02.816230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d9149-a6d6-4e71-bb2e-ef0b7ee35ed8 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:02.817850 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 168/349] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:02.819502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a420565-24e9-4755-bbc8-ab815a10e8c0 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:02.820037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a420565-24e9-4755-bbc8-ab815a10e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:02.820540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a420565-24e9-4755-bbc8-ab815a10e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:02.841015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5a420565-24e9-4755-bbc8-ab815a10e8c0 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:02.842610 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5a420565-24e9-4755-bbc8-ab815a10e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:02.915198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 169/350] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:02.916566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a420565-24e9-4755-bbc8-ab815a10e8c0 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:02.921332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c31545-3286-4307-baad-82471899877d None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:02.955458 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a78707-8be9-46c7-a338-a6cf398d842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:02.956366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a78707-8be9-46c7-a338-a6cf398d842e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:02.956641 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a78707-8be9-46c7-a338-a6cf398d842e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:02.956906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a78707-8be9-46c7-a338-a6cf398d842e None admin] PATH_INFO: `/v3/groups/1321029487ce449ea247e68555d11328` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:02.958068 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a78707-8be9-46c7-a338-a6cf398d842e None admin] RBAC: Authorizing `identity:get_group(group_id=1321029487ce449ea247e68555d11328)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:02.959485 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a78707-8be9-46c7-a338-a6cf398d842e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:02.961925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 182/351] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:02 2022] GET /identity/v3/groups/1321029487ce449ea247e68555d11328 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:02.962894 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09490676-0313-4498-94f0-53f96bfe4966 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:02.963170 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09490676-0313-4498-94f0-53f96bfe4966 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:02.963439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09490676-0313-4498-94f0-53f96bfe4966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:02.981082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-09490676-0313-4498-94f0-53f96bfe4966 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:02.982228 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-09490676-0313-4498-94f0-53f96bfe4966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:03.026054 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a420565-24e9-4755-bbc8-ab815a10e8c0 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:03.048467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 183/352] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:03.049317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09490676-0313-4498-94f0-53f96bfe4966 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:03.060995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9ef3-13c9-42e9-87ff-6e33e65cecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:03.062002 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9ef3-13c9-42e9-87ff-6e33e65cecd4 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:03.062513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9ef3-13c9-42e9-87ff-6e33e65cecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:03.063026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9ef3-13c9-42e9-87ff-6e33e65cecd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:03.064142 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b9ef3-13c9-42e9-87ff-6e33e65cecd4 None admin] RBAC: Adding query filter params (group.id=1321029487ce449ea247e68555d11328, role.id=f12928ff609a47a9bef9cb8abc28932b, scope.project.id=01616978948a4ea094e1ee9190ac21f2) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:03.064670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b9ef3-13c9-42e9-87ff-6e33e65cecd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:03.066357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b9ef3-13c9-42e9-87ff-6e33e65cecd4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:03.073073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 170/353] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 08:58:02 2022] GET /identity/v3/role_assignments?group.id=1321029487ce449ea247e68555d11328&scope.project.id=01616978948a4ea094e1ee9190ac21f2&role.id=f12928ff609a47a9bef9cb8abc28932b => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:03.074264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9ef3-13c9-42e9-87ff-6e33e65cecd4 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:03.176738 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09490676-0313-4498-94f0-53f96bfe4966 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:03.181855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9ef3-13c9-42e9-87ff-6e33e65cecd4 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:03.214172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086ea1b-e14d-40b8-b707-5edb4a2894d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:03.214976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086ea1b-e14d-40b8-b707-5edb4a2894d3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:03.215255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086ea1b-e14d-40b8-b707-5edb4a2894d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:03.215522 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086ea1b-e14d-40b8-b707-5edb4a2894d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:03.230487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086ea1b-e14d-40b8-b707-5edb4a2894d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:03.233351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd483d-7ec6-41f6-995e-4b2fc7962bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:03.234303 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd483d-7ec6-41f6-995e-4b2fc7962bba None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:03.234815 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd483d-7ec6-41f6-995e-4b2fc7962bba None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:03.235324 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd483d-7ec6-41f6-995e-4b2fc7962bba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:03.236439 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd483d-7ec6-41f6-995e-4b2fc7962bba None admin] RBAC: Adding query filter params (group.id=1321029487ce449ea247e68555d11328, role.id=e67ab18ce1304dc28ac4e134bba5f8be, scope.project.id=01616978948a4ea094e1ee9190ac21f2) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:03.237003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd483d-7ec6-41f6-995e-4b2fc7962bba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-8086ea1b-e14d-40b8-b707-5edb4a2894d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:03.238378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:03.239330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:03.240871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 184/354] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:03.242120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b3c82-3100-4639-8738-9374f20cfa7d None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:03.242120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b3c82-3100-4639-8738-9374f20cfa7d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:03.242495 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b3c82-3100-4639-8738-9374f20cfa7d None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:03.243151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd483d-7ec6-41f6-995e-4b2fc7962bba None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:03.243736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 185/355] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:03.244508 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b3c82-3100-4639-8738-9374f20cfa7d None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:03.250590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 171/356] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 08:58:03 2022] GET /identity/v3/role_assignments?group.id=1321029487ce449ea247e68555d11328&scope.project.id=01616978948a4ea094e1ee9190ac21f2&role.id=e67ab18ce1304dc28ac4e134bba5f8be => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:03.252001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd483d-7ec6-41f6-995e-4b2fc7962bba None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:03.355160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b3c82-3100-4639-8738-9374f20cfa7d None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:03.364828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd483d-7ec6-41f6-995e-4b2fc7962bba None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:03.391333 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745238e-74cc-4a93-8df9-2618c94b2f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:03.392105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745238e-74cc-4a93-8df9-2618c94b2f3b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:03.392392 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745238e-74cc-4a93-8df9-2618c94b2f3b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:03.392665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745238e-74cc-4a93-8df9-2618c94b2f3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:03.403323 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7575e9-a297-4a53-be4d-3572fe0fc264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:03.404717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7575e9-a297-4a53-be4d-3572fe0fc264 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:03.405275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7575e9-a297-4a53-be4d-3572fe0fc264 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:03.405763 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7575e9-a297-4a53-be4d-3572fe0fc264 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:03.406277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745238e-74cc-4a93-8df9-2618c94b2f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:03.406953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7575e9-a297-4a53-be4d-3572fe0fc264 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:03.407499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7575e9-a297-4a53-be4d-3572fe0fc264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:03.409170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7575e9-a297-4a53-be4d-3572fe0fc264 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-b745238e-74cc-4a93-8df9-2618c94b2f3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:03.414945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:03.415968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:03.417237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 186/357] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:03.418110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843623c5-a297-4b66-83df-c3450cd52437 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:03.418110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843623c5-a297-4b66-83df-c3450cd52437 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:03.418110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843623c5-a297-4b66-83df-c3450cd52437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:03.424437 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 172/358] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:58:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:03.425700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7575e9-a297-4a53-be4d-3572fe0fc264 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:03.437924 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-843623c5-a297-4b66-83df-c3450cd52437 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:03.439053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-843623c5-a297-4b66-83df-c3450cd52437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:03.538328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7575e9-a297-4a53-be4d-3572fe0fc264 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:03.557349 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 187/359] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:03.558216 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843623c5-a297-4b66-83df-c3450cd52437 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:03.574438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635998a-810e-4f4c-8d42-d042a13ac421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:03.575732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635998a-810e-4f4c-8d42-d042a13ac421 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:03.576258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635998a-810e-4f4c-8d42-d042a13ac421 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:03.576739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635998a-810e-4f4c-8d42-d042a13ac421 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:03.577829 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635998a-810e-4f4c-8d42-d042a13ac421 None admin] RBAC: Adding query filter params (name=member) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:03.578375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635998a-810e-4f4c-8d42-d042a13ac421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:03.579956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635998a-810e-4f4c-8d42-d042a13ac421 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:03.589831 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 173/360] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:58:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:03.598359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635998a-810e-4f4c-8d42-d042a13ac421 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:03.701963 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843623c5-a297-4b66-83df-c3450cd52437 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:03.715871 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635998a-810e-4f4c-8d42-d042a13ac421 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:03.740127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68d817-bd3f-40cd-b9d4-54cb727ddc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:03.741326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68d817-bd3f-40cd-b9d4-54cb727ddc90 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:03.741835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68d817-bd3f-40cd-b9d4-54cb727ddc90 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:03.742278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68d817-bd3f-40cd-b9d4-54cb727ddc90 None admin] PATH_INFO: `/v3/users/d8bb4875e84f4d37951fd8059862d7e1` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:03.743620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68d817-bd3f-40cd-b9d4-54cb727ddc90 None admin] RBAC: Authorizing `identity:get_user(user_id=d8bb4875e84f4d37951fd8059862d7e1)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:03.745327 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68d817-bd3f-40cd-b9d4-54cb727ddc90 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:03.747450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 188/361] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:58:03 2022] GET /identity/v3/users/d8bb4875e84f4d37951fd8059862d7e1 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:03.748464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68d817-bd3f-40cd-b9d4-54cb727ddc90 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:03.761746 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff05105-7f35-492d-9ace-e151c99a9428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:03.762746 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff05105-7f35-492d-9ace-e151c99a9428 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:03.763221 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff05105-7f35-492d-9ace-e151c99a9428 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:03.763702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff05105-7f35-492d-9ace-e151c99a9428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:03.843265 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff05105-7f35-492d-9ace-e151c99a9428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:03.845424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff05105-7f35-492d-9ace-e151c99a9428 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:03.862014 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68d817-bd3f-40cd-b9d4-54cb727ddc90 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:03.897534 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054f30a-9790-4c60-9c43-e8f2cdc0fd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:03.899295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054f30a-9790-4c60-9c43-e8f2cdc0fd2b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:03.900052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054f30a-9790-4c60-9c43-e8f2cdc0fd2b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:03.900545 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054f30a-9790-4c60-9c43-e8f2cdc0fd2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:03.910710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054f30a-9790-4c60-9c43-e8f2cdc0fd2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-3054f30a-9790-4c60-9c43-e8f2cdc0fd2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:03.919336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:03.920298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:03.921143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:03.921143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:03.921143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:03.921143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:03.921143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:03.921143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:03.921143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:03.921143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:03.921143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:03.921143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:03.921143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:03.921143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:03.923846 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 189/362] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:58:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:03.929097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054f30a-9790-4c60-9c43-e8f2cdc0fd2b None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:03.966319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 174/363] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:03.966319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e1bbd-c86d-4723-8aa8-5f9289ed8da2 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:03.966319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e1bbd-c86d-4723-8aa8-5f9289ed8da2 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:03.966319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e1bbd-c86d-4723-8aa8-5f9289ed8da2 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:03.966319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 175/364] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:03.966319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e1bbd-c86d-4723-8aa8-5f9289ed8da2 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:04.051946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054f30a-9790-4c60-9c43-e8f2cdc0fd2b None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:04.075060 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e1bbd-c86d-4723-8aa8-5f9289ed8da2 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:04.091174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c19bd3-64cf-45c0-a795-cd1b2cbe64c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:04.091823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c19bd3-64cf-45c0-a795-cd1b2cbe64c3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:04.092132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c19bd3-64cf-45c0-a795-cd1b2cbe64c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:04.092397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c19bd3-64cf-45c0-a795-cd1b2cbe64c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:04.093267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c19bd3-64cf-45c0-a795-cd1b2cbe64c3 None admin] RBAC: Adding query filter params (role.id=4f6101138a274d1d8a67780808b9a71e, user.id=d8bb4875e84f4d37951fd8059862d7e1, scope.system=all) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:04.093576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c19bd3-64cf-45c0-a795-cd1b2cbe64c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:04.095059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c19bd3-64cf-45c0-a795-cd1b2cbe64c3 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:04.107674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 190/365] 10.222.0.23 () {56 vars in 1308 bytes} [Tue May 3 08:58:03 2022] GET /identity/v3/role_assignments?user.id=d8bb4875e84f4d37951fd8059862d7e1&scope.system=all&role.id=4f6101138a274d1d8a67780808b9a71e => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:04.108767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c19bd3-64cf-45c0-a795-cd1b2cbe64c3 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:04.109133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4daac8-db81-4ef4-b26b-fdacb618136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:04.109795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4daac8-db81-4ef4-b26b-fdacb618136a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:04.110074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4daac8-db81-4ef4-b26b-fdacb618136a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:04.110344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4daac8-db81-4ef4-b26b-fdacb618136a None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:04.111092 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4daac8-db81-4ef4-b26b-fdacb618136a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:04.111393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4daac8-db81-4ef4-b26b-fdacb618136a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:04.112817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4daac8-db81-4ef4-b26b-fdacb618136a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:04.122698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 176/366] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:04.123962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbf3fa-0b94-4ace-b035-e7b0e17257ba None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:04.124385 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbf3fa-0b94-4ace-b035-e7b0e17257ba None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:04.124756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbf3fa-0b94-4ace-b035-e7b0e17257ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:04.142353 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-ffdbf3fa-0b94-4ace-b035-e7b0e17257ba None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:04.143733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ffdbf3fa-0b94-4ace-b035-e7b0e17257ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:04.221652 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c19bd3-64cf-45c0-a795-cd1b2cbe64c3 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:04.225489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 177/367] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:04.232110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbf3fa-0b94-4ace-b035-e7b0e17257ba None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:04.278990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3688b-bad5-4b27-af1f-6cc7ceceadc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:04.280298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3688b-bad5-4b27-af1f-6cc7ceceadc8 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:04.280809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3688b-bad5-4b27-af1f-6cc7ceceadc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:04.281288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3688b-bad5-4b27-af1f-6cc7ceceadc8 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:04.284077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3688b-bad5-4b27-af1f-6cc7ceceadc8 None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:04.285908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3688b-bad5-4b27-af1f-6cc7ceceadc8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:04.288366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 191/368] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:04 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:04.289489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3688b-bad5-4b27-af1f-6cc7ceceadc8 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:04.337564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbf3fa-0b94-4ace-b035-e7b0e17257ba None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:04.373448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af18e3c-9ec2-4040-a13a-091d79d86c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:04.374240 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af18e3c-9ec2-4040-a13a-091d79d86c9f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:04.374605 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af18e3c-9ec2-4040-a13a-091d79d86c9f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:04.374946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af18e3c-9ec2-4040-a13a-091d79d86c9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:04.432910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3688b-bad5-4b27-af1f-6cc7ceceadc8 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:04.497968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af18e3c-9ec2-4040-a13a-091d79d86c9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:04.499462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af18e3c-9ec2-4040-a13a-091d79d86c9f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:04.502040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aab9f-7d2d-4cab-adeb-bafbe8997834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:04.502845 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aab9f-7d2d-4cab-adeb-bafbe8997834 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:04.503123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aab9f-7d2d-4cab-adeb-bafbe8997834 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:04.503394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aab9f-7d2d-4cab-adeb-bafbe8997834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:04.528630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aab9f-7d2d-4cab-adeb-bafbe8997834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-0b1aab9f-7d2d-4cab-adeb-bafbe8997834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:04.539906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:04.540885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:04.542211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 192/369] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:04.542860 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aab9f-7d2d-4cab-adeb-bafbe8997834 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:04.629703 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 178/370] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:04.630974 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af18e3c-9ec2-4040-a13a-091d79d86c9f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:04.675311 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aab9f-7d2d-4cab-adeb-bafbe8997834 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:04.718328 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ed79d-e5fe-47cd-acb9-56c35fe0e2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:04.719340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ed79d-e5fe-47cd-acb9-56c35fe0e2ee None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:04.719620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ed79d-e5fe-47cd-acb9-56c35fe0e2ee None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:04.719896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ed79d-e5fe-47cd-acb9-56c35fe0e2ee None admin] PATH_INFO: `/v3/groups/1321029487ce449ea247e68555d11328` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:04.721519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ed79d-e5fe-47cd-acb9-56c35fe0e2ee None admin] RBAC: Authorizing `identity:get_group(group_id=1321029487ce449ea247e68555d11328)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:04.723008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ed79d-e5fe-47cd-acb9-56c35fe0e2ee None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:04.725379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 193/371] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:04 2022] GET /identity/v3/groups/1321029487ce449ea247e68555d11328 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:04.726969 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ed79d-e5fe-47cd-acb9-56c35fe0e2ee None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:04.742111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af18e3c-9ec2-4040-a13a-091d79d86c9f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:04.777369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9033e9-662d-4d88-a8f1-fdf19bcbb7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:04.778384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9033e9-662d-4d88-a8f1-fdf19bcbb7d5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:04.778860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9033e9-662d-4d88-a8f1-fdf19bcbb7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:04.779326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9033e9-662d-4d88-a8f1-fdf19bcbb7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:04.780329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9033e9-662d-4d88-a8f1-fdf19bcbb7d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:04.780828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9033e9-662d-4d88-a8f1-fdf19bcbb7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:04.782400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9033e9-662d-4d88-a8f1-fdf19bcbb7d5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:04.791536 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 179/372] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:04.792678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9033e9-662d-4d88-a8f1-fdf19bcbb7d5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:04.857079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ed79d-e5fe-47cd-acb9-56c35fe0e2ee None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:04.896792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9033e9-662d-4d88-a8f1-fdf19bcbb7d5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:04.901521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afdd37-9c74-43a9-8aae-7d075519c4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:04.902393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afdd37-9c74-43a9-8aae-7d075519c4db None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:04.902672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afdd37-9c74-43a9-8aae-7d075519c4db None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:04.902944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afdd37-9c74-43a9-8aae-7d075519c4db None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:04.904589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afdd37-9c74-43a9-8aae-7d075519c4db None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:04.905672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afdd37-9c74-43a9-8aae-7d075519c4db None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:04.907934 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 194/373] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:04 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:04.914857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afdd37-9c74-43a9-8aae-7d075519c4db None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:04.939978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c3203-2df7-4ca0-ac19-5d73a6a1518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:04.940910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c3203-2df7-4ca0-ac19-5d73a6a1518e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:04.941340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c3203-2df7-4ca0-ac19-5d73a6a1518e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:04.941803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c3203-2df7-4ca0-ac19-5d73a6a1518e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:04.942833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c3203-2df7-4ca0-ac19-5d73a6a1518e None admin] RBAC: Adding query filter params (group.id=1321029487ce449ea247e68555d11328, role.id=e67ab18ce1304dc28ac4e134bba5f8be, scope.project.id=f51e80d377884c07b775ad9e99feb88a) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:04.943306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c3203-2df7-4ca0-ac19-5d73a6a1518e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:04.944964 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c3203-2df7-4ca0-ac19-5d73a6a1518e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:04.951599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 180/374] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 08:58:04 2022] GET /identity/v3/role_assignments?group.id=1321029487ce449ea247e68555d11328&scope.project.id=f51e80d377884c07b775ad9e99feb88a&role.id=e67ab18ce1304dc28ac4e134bba5f8be => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:04.952602 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c3203-2df7-4ca0-ac19-5d73a6a1518e None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:05.059532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afdd37-9c74-43a9-8aae-7d075519c4db None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:05.096951 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d9da4-a0bd-4caf-8d65-7aa1fea2c5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:05.097383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d9da4-a0bd-4caf-8d65-7aa1fea2c5bc None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:05.097667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d9da4-a0bd-4caf-8d65-7aa1fea2c5bc None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:05.097941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d9da4-a0bd-4caf-8d65-7aa1fea2c5bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:05.104267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c3203-2df7-4ca0-ac19-5d73a6a1518e None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:05.144829 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b54149-b8fb-423f-b827-98d578335f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:05.145941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b54149-b8fb-423f-b827-98d578335f39 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:05.146364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b54149-b8fb-423f-b827-98d578335f39 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:05.146778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b54149-b8fb-423f-b827-98d578335f39 None admin] PATH_INFO: `/v3/groups/1321029487ce449ea247e68555d11328` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:05.149959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b54149-b8fb-423f-b827-98d578335f39 None admin] RBAC: Authorizing `identity:get_group(group_id=1321029487ce449ea247e68555d11328)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:05.151671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b54149-b8fb-423f-b827-98d578335f39 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:05.153980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 181/375] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:04 2022] GET /identity/v3/groups/1321029487ce449ea247e68555d11328 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:05.164574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b54149-b8fb-423f-b827-98d578335f39 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:05.195437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d9da4-a0bd-4caf-8d65-7aa1fea2c5bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:05.197705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d9da4-a0bd-4caf-8d65-7aa1fea2c5bc None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:05.296168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b54149-b8fb-423f-b827-98d578335f39 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:05.311011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 195/376] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:05.316462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d9da4-a0bd-4caf-8d65-7aa1fea2c5bc None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:05.345744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3bef2-6e67-4fbd-b4d9-54d5adf1f2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:05.346666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3bef2-6e67-4fbd-b4d9-54d5adf1f2de None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:05.347079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3bef2-6e67-4fbd-b4d9-54d5adf1f2de None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:05.347479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3bef2-6e67-4fbd-b4d9-54d5adf1f2de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:05.348478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3bef2-6e67-4fbd-b4d9-54d5adf1f2de None admin] RBAC: Adding query filter params (group.id=1321029487ce449ea247e68555d11328, role.id=f12928ff609a47a9bef9cb8abc28932b, scope.project.id=f51e80d377884c07b775ad9e99feb88a) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:05.348952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3bef2-6e67-4fbd-b4d9-54d5adf1f2de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:05.350536 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3bef2-6e67-4fbd-b4d9-54d5adf1f2de None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:05.357442 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 182/377] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 08:58:05 2022] GET /identity/v3/role_assignments?group.id=1321029487ce449ea247e68555d11328&scope.project.id=f51e80d377884c07b775ad9e99feb88a&role.id=f12928ff609a47a9bef9cb8abc28932b => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:05.434689 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d9da4-a0bd-4caf-8d65-7aa1fea2c5bc None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:05.484959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9c159-a2a3-416f-8ffc-046363269f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:05.486453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9c159-a2a3-416f-8ffc-046363269f4b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:05.487009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9c159-a2a3-416f-8ffc-046363269f4b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:05.487289 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9c159-a2a3-416f-8ffc-046363269f4b None admin] PATH_INFO: `/v3/projects/25541cb90a5a4ec5b739da2d1d1355bf` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:05.488794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9c159-a2a3-416f-8ffc-046363269f4b None admin] RBAC: Authorizing `identity:get_project(project_id=25541cb90a5a4ec5b739da2d1d1355bf)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:05.490283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9c159-a2a3-416f-8ffc-046363269f4b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:05.493313 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 196/378] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:05 2022] GET /identity/v3/projects/25541cb90a5a4ec5b739da2d1d1355bf => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:05.499567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3bef2-6e67-4fbd-b4d9-54d5adf1f2de None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:05.627405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3bef2-6e67-4fbd-b4d9-54d5adf1f2de None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:05.670300 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83531963-c7de-4dd6-8196-7c4f23c213f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:05.671176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83531963-c7de-4dd6-8196-7c4f23c213f0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:05.671461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83531963-c7de-4dd6-8196-7c4f23c213f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:05.671736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83531963-c7de-4dd6-8196-7c4f23c213f0 None admin] PATH_INFO: `/v3/groups/303ba53a7d2948a2a831d0108bcda47a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:05.680738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83531963-c7de-4dd6-8196-7c4f23c213f0 None admin] RBAC: Authorizing `identity:get_group(group_id=303ba53a7d2948a2a831d0108bcda47a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:05.682202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83531963-c7de-4dd6-8196-7c4f23c213f0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:05.683912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 183/379] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:05 2022] GET /identity/v3/groups/303ba53a7d2948a2a831d0108bcda47a => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:05.689933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9c159-a2a3-416f-8ffc-046363269f4b None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:05.833405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9c159-a2a3-416f-8ffc-046363269f4b None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:05.873677 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038840c-5337-4a57-a398-c6e502ba0912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:05.874343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038840c-5337-4a57-a398-c6e502ba0912 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:05.874620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038840c-5337-4a57-a398-c6e502ba0912 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:05.874884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038840c-5337-4a57-a398-c6e502ba0912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:05.875710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038840c-5337-4a57-a398-c6e502ba0912 None admin] RBAC: Adding query filter params (group.id=303ba53a7d2948a2a831d0108bcda47a, role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=25541cb90a5a4ec5b739da2d1d1355bf) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:05.876013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038840c-5337-4a57-a398-c6e502ba0912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:05.877596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038840c-5337-4a57-a398-c6e502ba0912 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:05.883472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 197/380] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 08:58:05 2022] GET /identity/v3/role_assignments?group.id=303ba53a7d2948a2a831d0108bcda47a&scope.project.id=25541cb90a5a4ec5b739da2d1d1355bf&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:06.141431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c712-f8ba-41ba-a47c-d35dd108fffa None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:06.141431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c712-f8ba-41ba-a47c-d35dd108fffa None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:06.141431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c712-f8ba-41ba-a47c-d35dd108fffa None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:06.142174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 184/381] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:06.148507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c019cb-8df5-4e4c-b3fe-33bc482a1210 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:06.149180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c019cb-8df5-4e4c-b3fe-33bc482a1210 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:06.149647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c019cb-8df5-4e4c-b3fe-33bc482a1210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:06.169431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-27c019cb-8df5-4e4c-b3fe-33bc482a1210 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:06.170621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-27c019cb-8df5-4e4c-b3fe-33bc482a1210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:06.259200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 198/382] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:58:06.284268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09c712-f8ba-41ba-a47c-d35dd108fffa None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:06.414761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09c712-f8ba-41ba-a47c-d35dd108fffa None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:06.439762 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab089-eebb-4824-af9b-2ffa6b1ceba9 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:06.440345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab089-eebb-4824-af9b-2ffa6b1ceba9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:06.440345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab089-eebb-4824-af9b-2ffa6b1ceba9 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:06.445192 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 199/383] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:06.450497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada3a10-bc1b-42b6-88f1-e3f42befa817 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:06.450789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada3a10-bc1b-42b6-88f1-e3f42befa817 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:06.451053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada3a10-bc1b-42b6-88f1-e3f42befa817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:06.454270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aad422-f084-4d52-bea4-fc5b69980ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:06.455393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aad422-f084-4d52-bea4-fc5b69980ed7 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:06.455864 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aad422-f084-4d52-bea4-fc5b69980ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:06.456347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aad422-f084-4d52-bea4-fc5b69980ed7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:06.470895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-dada3a10-bc1b-42b6-88f1-e3f42befa817 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:06.471878 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aad422-f084-4d52-bea4-fc5b69980ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:06.472271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-dada3a10-bc1b-42b6-88f1-e3f42befa817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-c3aad422-f084-4d52-bea4-fc5b69980ed7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:06.483978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:06.484972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:06.485739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:06.485739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:06.485739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:06.485739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:06.485739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:06.485739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:06.485739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:06.485739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:06.485739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:06.485739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:06.485739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:06.485739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:06.487893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 185/384] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:58:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:06.493835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aad422-f084-4d52-bea4-fc5b69980ed7 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:06.556187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 200/385] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:58:06.624434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aad422-f084-4d52-bea4-fc5b69980ed7 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:06.629915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada3a10-bc1b-42b6-88f1-e3f42befa817 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:06.663527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a29d4-0ac2-4758-86dc-963e8547c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:06.664223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a29d4-0ac2-4758-86dc-963e8547c995 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:06.664505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a29d4-0ac2-4758-86dc-963e8547c995 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:06.664828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a29d4-0ac2-4758-86dc-963e8547c995 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:06.665526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a29d4-0ac2-4758-86dc-963e8547c995 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:06.665831 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a29d4-0ac2-4758-86dc-963e8547c995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:06.667211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a29d4-0ac2-4758-86dc-963e8547c995 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:06.675805 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 186/386] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:06.685186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a29d4-0ac2-4758-86dc-963e8547c995 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:06.786308 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a29d4-0ac2-4758-86dc-963e8547c995 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:06.822393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2da140-196a-4a42-9c71-4ed1a08f544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:06.823315 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2da140-196a-4a42-9c71-4ed1a08f544a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:06.823642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2da140-196a-4a42-9c71-4ed1a08f544a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:06.823918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2da140-196a-4a42-9c71-4ed1a08f544a None admin] PATH_INFO: `/v3/groups/1321029487ce449ea247e68555d11328` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:06.826065 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2da140-196a-4a42-9c71-4ed1a08f544a None admin] RBAC: Authorizing `identity:get_group(group_id=1321029487ce449ea247e68555d11328)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:06.827518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2da140-196a-4a42-9c71-4ed1a08f544a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:06.830583 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 187/387] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:06 2022] GET /identity/v3/groups/1321029487ce449ea247e68555d11328 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:06.834855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2da140-196a-4a42-9c71-4ed1a08f544a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:06.861828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada3a10-bc1b-42b6-88f1-e3f42befa817 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:06.927566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945a6fd-9adb-4488-941f-d4ab3bafa6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:06.928380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945a6fd-9adb-4488-941f-d4ab3bafa6bd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:06.928662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945a6fd-9adb-4488-941f-d4ab3bafa6bd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:06.928961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945a6fd-9adb-4488-941f-d4ab3bafa6bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:06.940046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945a6fd-9adb-4488-941f-d4ab3bafa6bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-a945a6fd-9adb-4488-941f-d4ab3bafa6bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:06.949294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:06.950469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:06.951856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 201/388] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:06.956798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945a6fd-9adb-4488-941f-d4ab3bafa6bd None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:06.989222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2da140-196a-4a42-9c71-4ed1a08f544a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:07.030521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8111fca-238c-48e8-965b-834f8fcb46b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:07.031388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8111fca-238c-48e8-965b-834f8fcb46b2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:07.031671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8111fca-238c-48e8-965b-834f8fcb46b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:07.031941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8111fca-238c-48e8-965b-834f8fcb46b2 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:07.033783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8111fca-238c-48e8-965b-834f8fcb46b2 None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:07.035216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8111fca-238c-48e8-965b-834f8fcb46b2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:07.037089 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 188/389] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:06 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:07.044841 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8111fca-238c-48e8-965b-834f8fcb46b2 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:07.147926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945a6fd-9adb-4488-941f-d4ab3bafa6bd None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:07.203763 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191ec0b-3165-4713-95a9-863f983ab27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:07.204788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191ec0b-3165-4713-95a9-863f983ab27e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:07.205274 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191ec0b-3165-4713-95a9-863f983ab27e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:07.205764 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191ec0b-3165-4713-95a9-863f983ab27e None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:07.206724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191ec0b-3165-4713-95a9-863f983ab27e None admin] RBAC: Adding query filter params (name=member) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:07.207223 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191ec0b-3165-4713-95a9-863f983ab27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:07.216113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8111fca-238c-48e8-965b-834f8fcb46b2 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:07.217328 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191ec0b-3165-4713-95a9-863f983ab27e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:07.231949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 202/390] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:58:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:07.237663 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191ec0b-3165-4713-95a9-863f983ab27e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:07.259321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115d7b1-7c41-4085-bcba-9c3aa1caf0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:07.260258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115d7b1-7c41-4085-bcba-9c3aa1caf0a8 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:07.260507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115d7b1-7c41-4085-bcba-9c3aa1caf0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:07.260777 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115d7b1-7c41-4085-bcba-9c3aa1caf0a8 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2/groups/1321029487ce449ea247e68555d11328/roles/f12928ff609a47a9bef9cb8abc28932b` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:07.265175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115d7b1-7c41-4085-bcba-9c3aa1caf0a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=01616978948a4ea094e1ee9190ac21f2, group_id=1321029487ce449ea247e68555d11328, role_id=f12928ff609a47a9bef9cb8abc28932b)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:07.266601 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115d7b1-7c41-4085-bcba-9c3aa1caf0a8 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:07.294724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 189/391] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 3 08:58:07 2022] PUT /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2/groups/1321029487ce449ea247e68555d11328/roles/f12928ff609a47a9bef9cb8abc28932b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:58:07.361213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191ec0b-3165-4713-95a9-863f983ab27e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:07.395789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ecb49-2aa5-41ca-a28a-fea7bad5c4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:07.396690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ecb49-2aa5-41ca-a28a-fea7bad5c4bb None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:07.396963 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ecb49-2aa5-41ca-a28a-fea7bad5c4bb None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:07.397232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ecb49-2aa5-41ca-a28a-fea7bad5c4bb None admin] PATH_INFO: `/v3/groups/1321029487ce449ea247e68555d11328` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:07.398487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ecb49-2aa5-41ca-a28a-fea7bad5c4bb None admin] RBAC: Authorizing `identity:get_group(group_id=1321029487ce449ea247e68555d11328)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:07.399911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ecb49-2aa5-41ca-a28a-fea7bad5c4bb None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:07.401850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 203/392] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:07 2022] GET /identity/v3/groups/1321029487ce449ea247e68555d11328 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:07.409476 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115d7b1-7c41-4085-bcba-9c3aa1caf0a8 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:07.523970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115d7b1-7c41-4085-bcba-9c3aa1caf0a8 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:07.560569 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ab5c9-e3e2-4fa3-bad1-b1dca4ee6d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:07.561866 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab5c9-e3e2-4fa3-bad1-b1dca4ee6d7f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:07.562369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab5c9-e3e2-4fa3-bad1-b1dca4ee6d7f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:07.562842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab5c9-e3e2-4fa3-bad1-b1dca4ee6d7f None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:07.564428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ab5c9-e3e2-4fa3-bad1-b1dca4ee6d7f None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:07.566121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ab5c9-e3e2-4fa3-bad1-b1dca4ee6d7f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:07.568121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 190/393] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:07 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:07.574719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ecb49-2aa5-41ca-a28a-fea7bad5c4bb None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:07.713455 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ecb49-2aa5-41ca-a28a-fea7bad5c4bb None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:07.751648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6534732-bf35-4ae7-9e55-92344f558ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:07.752965 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6534732-bf35-4ae7-9e55-92344f558ce5 None admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:07.753449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6534732-bf35-4ae7-9e55-92344f558ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:07.753915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6534732-bf35-4ae7-9e55-92344f558ce5 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2/groups/1321029487ce449ea247e68555d11328/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:07.756992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6534732-bf35-4ae7-9e55-92344f558ce5 None admin] RBAC: Authorizing `identity:create_grant(project_id=01616978948a4ea094e1ee9190ac21f2, group_id=1321029487ce449ea247e68555d11328, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:07.758759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6534732-bf35-4ae7-9e55-92344f558ce5 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:07.780632 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 204/394] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 3 08:58:07 2022] PUT /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2/groups/1321029487ce449ea247e68555d11328/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:58:08.070800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589581-adb8-4da1-be47-b15c4106ac8e None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:08.071756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589581-adb8-4da1-be47-b15c4106ac8e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:08.072261 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589581-adb8-4da1-be47-b15c4106ac8e None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:08.074138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 191/395] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:08.079482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef84456-4abc-4dd1-8ba6-aecccfcc1237 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:08.080008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef84456-4abc-4dd1-8ba6-aecccfcc1237 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:08.080509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef84456-4abc-4dd1-8ba6-aecccfcc1237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:08.102916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-3ef84456-4abc-4dd1-8ba6-aecccfcc1237 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:08.104505 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3ef84456-4abc-4dd1-8ba6-aecccfcc1237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:08.190737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 205/396] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:08.242510 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1589581-adb8-4da1-be47-b15c4106ac8e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:08.386058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1589581-adb8-4da1-be47-b15c4106ac8e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:08.428109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e0f6f-25e8-40ed-99bc-261e37f860ef None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:08.428731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e0f6f-25e8-40ed-99bc-261e37f860ef None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:08.429266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e0f6f-25e8-40ed-99bc-261e37f860ef None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:08.433224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 206/397] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:58:08.437217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a5d42-038d-4242-b8c2-9fec78cb57f4 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:08.437773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a5d42-038d-4242-b8c2-9fec78cb57f4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:08.438247 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a5d42-038d-4242-b8c2-9fec78cb57f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:08.468993 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c3af7-692c-47ba-92c0-041afe689f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:08.470164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c3af7-692c-47ba-92c0-041afe689f97 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:08.470643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c3af7-692c-47ba-92c0-041afe689f97 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:08.471132 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c3af7-692c-47ba-92c0-041afe689f97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:08.476134 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-bd7a5d42-038d-4242-b8c2-9fec78cb57f4 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:08.477317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-bd7a5d42-038d-4242-b8c2-9fec78cb57f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:08.501612 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c3af7-692c-47ba-92c0-041afe689f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-707c3af7-692c-47ba-92c0-041afe689f97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:08.524537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:08.525486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:08.526262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:08.526262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:08.526262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:08.526262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:08.526262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:08.526262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:08.526262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:08.526262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:08.526262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:08.526262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:08.526262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:58:08.526262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:08.534448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 192/398] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:08.535607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c3af7-692c-47ba-92c0-041afe689f97 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:08.685488 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c3af7-692c-47ba-92c0-041afe689f97 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:08.724305 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a39618-0188-415d-9d35-3bbb56bb337f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:08.725393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39618-0188-415d-9d35-3bbb56bb337f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:08.725974 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39618-0188-415d-9d35-3bbb56bb337f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:08.726544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39618-0188-415d-9d35-3bbb56bb337f None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:08.727547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a39618-0188-415d-9d35-3bbb56bb337f None admin] RBAC: Adding query filter params (name=member) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:08.728111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a39618-0188-415d-9d35-3bbb56bb337f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:08.728924 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 207/399] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:08.730461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a39618-0188-415d-9d35-3bbb56bb337f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:08.740193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 193/400] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:58:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:08.748020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a5d42-038d-4242-b8c2-9fec78cb57f4 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:08.760341 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a39618-0188-415d-9d35-3bbb56bb337f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:08.868349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a39618-0188-415d-9d35-3bbb56bb337f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:08.917536 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cea4d-bf4e-46a2-b9b4-de15f288a822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:08.918366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cea4d-bf4e-46a2-b9b4-de15f288a822 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:08.918643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cea4d-bf4e-46a2-b9b4-de15f288a822 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:08.918913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cea4d-bf4e-46a2-b9b4-de15f288a822 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:08.954374 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932cea4d-bf4e-46a2-b9b4-de15f288a822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-932cea4d-bf4e-46a2-b9b4-de15f288a822 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:08.986177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:08.987384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:08.988211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 194/401] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:58:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:08.994333 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cea4d-bf4e-46a2-b9b4-de15f288a822 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:09.029338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a5d42-038d-4242-b8c2-9fec78cb57f4 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:09.066893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2ea4f-00f2-45d5-910e-4fe28a69323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:09.067753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2ea4f-00f2-45d5-910e-4fe28a69323b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:09.068033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2ea4f-00f2-45d5-910e-4fe28a69323b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:09.068335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2ea4f-00f2-45d5-910e-4fe28a69323b None admin] PATH_INFO: `/v3/groups/1321029487ce449ea247e68555d11328` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:09.071460 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2ea4f-00f2-45d5-910e-4fe28a69323b None admin] RBAC: Authorizing `identity:get_group(group_id=1321029487ce449ea247e68555d11328)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:09.071576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2ea4f-00f2-45d5-910e-4fe28a69323b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:09.073670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 208/402] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:08 2022] GET /identity/v3/groups/1321029487ce449ea247e68555d11328 => generated 226 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:09.074947 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcacdd-b848-45a1-a97a-f0de25796427 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:09.075498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcacdd-b848-45a1-a97a-f0de25796427 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:09.075771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcacdd-b848-45a1-a97a-f0de25796427 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:09.077134 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 209/403] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:09.080893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcacdd-b848-45a1-a97a-f0de25796427 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:09.141484 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cea4d-bf4e-46a2-b9b4-de15f288a822 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:09.184886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b6163-7bc6-4a49-b74c-6f56227b9ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:09.185351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b6163-7bc6-4a49-b74c-6f56227b9ca5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:09.185628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b6163-7bc6-4a49-b74c-6f56227b9ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:09.185903 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b6163-7bc6-4a49-b74c-6f56227b9ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:09.186658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b6163-7bc6-4a49-b74c-6f56227b9ca5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:09.187024 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b6163-7bc6-4a49-b74c-6f56227b9ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:09.188353 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b6163-7bc6-4a49-b74c-6f56227b9ca5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:09.196907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcacdd-b848-45a1-a97a-f0de25796427 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:09.197287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 195/404] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:09.198547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f577-9776-4d80-b9fa-1edbddee6f2d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:09.198806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f577-9776-4d80-b9fa-1edbddee6f2d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:09.199081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f577-9776-4d80-b9fa-1edbddee6f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:09.232232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a814f577-9776-4d80-b9fa-1edbddee6f2d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:09.233145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a814f577-9776-4d80-b9fa-1edbddee6f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:09.248639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc9ee8-a6b2-4837-98a1-02d9188774ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:09.250429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc9ee8-a6b2-4837-98a1-02d9188774ab None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:09.250899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc9ee8-a6b2-4837-98a1-02d9188774ab None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:09.251352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc9ee8-a6b2-4837-98a1-02d9188774ab None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:09.253121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc9ee8-a6b2-4837-98a1-02d9188774ab None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:09.254711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc9ee8-a6b2-4837-98a1-02d9188774ab None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:09.257644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 210/405] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:09 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:09.259188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc9ee8-a6b2-4837-98a1-02d9188774ab None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:09.313967 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 196/406] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:09.315119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f577-9776-4d80-b9fa-1edbddee6f2d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:09.378653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc9ee8-a6b2-4837-98a1-02d9188774ab None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:09.417133 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04316b1b-4f56-445c-ab50-c992dd69e67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:09.418553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04316b1b-4f56-445c-ab50-c992dd69e67f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:09.419039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04316b1b-4f56-445c-ab50-c992dd69e67f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:09.419612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04316b1b-4f56-445c-ab50-c992dd69e67f None admin] PATH_INFO: `/v3/groups/1321029487ce449ea247e68555d11328` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:09.421572 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04316b1b-4f56-445c-ab50-c992dd69e67f None admin] RBAC: Authorizing `identity:get_group(group_id=1321029487ce449ea247e68555d11328)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:09.423425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04316b1b-4f56-445c-ab50-c992dd69e67f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:09.425975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 211/407] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:09 2022] GET /identity/v3/groups/1321029487ce449ea247e68555d11328 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:09.426993 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04316b1b-4f56-445c-ab50-c992dd69e67f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:09.444785 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f577-9776-4d80-b9fa-1edbddee6f2d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:09.484047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164d25-d9e6-4bbe-bb86-2ba5d7cf17d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:09.485015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164d25-d9e6-4bbe-bb86-2ba5d7cf17d7 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:09.485308 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164d25-d9e6-4bbe-bb86-2ba5d7cf17d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:09.485649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164d25-d9e6-4bbe-bb86-2ba5d7cf17d7 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a/groups/1321029487ce449ea247e68555d11328/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:09.487787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1164d25-d9e6-4bbe-bb86-2ba5d7cf17d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f51e80d377884c07b775ad9e99feb88a, group_id=1321029487ce449ea247e68555d11328, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:09.489240 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1164d25-d9e6-4bbe-bb86-2ba5d7cf17d7 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:09.516701 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 197/408] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 3 08:58:09 2022] PUT /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a/groups/1321029487ce449ea247e68555d11328/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:58:09.518997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164d25-d9e6-4bbe-bb86-2ba5d7cf17d7 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:09.562556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04316b1b-4f56-445c-ab50-c992dd69e67f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:09.608702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450b351-b6b5-481c-9a10-ffebf7a2ccaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:09.609903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450b351-b6b5-481c-9a10-ffebf7a2ccaa None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:09.610378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450b351-b6b5-481c-9a10-ffebf7a2ccaa None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:09.610867 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450b351-b6b5-481c-9a10-ffebf7a2ccaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:09.625136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450b351-b6b5-481c-9a10-ffebf7a2ccaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-8450b351-b6b5-481c-9a10-ffebf7a2ccaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:09.635985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:09.636906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:09.637717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:09.637717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:09.637717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:09.637717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:09.637717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:09.637717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:09.637717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:09.637717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:09.637717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:09.637717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:09.637717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:09.637717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:09.640937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 212/409] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:09.646576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164d25-d9e6-4bbe-bb86-2ba5d7cf17d7 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:09.648344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450b351-b6b5-481c-9a10-ffebf7a2ccaa None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:09.745496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7082c-420b-4ade-a033-1e1c4743bc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:09.746289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7082c-420b-4ade-a033-1e1c4743bc9b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:09.746571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7082c-420b-4ade-a033-1e1c4743bc9b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:09.746841 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7082c-420b-4ade-a033-1e1c4743bc9b None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:09.753037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7082c-420b-4ade-a033-1e1c4743bc9b None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:09.754725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7082c-420b-4ade-a033-1e1c4743bc9b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:09.756664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 198/410] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:09 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:09.762780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7082c-420b-4ade-a033-1e1c4743bc9b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:09.764456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450b351-b6b5-481c-9a10-ffebf7a2ccaa None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:09.802122 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccef86a-065e-4111-9659-52d210f98817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:09.803046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccef86a-065e-4111-9659-52d210f98817 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:09.803467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccef86a-065e-4111-9659-52d210f98817 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:09.803914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccef86a-065e-4111-9659-52d210f98817 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:09.804835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccef86a-065e-4111-9659-52d210f98817 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:09.805269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccef86a-065e-4111-9659-52d210f98817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:09.806819 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccef86a-065e-4111-9659-52d210f98817 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:09.815602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 213/411] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:09.822514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccef86a-065e-4111-9659-52d210f98817 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:09.903918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7082c-420b-4ade-a033-1e1c4743bc9b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:09.946757 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb544a4-487e-41e8-831b-fb7a5ef5d26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:09.947635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb544a4-487e-41e8-831b-fb7a5ef5d26f None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:09.948177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb544a4-487e-41e8-831b-fb7a5ef5d26f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:09.948685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb544a4-487e-41e8-831b-fb7a5ef5d26f None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a/groups/1321029487ce449ea247e68555d11328/roles/f12928ff609a47a9bef9cb8abc28932b` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:09.952329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb544a4-487e-41e8-831b-fb7a5ef5d26f None admin] RBAC: Authorizing `identity:create_grant(project_id=f51e80d377884c07b775ad9e99feb88a, group_id=1321029487ce449ea247e68555d11328, role_id=f12928ff609a47a9bef9cb8abc28932b)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:09.954008 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb544a4-487e-41e8-831b-fb7a5ef5d26f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:09.954798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccef86a-065e-4111-9659-52d210f98817 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:09.988422 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 199/412] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 3 08:58:09 2022] PUT /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a/groups/1321029487ce449ea247e68555d11328/roles/f12928ff609a47a9bef9cb8abc28932b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:58:10.021441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24668-7553-41ba-97d1-d644c5fdf7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:10.022328 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24668-7553-41ba-97d1-d644c5fdf7f5 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:10.022630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24668-7553-41ba-97d1-d644c5fdf7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:10.022975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24668-7553-41ba-97d1-d644c5fdf7f5 None admin] PATH_INFO: `/v3/groups/303ba53a7d2948a2a831d0108bcda47a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:10.024815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f24668-7553-41ba-97d1-d644c5fdf7f5 None admin] RBAC: Authorizing `identity:get_group(group_id=303ba53a7d2948a2a831d0108bcda47a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:10.027282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f24668-7553-41ba-97d1-d644c5fdf7f5 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:10.030415 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 214/413] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:09 2022] GET /identity/v3/groups/303ba53a7d2948a2a831d0108bcda47a => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:10.035978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb544a4-487e-41e8-831b-fb7a5ef5d26f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:10.164288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb544a4-487e-41e8-831b-fb7a5ef5d26f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:10.205137 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5199241-8725-4300-b785-482e7983a3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:10.206401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5199241-8725-4300-b785-482e7983a3a4 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:10.207124 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5199241-8725-4300-b785-482e7983a3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:10.207668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5199241-8725-4300-b785-482e7983a3a4 None admin] PATH_INFO: `/v3/projects/25541cb90a5a4ec5b739da2d1d1355bf` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:10.209377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5199241-8725-4300-b785-482e7983a3a4 None admin] RBAC: Authorizing `identity:get_project(project_id=25541cb90a5a4ec5b739da2d1d1355bf)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:10.211152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5199241-8725-4300-b785-482e7983a3a4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:10.218046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 200/414] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:10 2022] GET /identity/v3/projects/25541cb90a5a4ec5b739da2d1d1355bf => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:10.219729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24668-7553-41ba-97d1-d644c5fdf7f5 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:10.390040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24668-7553-41ba-97d1-d644c5fdf7f5 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:10.431507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ce9b4-c74d-48d8-9714-153c88de2d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:10.432544 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ce9b4-c74d-48d8-9714-153c88de2d10 None admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:10.432822 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ce9b4-c74d-48d8-9714-153c88de2d10 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:10.433092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ce9b4-c74d-48d8-9714-153c88de2d10 None admin] PATH_INFO: `/v3/projects/25541cb90a5a4ec5b739da2d1d1355bf/groups/303ba53a7d2948a2a831d0108bcda47a/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:10.435046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ce9b4-c74d-48d8-9714-153c88de2d10 None admin] RBAC: Authorizing `identity:create_grant(project_id=25541cb90a5a4ec5b739da2d1d1355bf, group_id=303ba53a7d2948a2a831d0108bcda47a, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:10.436509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ce9b4-c74d-48d8-9714-153c88de2d10 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:10.454188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 215/415] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 3 08:58:10 2022] PUT /identity/v3/projects/25541cb90a5a4ec5b739da2d1d1355bf/groups/303ba53a7d2948a2a831d0108bcda47a/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:58:10.572311 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c53ad-d435-49cf-bda9-10e30be873b3 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:10.572760 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c53ad-d435-49cf-bda9-10e30be873b3 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:10.573125 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c53ad-d435-49cf-bda9-10e30be873b3 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:10.574882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 201/416] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:10.581040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14900ec7-4849-4a95-af6d-238cecb5c9be None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:10.581471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14900ec7-4849-4a95-af6d-238cecb5c9be None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:10.581898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14900ec7-4849-4a95-af6d-238cecb5c9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:10.599955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-14900ec7-4849-4a95-af6d-238cecb5c9be None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:10.601444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-14900ec7-4849-4a95-af6d-238cecb5c9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:10.674437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 216/417] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:10.698354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c53ad-d435-49cf-bda9-10e30be873b3 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:10.805900 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c53ad-d435-49cf-bda9-10e30be873b3 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:10.840005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f3bc2-7a02-45a9-8d82-798ed4f679e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:10.840893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f3bc2-7a02-45a9-8d82-798ed4f679e0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:10.841171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f3bc2-7a02-45a9-8d82-798ed4f679e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:10.841482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f3bc2-7a02-45a9-8d82-798ed4f679e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:10.851798 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f3bc2-7a02-45a9-8d82-798ed4f679e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-583f3bc2-7a02-45a9-8d82-798ed4f679e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:10.860025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:10.860944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:10.862518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 202/418] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:58:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:10.867938 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14900ec7-4849-4a95-af6d-238cecb5c9be None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:10.900626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0238d53-21f7-4f74-989f-7aec5a2d2d36 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:10.900923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0238d53-21f7-4f74-989f-7aec5a2d2d36 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:10.901538 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0238d53-21f7-4f74-989f-7aec5a2d2d36 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:10.903530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 203/419] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:58:10.910036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e47723-7e22-4098-86fe-ac169603cb3a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:10.910318 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e47723-7e22-4098-86fe-ac169603cb3a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:10.910596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e47723-7e22-4098-86fe-ac169603cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:10.929432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-05e47723-7e22-4098-86fe-ac169603cb3a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:10.930759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-05e47723-7e22-4098-86fe-ac169603cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:11.006161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 204/420] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:11.032463 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14900ec7-4849-4a95-af6d-238cecb5c9be None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:11.041247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e47723-7e22-4098-86fe-ac169603cb3a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:11.077437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173d550-36e2-45a1-9fe9-4fb78dacf6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:11.078115 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173d550-36e2-45a1-9fe9-4fb78dacf6ce None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:11.078395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173d550-36e2-45a1-9fe9-4fb78dacf6ce None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:11.078665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173d550-36e2-45a1-9fe9-4fb78dacf6ce None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:11.079419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173d550-36e2-45a1-9fe9-4fb78dacf6ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:11.079729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173d550-36e2-45a1-9fe9-4fb78dacf6ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:11.081119 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173d550-36e2-45a1-9fe9-4fb78dacf6ce None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:11.096531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 217/421] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:11.104139 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173d550-36e2-45a1-9fe9-4fb78dacf6ce None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:11.150440 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e47723-7e22-4098-86fe-ac169603cb3a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:11.185179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe978f4-bfe5-4db5-9d4a-dc3122c7c4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:11.186055 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe978f4-bfe5-4db5-9d4a-dc3122c7c4f0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:11.186334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe978f4-bfe5-4db5-9d4a-dc3122c7c4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:11.186756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe978f4-bfe5-4db5-9d4a-dc3122c7c4f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:11.200425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe978f4-bfe5-4db5-9d4a-dc3122c7c4f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:11.204464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173d550-36e2-45a1-9fe9-4fb78dacf6ce None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-3fe978f4-bfe5-4db5-9d4a-dc3122c7c4f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:11.216638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:11.218542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:11.219656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 205/422] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:11.232111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe978f4-bfe5-4db5-9d4a-dc3122c7c4f0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:11.244265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16cf54-e1ae-4620-82c0-b328e3ca71da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:11.245028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16cf54-e1ae-4620-82c0-b328e3ca71da None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:11.245378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16cf54-e1ae-4620-82c0-b328e3ca71da None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:11.245721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16cf54-e1ae-4620-82c0-b328e3ca71da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:11.327955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16cf54-e1ae-4620-82c0-b328e3ca71da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:11.329730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16cf54-e1ae-4620-82c0-b328e3ca71da None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:11.382846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe978f4-bfe5-4db5-9d4a-dc3122c7c4f0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:11.435647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 218/423] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:58:11.441078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16cf54-e1ae-4620-82c0-b328e3ca71da None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:11.473707 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcabf4-cd5a-4867-9a8c-5d5cd44f1b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:11.474666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcabf4-cd5a-4867-9a8c-5d5cd44f1b82 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:11.475171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcabf4-cd5a-4867-9a8c-5d5cd44f1b82 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:11.475679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcabf4-cd5a-4867-9a8c-5d5cd44f1b82 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:11.477155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcabf4-cd5a-4867-9a8c-5d5cd44f1b82 None admin] RBAC: Adding query filter params (name=member) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:11.477636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcabf4-cd5a-4867-9a8c-5d5cd44f1b82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:11.479184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcabf4-cd5a-4867-9a8c-5d5cd44f1b82 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:11.499469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 206/424] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:58:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:11.504899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcabf4-cd5a-4867-9a8c-5d5cd44f1b82 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:11.547742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16cf54-e1ae-4620-82c0-b328e3ca71da None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:11.584034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdd25a-7eb3-4fde-a60a-6f3aeacd85c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:11.585601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdd25a-7eb3-4fde-a60a-6f3aeacd85c3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:11.585879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdd25a-7eb3-4fde-a60a-6f3aeacd85c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:11.586205 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdd25a-7eb3-4fde-a60a-6f3aeacd85c3 None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:11.587637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdd25a-7eb3-4fde-a60a-6f3aeacd85c3 None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:11.589268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdd25a-7eb3-4fde-a60a-6f3aeacd85c3 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:11.591256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 219/425] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:11 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:11.597450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdd25a-7eb3-4fde-a60a-6f3aeacd85c3 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:11.719744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdd25a-7eb3-4fde-a60a-6f3aeacd85c3 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:11.760466 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcabf4-cd5a-4867-9a8c-5d5cd44f1b82 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:11.789156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675bd90-23e2-4755-bdef-80d88181bbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:11.791065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675bd90-23e2-4755-bdef-80d88181bbd1 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:11.794156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675bd90-23e2-4755-bdef-80d88181bbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:11.794643 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675bd90-23e2-4755-bdef-80d88181bbd1 None admin] PATH_INFO: `/v3/groups/1321029487ce449ea247e68555d11328` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:11.796989 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675bd90-23e2-4755-bdef-80d88181bbd1 None admin] RBAC: Authorizing `identity:get_group(group_id=1321029487ce449ea247e68555d11328)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:11.798647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675bd90-23e2-4755-bdef-80d88181bbd1 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:11.800668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 220/426] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:11 2022] GET /identity/v3/groups/1321029487ce449ea247e68555d11328 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:11.808206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675bd90-23e2-4755-bdef-80d88181bbd1 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:11.821068 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf9d82-7e69-46c7-b390-6ea9752424e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:11.821920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9d82-7e69-46c7-b390-6ea9752424e5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:11.822436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9d82-7e69-46c7-b390-6ea9752424e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:11.822856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9d82-7e69-46c7-b390-6ea9752424e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:11.890980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf9d82-7e69-46c7-b390-6ea9752424e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:11.892771 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf9d82-7e69-46c7-b390-6ea9752424e5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:12.028278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675bd90-23e2-4755-bdef-80d88181bbd1 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:12.050158 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 207/427] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:58:12.054208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf9d82-7e69-46c7-b390-6ea9752424e5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:12.101878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b5d06-3e7e-4aa2-9194-31941d368995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:12.102541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b5d06-3e7e-4aa2-9194-31941d368995 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:12.102831 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b5d06-3e7e-4aa2-9194-31941d368995 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:12.103217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b5d06-3e7e-4aa2-9194-31941d368995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:12.103928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b5d06-3e7e-4aa2-9194-31941d368995 None admin] RBAC: Adding query filter params (group.id=1321029487ce449ea247e68555d11328, role.id=f12928ff609a47a9bef9cb8abc28932b, scope.project.id=01616978948a4ea094e1ee9190ac21f2) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:12.104279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b5d06-3e7e-4aa2-9194-31941d368995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:12.105704 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b5d06-3e7e-4aa2-9194-31941d368995 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:12.119524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 221/428] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 08:58:11 2022] GET /identity/v3/role_assignments?group.id=1321029487ce449ea247e68555d11328&scope.project.id=01616978948a4ea094e1ee9190ac21f2&role.id=f12928ff609a47a9bef9cb8abc28932b => generated 611 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:12.169347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf9d82-7e69-46c7-b390-6ea9752424e5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:12.205900 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ed2c9-fc4a-4076-ae57-bbc19a41935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:12.207920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed2c9-fc4a-4076-ae57-bbc19a41935d None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:12.208377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed2c9-fc4a-4076-ae57-bbc19a41935d None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:12.208809 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed2c9-fc4a-4076-ae57-bbc19a41935d None admin] PATH_INFO: `/v3/projects/01616978948a4ea094e1ee9190ac21f2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:12.210818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ed2c9-fc4a-4076-ae57-bbc19a41935d None admin] RBAC: Authorizing `identity:get_project(project_id=01616978948a4ea094e1ee9190ac21f2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:12.212539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ed2c9-fc4a-4076-ae57-bbc19a41935d None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:12.214771 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 208/429] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:12 2022] GET /identity/v3/projects/01616978948a4ea094e1ee9190ac21f2 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:12.220040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b5d06-3e7e-4aa2-9194-31941d368995 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:12.285873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dd5c7-cf95-472b-8792-436681fef8ac None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:12.286180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dd5c7-cf95-472b-8792-436681fef8ac None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:12.286370 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dd5c7-cf95-472b-8792-436681fef8ac None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:12.288014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 209/430] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:58:12.293279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6aee-2c49-4f88-afb4-c476a184e25e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:12.293561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6aee-2c49-4f88-afb4-c476a184e25e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:12.293837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6aee-2c49-4f88-afb4-c476a184e25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:12.314168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-4c4f6aee-2c49-4f88-afb4-c476a184e25e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:12.315547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4c4f6aee-2c49-4f88-afb4-c476a184e25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:12.380763 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b5d06-3e7e-4aa2-9194-31941d368995 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:12.415356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c11166-c438-4c95-82b1-5b0495c61c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:12.416259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c11166-c438-4c95-82b1-5b0495c61c01 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:12.416546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c11166-c438-4c95-82b1-5b0495c61c01 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:12.416823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c11166-c438-4c95-82b1-5b0495c61c01 None admin] PATH_INFO: `/v3/groups/1321029487ce449ea247e68555d11328` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:12.418018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c11166-c438-4c95-82b1-5b0495c61c01 None admin] RBAC: Authorizing `identity:get_group(group_id=1321029487ce449ea247e68555d11328)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:12.419451 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c11166-c438-4c95-82b1-5b0495c61c01 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:12.421446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 222/431] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:12 2022] GET /identity/v3/groups/1321029487ce449ea247e68555d11328 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:12.426866 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c11166-c438-4c95-82b1-5b0495c61c01 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:12.446465 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 210/432] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:58:12.489174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f6aee-2c49-4f88-afb4-c476a184e25e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:12.541259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c11166-c438-4c95-82b1-5b0495c61c01 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:12.583734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e46aef-fabd-4546-a679-cf49a1ebf303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:12.584440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e46aef-fabd-4546-a679-cf49a1ebf303 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:12.584727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e46aef-fabd-4546-a679-cf49a1ebf303 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:12.585031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e46aef-fabd-4546-a679-cf49a1ebf303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:12.585870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e46aef-fabd-4546-a679-cf49a1ebf303 None admin] RBAC: Adding query filter params (group.id=1321029487ce449ea247e68555d11328, role.id=e67ab18ce1304dc28ac4e134bba5f8be, scope.project.id=01616978948a4ea094e1ee9190ac21f2) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:12.586184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e46aef-fabd-4546-a679-cf49a1ebf303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:12.587611 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e46aef-fabd-4546-a679-cf49a1ebf303 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:12.593908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 223/433] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 08:58:12 2022] GET /identity/v3/role_assignments?group.id=1321029487ce449ea247e68555d11328&scope.project.id=01616978948a4ea094e1ee9190ac21f2&role.id=e67ab18ce1304dc28ac4e134bba5f8be => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:12.617636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f6aee-2c49-4f88-afb4-c476a184e25e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:12.658127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905cf8d-2dd9-4f7b-980c-2db934a14cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:12.658933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905cf8d-2dd9-4f7b-980c-2db934a14cf7 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:12.659215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905cf8d-2dd9-4f7b-980c-2db934a14cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:12.659488 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905cf8d-2dd9-4f7b-980c-2db934a14cf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:12.672165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905cf8d-2dd9-4f7b-980c-2db934a14cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-4905cf8d-2dd9-4f7b-980c-2db934a14cf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:12.680909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:12.681869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:12.682646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 211/434] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:12.689978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e46aef-fabd-4546-a679-cf49a1ebf303 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:12.801721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e46aef-fabd-4546-a679-cf49a1ebf303 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:12.836667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b54e4-d327-4b8a-a0c9-77b745a82826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:12.837349 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b54e4-d327-4b8a-a0c9-77b745a82826 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:12.837629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b54e4-d327-4b8a-a0c9-77b745a82826 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:12.837901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b54e4-d327-4b8a-a0c9-77b745a82826 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:12.838668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b54e4-d327-4b8a-a0c9-77b745a82826 None admin] RBAC: Adding query filter params (name=member) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:12.838973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b54e4-d327-4b8a-a0c9-77b745a82826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:12.840471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b54e4-d327-4b8a-a0c9-77b745a82826 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:12.850277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 224/435] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:58:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:12.856481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905cf8d-2dd9-4f7b-980c-2db934a14cf7 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:12.966406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905cf8d-2dd9-4f7b-980c-2db934a14cf7 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:13.005210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcd16c-3d63-4c01-926f-4e7db7aee9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:13.005856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcd16c-3d63-4c01-926f-4e7db7aee9ae None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.006134 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcd16c-3d63-4c01-926f-4e7db7aee9ae None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.006405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcd16c-3d63-4c01-926f-4e7db7aee9ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.042200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ce741-a559-4b63-b520-2b6053ec8a31 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.042700 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ce741-a559-4b63-b520-2b6053ec8a31 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.042805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ce741-a559-4b63-b520-2b6053ec8a31 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.044262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 225/436] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:58:13.051453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673386bb-264a-4aa5-9fb8-186bfc7ee8f5 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.051453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673386bb-264a-4aa5-9fb8-186bfc7ee8f5 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.051453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673386bb-264a-4aa5-9fb8-186bfc7ee8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.073178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-673386bb-264a-4aa5-9fb8-186bfc7ee8f5 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:13.074453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-673386bb-264a-4aa5-9fb8-186bfc7ee8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:13.087064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcd16c-3d63-4c01-926f-4e7db7aee9ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:13.089519 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcd16c-3d63-4c01-926f-4e7db7aee9ae None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:13.161032 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 226/437] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:58:13.185393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673386bb-264a-4aa5-9fb8-186bfc7ee8f5 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:13.219630 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 212/438] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:13.225148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcd16c-3d63-4c01-926f-4e7db7aee9ae None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:13.308400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673386bb-264a-4aa5-9fb8-186bfc7ee8f5 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:13.338793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcd16c-3d63-4c01-926f-4e7db7aee9ae None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:13.340050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbb471-1dfb-4946-874f-1fb7c6df451d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:13.340866 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbb471-1dfb-4946-874f-1fb7c6df451d None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.341142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbb471-1dfb-4946-874f-1fb7c6df451d None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.341408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbb471-1dfb-4946-874f-1fb7c6df451d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.351439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbb471-1dfb-4946-874f-1fb7c6df451d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-2dcbb471-1dfb-4946-874f-1fb7c6df451d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:13.359396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:13.360564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:13.361436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 227/439] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:58:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:13.362079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64febfee-93c2-4b20-892f-2a7935d7cd4a None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.362079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64febfee-93c2-4b20-892f-2a7935d7cd4a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.362407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64febfee-93c2-4b20-892f-2a7935d7cd4a None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.363608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 228/440] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:13.366716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64febfee-93c2-4b20-892f-2a7935d7cd4a None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:13.373889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f073b2-643b-4815-8ac4-49b7fce6e1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:13.374744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f073b2-643b-4815-8ac4-49b7fce6e1d2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.375026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f073b2-643b-4815-8ac4-49b7fce6e1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.375309 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f073b2-643b-4815-8ac4-49b7fce6e1d2 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.376516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f073b2-643b-4815-8ac4-49b7fce6e1d2 None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:13.377939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f073b2-643b-4815-8ac4-49b7fce6e1d2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:13.379597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 213/441] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:13 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:13.381354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fffa3-250c-41f0-bbb4-8e65044de47c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.381645 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fffa3-250c-41f0-bbb4-8e65044de47c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.382470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fffa3-250c-41f0-bbb4-8e65044de47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.398670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0f9fffa3-250c-41f0-bbb4-8e65044de47c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:13.399866 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0f9fffa3-250c-41f0-bbb4-8e65044de47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:13.460750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 214/442] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:13.461531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64febfee-93c2-4b20-892f-2a7935d7cd4a None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:13.461643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fffa3-250c-41f0-bbb4-8e65044de47c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:13.498864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd1935-2b19-4a1b-a2d1-db62fd944719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:13.499525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd1935-2b19-4a1b-a2d1-db62fd944719 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.499963 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd1935-2b19-4a1b-a2d1-db62fd944719 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.500271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd1935-2b19-4a1b-a2d1-db62fd944719 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.501017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd1935-2b19-4a1b-a2d1-db62fd944719 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:13.501322 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd1935-2b19-4a1b-a2d1-db62fd944719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:13.502687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd1935-2b19-4a1b-a2d1-db62fd944719 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:13.510798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 229/443] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:13.511570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd1935-2b19-4a1b-a2d1-db62fd944719 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:13.558513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fffa3-250c-41f0-bbb4-8e65044de47c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:13.589570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613a043-e209-4a7e-ab2f-97ce4d527ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:13.590351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613a043-e209-4a7e-ab2f-97ce4d527ced None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.590650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613a043-e209-4a7e-ab2f-97ce4d527ced None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.590920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613a043-e209-4a7e-ab2f-97ce4d527ced None admin] PATH_INFO: `/v3/groups/1321029487ce449ea247e68555d11328` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.592070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613a043-e209-4a7e-ab2f-97ce4d527ced None admin] RBAC: Authorizing `identity:get_group(group_id=1321029487ce449ea247e68555d11328)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:13.593512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613a043-e209-4a7e-ab2f-97ce4d527ced None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:13.595255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 215/444] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:13 2022] GET /identity/v3/groups/1321029487ce449ea247e68555d11328 => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:13.595825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613a043-e209-4a7e-ab2f-97ce4d527ced None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:13.613777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd1935-2b19-4a1b-a2d1-db62fd944719 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:13.646341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cdc45-b5fc-49f0-a528-515322fd52be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:13.647122 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cdc45-b5fc-49f0-a528-515322fd52be None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.647404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cdc45-b5fc-49f0-a528-515322fd52be None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.647673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cdc45-b5fc-49f0-a528-515322fd52be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.657096 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cdc45-b5fc-49f0-a528-515322fd52be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-f47cdc45-b5fc-49f0-a528-515322fd52be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:13.665191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:13.666141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:13.666914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:13.666914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:13.666914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:13.666914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:13.666914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:13.666914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:13.666914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:13.666914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:13.666914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:13.666914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:13.666914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:13.666914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:13.668222 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 230/445] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:13.669190 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cdc45-b5fc-49f0-a528-515322fd52be None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:13.689262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613a043-e209-4a7e-ab2f-97ce4d527ced None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:13.721585 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e127a28-9f1c-484c-b4a0-d25c32f216b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:13.722227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e127a28-9f1c-484c-b4a0-d25c32f216b0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.722514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e127a28-9f1c-484c-b4a0-d25c32f216b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.722784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e127a28-9f1c-484c-b4a0-d25c32f216b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.760755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cdc45-b5fc-49f0-a528-515322fd52be None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:13.785575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e127a28-9f1c-484c-b4a0-d25c32f216b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:13.787029 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e127a28-9f1c-484c-b4a0-d25c32f216b0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:13.792267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89ce09-80cb-48dc-ab4e-947ad294babe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:13.792904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89ce09-80cb-48dc-ab4e-947ad294babe None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.793191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89ce09-80cb-48dc-ab4e-947ad294babe None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.793462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89ce09-80cb-48dc-ab4e-947ad294babe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.794281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89ce09-80cb-48dc-ab4e-947ad294babe None admin] RBAC: Adding query filter params (group.id=1321029487ce449ea247e68555d11328, role.id=e67ab18ce1304dc28ac4e134bba5f8be, scope.project.id=f51e80d377884c07b775ad9e99feb88a) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:13.794589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89ce09-80cb-48dc-ab4e-947ad294babe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:13.795990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89ce09-80cb-48dc-ab4e-947ad294babe None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:13.801527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 231/446] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 08:58:13 2022] GET /identity/v3/role_assignments?group.id=1321029487ce449ea247e68555d11328&scope.project.id=f51e80d377884c07b775ad9e99feb88a&role.id=e67ab18ce1304dc28ac4e134bba5f8be => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:13.802302 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89ce09-80cb-48dc-ab4e-947ad294babe None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:13.901817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 216/447] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:13.902711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89ce09-80cb-48dc-ab4e-947ad294babe None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:13.907478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e127a28-9f1c-484c-b4a0-d25c32f216b0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:13.937425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6462-bebd-48c2-9400-a876b61bdce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:13.938136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6462-bebd-48c2-9400-a876b61bdce4 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:13.938418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6462-bebd-48c2-9400-a876b61bdce4 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:13.938697 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6462-bebd-48c2-9400-a876b61bdce4 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:13.939461 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab6462-bebd-48c2-9400-a876b61bdce4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:13.939770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab6462-bebd-48c2-9400-a876b61bdce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:13.941227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab6462-bebd-48c2-9400-a876b61bdce4 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:13.950277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 232/448] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:13.955913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6462-bebd-48c2-9400-a876b61bdce4 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:14.014763 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e127a28-9f1c-484c-b4a0-d25c32f216b0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:14.056675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1295a7-51ae-4ca4-9398-6dff3a6f2673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:14.057785 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1295a7-51ae-4ca4-9398-6dff3a6f2673 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:14.058067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1295a7-51ae-4ca4-9398-6dff3a6f2673 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:14.058347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1295a7-51ae-4ca4-9398-6dff3a6f2673 None admin] PATH_INFO: `/v3/projects/f51e80d377884c07b775ad9e99feb88a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:14.059557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1295a7-51ae-4ca4-9398-6dff3a6f2673 None admin] RBAC: Authorizing `identity:get_project(project_id=f51e80d377884c07b775ad9e99feb88a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:14.061030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1295a7-51ae-4ca4-9398-6dff3a6f2673 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:14.063070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 217/449] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:13 2022] GET /identity/v3/projects/f51e80d377884c07b775ad9e99feb88a => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:14.068017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6462-bebd-48c2-9400-a876b61bdce4 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:14.068508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1295a7-51ae-4ca4-9398-6dff3a6f2673 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:14.108553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5946623-1871-4efc-9f17-e8d475cceb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:14.109211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5946623-1871-4efc-9f17-e8d475cceb6e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:14.109491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5946623-1871-4efc-9f17-e8d475cceb6e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:14.109765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5946623-1871-4efc-9f17-e8d475cceb6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:14.177818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1295a7-51ae-4ca4-9398-6dff3a6f2673 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:14.184344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5946623-1871-4efc-9f17-e8d475cceb6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:14.186196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5946623-1871-4efc-9f17-e8d475cceb6e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:14.212152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702119c-f11b-4ede-917d-20b5febfd929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:14.212996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702119c-f11b-4ede-917d-20b5febfd929 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:14.213271 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702119c-f11b-4ede-917d-20b5febfd929 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:14.213540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702119c-f11b-4ede-917d-20b5febfd929 None admin] PATH_INFO: `/v3/groups/1321029487ce449ea247e68555d11328` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:14.214693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702119c-f11b-4ede-917d-20b5febfd929 None admin] RBAC: Authorizing `identity:get_group(group_id=1321029487ce449ea247e68555d11328)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:14.216126 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702119c-f11b-4ede-917d-20b5febfd929 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:14.217713 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 218/450] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:14 2022] GET /identity/v3/groups/1321029487ce449ea247e68555d11328 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:14.223358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702119c-f11b-4ede-917d-20b5febfd929 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:14.282147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 233/451] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:58:14.287571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5946623-1871-4efc-9f17-e8d475cceb6e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:14.314594 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702119c-f11b-4ede-917d-20b5febfd929 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:14.347982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be30940-61ab-42ba-b393-d4b2db2ec89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:14.348652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be30940-61ab-42ba-b393-d4b2db2ec89d None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:14.348932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be30940-61ab-42ba-b393-d4b2db2ec89d None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:14.349210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be30940-61ab-42ba-b393-d4b2db2ec89d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:14.350030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be30940-61ab-42ba-b393-d4b2db2ec89d None admin] RBAC: Adding query filter params (group.id=1321029487ce449ea247e68555d11328, role.id=f12928ff609a47a9bef9cb8abc28932b, scope.project.id=f51e80d377884c07b775ad9e99feb88a) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:14.350342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be30940-61ab-42ba-b393-d4b2db2ec89d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:14.351809 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be30940-61ab-42ba-b393-d4b2db2ec89d None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:14.357392 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 219/452] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 08:58:14 2022] GET /identity/v3/role_assignments?group.id=1321029487ce449ea247e68555d11328&scope.project.id=f51e80d377884c07b775ad9e99feb88a&role.id=f12928ff609a47a9bef9cb8abc28932b => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:14.378213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5946623-1871-4efc-9f17-e8d475cceb6e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:14.414072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb7ba1-e76a-4ee4-b75f-67baf2a69560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:14.414952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb7ba1-e76a-4ee4-b75f-67baf2a69560 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:14.415233 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb7ba1-e76a-4ee4-b75f-67baf2a69560 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:14.415506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb7ba1-e76a-4ee4-b75f-67baf2a69560 None admin] PATH_INFO: `/v3/projects/25541cb90a5a4ec5b739da2d1d1355bf` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:14.416777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb7ba1-e76a-4ee4-b75f-67baf2a69560 None admin] RBAC: Authorizing `identity:get_project(project_id=25541cb90a5a4ec5b739da2d1d1355bf)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:14.418239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb7ba1-e76a-4ee4-b75f-67baf2a69560 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:14.420006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 234/453] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:58:14 2022] GET /identity/v3/projects/25541cb90a5a4ec5b739da2d1d1355bf => generated 344 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:14.425812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be30940-61ab-42ba-b393-d4b2db2ec89d None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:14.526320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be30940-61ab-42ba-b393-d4b2db2ec89d None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:14.559581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935a071-9595-4c97-93ad-4ac8cc7c96d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:14.560507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935a071-9595-4c97-93ad-4ac8cc7c96d8 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:14.560795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935a071-9595-4c97-93ad-4ac8cc7c96d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:14.561070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935a071-9595-4c97-93ad-4ac8cc7c96d8 None admin] PATH_INFO: `/v3/groups/303ba53a7d2948a2a831d0108bcda47a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:14.562248 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935a071-9595-4c97-93ad-4ac8cc7c96d8 None admin] RBAC: Authorizing `identity:get_group(group_id=303ba53a7d2948a2a831d0108bcda47a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:14.563691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935a071-9595-4c97-93ad-4ac8cc7c96d8 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:14.565347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 220/454] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 08:58:14 2022] GET /identity/v3/groups/303ba53a7d2948a2a831d0108bcda47a => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:14.571767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb7ba1-e76a-4ee4-b75f-67baf2a69560 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:14.675652 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb7ba1-e76a-4ee4-b75f-67baf2a69560 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:14.708706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58600b54-7820-462a-99b4-b44b4a4adc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:14.709361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58600b54-7820-462a-99b4-b44b4a4adc56 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:14.709639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58600b54-7820-462a-99b4-b44b4a4adc56 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:14.710259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58600b54-7820-462a-99b4-b44b4a4adc56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:14.710732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58600b54-7820-462a-99b4-b44b4a4adc56 None admin] RBAC: Adding query filter params (group.id=303ba53a7d2948a2a831d0108bcda47a, role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=25541cb90a5a4ec5b739da2d1d1355bf) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:14.711039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58600b54-7820-462a-99b4-b44b4a4adc56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:14.712508 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58600b54-7820-462a-99b4-b44b4a4adc56 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:14.718297 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 235/455] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 08:58:14 2022] GET /identity/v3/role_assignments?group.id=303ba53a7d2948a2a831d0108bcda47a&scope.project.id=25541cb90a5a4ec5b739da2d1d1355bf&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:17.554368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1181ee-e8fb-4e07-a279-2a1ff80e1f2b None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:17.554873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1181ee-e8fb-4e07-a279-2a1ff80e1f2b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:17.554982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1181ee-e8fb-4e07-a279-2a1ff80e1f2b None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:17.556534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 221/456] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:17.569301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7370f-011a-4129-99c8-43a462ea2d67 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:17.570116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7370f-011a-4129-99c8-43a462ea2d67 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:17.570606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7370f-011a-4129-99c8-43a462ea2d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:17.594536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-8eb7370f-011a-4129-99c8-43a462ea2d67 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:17.596015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8eb7370f-011a-4129-99c8-43a462ea2d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:17.684460 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 236/457] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:17.717107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36743c27-1a28-43e9-a775-6e24f83fe592 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:17.717708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36743c27-1a28-43e9-a775-6e24f83fe592 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:17.718227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36743c27-1a28-43e9-a775-6e24f83fe592 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:17.720005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 222/458] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:17.724121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7370f-011a-4129-99c8-43a462ea2d67 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:17.729435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf67e9-30f1-466d-be7a-30958272a42e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:17.729721 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf67e9-30f1-466d-be7a-30958272a42e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:17.729996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf67e9-30f1-466d-be7a-30958272a42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:17.755308 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8cdf67e9-30f1-466d-be7a-30958272a42e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:17.759230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8cdf67e9-30f1-466d-be7a-30958272a42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:17.864033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 223/459] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:17.865304 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c44165-5ffb-46e8-9d26-58c28d72fafb None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:17.865587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c44165-5ffb-46e8-9d26-58c28d72fafb None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:17.865859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c44165-5ffb-46e8-9d26-58c28d72fafb None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:17.870328 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7370f-011a-4129-99c8-43a462ea2d67 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:17.874723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 224/460] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:17.879692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354bae5-b025-4962-9a90-73b16065a785 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:17.879979 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354bae5-b025-4962-9a90-73b16065a785 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:17.880346 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354bae5-b025-4962-9a90-73b16065a785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:17.904858 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a769f82-9fc1-4048-a064-71e256a278b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:17.906010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a769f82-9fc1-4048-a064-71e256a278b0 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:17.906494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a769f82-9fc1-4048-a064-71e256a278b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:17.907066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a769f82-9fc1-4048-a064-71e256a278b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:17.909193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-c354bae5-b025-4962-9a90-73b16065a785 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:17.910397 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c354bae5-b025-4962-9a90-73b16065a785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:17.919758 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a769f82-9fc1-4048-a064-71e256a278b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:17.921551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a769f82-9fc1-4048-a064-71e256a278b0 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-7a769f82-9fc1-4048-a064-71e256a278b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:17.942592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:17.943484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:17.945509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:17.945509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:17.945509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:17.945509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:17.945509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 237/461] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:17.945509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a769f82-9fc1-4048-a064-71e256a278b0 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:17.986646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 225/462] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:58:17.987874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354bae5-b025-4962-9a90-73b16065a785 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:18.053983 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a769f82-9fc1-4048-a064-71e256a278b0 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:18.091980 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d3eb2-4a79-44f5-aefe-a57c16a6b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:18.092820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d3eb2-4a79-44f5-aefe-a57c16a6b90e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.093098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d3eb2-4a79-44f5-aefe-a57c16a6b90e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.093369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d3eb2-4a79-44f5-aefe-a57c16a6b90e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.097545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354bae5-b025-4962-9a90-73b16065a785 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:18.103744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d3eb2-4a79-44f5-aefe-a57c16a6b90e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:18.105296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d3eb2-4a79-44f5-aefe-a57c16a6b90e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-b22d3eb2-4a79-44f5-aefe-a57c16a6b90e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:18.123209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:18.124050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:18.130105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:18.130105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:18.130105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:18.130105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:18.130105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 238/463] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:18.130105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d3eb2-4a79-44f5-aefe-a57c16a6b90e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:18.144339 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528ae2b-8ac6-4302-b48a-3607c2f7e2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:18.145501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528ae2b-8ac6-4302-b48a-3607c2f7e2b9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.146326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528ae2b-8ac6-4302-b48a-3607c2f7e2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.147063 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528ae2b-8ac6-4302-b48a-3607c2f7e2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.148771 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528ae2b-8ac6-4302-b48a-3607c2f7e2b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:18.149307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528ae2b-8ac6-4302-b48a-3607c2f7e2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:18.151087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528ae2b-8ac6-4302-b48a-3607c2f7e2b9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:18.165522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 226/464] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:18.166642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528ae2b-8ac6-4302-b48a-3607c2f7e2b9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:18.229626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d3eb2-4a79-44f5-aefe-a57c16a6b90e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:18.263847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a234-8fed-419e-8b9d-3ff44a9b9f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:18.264664 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a234-8fed-419e-8b9d-3ff44a9b9f2c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.264947 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a234-8fed-419e-8b9d-3ff44a9b9f2c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.265222 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a234-8fed-419e-8b9d-3ff44a9b9f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.266876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528ae2b-8ac6-4302-b48a-3607c2f7e2b9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:18.275016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431a234-8fed-419e-8b9d-3ff44a9b9f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:18.276496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431a234-8fed-419e-8b9d-3ff44a9b9f2c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-9431a234-8fed-419e-8b9d-3ff44a9b9f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:18.294130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:18.294986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:18.295802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:18.295802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:18.295802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:18.295802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:18.295802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 239/465] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:18.296596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a234-8fed-419e-8b9d-3ff44a9b9f2c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:18.304799 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f919c16-49cc-4bae-96a9-f141aab7def0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:18.305465 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919c16-49cc-4bae-96a9-f141aab7def0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.305748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919c16-49cc-4bae-96a9-f141aab7def0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.306025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919c16-49cc-4bae-96a9-f141aab7def0 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.306747 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f919c16-49cc-4bae-96a9-f141aab7def0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:18.307058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f919c16-49cc-4bae-96a9-f141aab7def0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:18.308451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f919c16-49cc-4bae-96a9-f141aab7def0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:18.320579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 227/466] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:18.326382 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308c240-6f40-4621-a9a4-8912a3fa9f49 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.326677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308c240-6f40-4621-a9a4-8912a3fa9f49 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.326958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308c240-6f40-4621-a9a4-8912a3fa9f49 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.332135 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 228/467] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:18.332135 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308c240-6f40-4621-a9a4-8912a3fa9f49 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:18.396155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a234-8fed-419e-8b9d-3ff44a9b9f2c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:18.425950 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308c240-6f40-4621-a9a4-8912a3fa9f49 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:18.428042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706b2e7-8aa8-4fae-b2dd-38542fca1aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:18.429267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706b2e7-8aa8-4fae-b2dd-38542fca1aab None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.429532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706b2e7-8aa8-4fae-b2dd-38542fca1aab None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.429802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706b2e7-8aa8-4fae-b2dd-38542fca1aab None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.430496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706b2e7-8aa8-4fae-b2dd-38542fca1aab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:18.431930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706b2e7-8aa8-4fae-b2dd-38542fca1aab None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:18.460331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 240/468] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:58:18 2022] POST /identity/v3/users => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:58:18.460331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706b2e7-8aa8-4fae-b2dd-38542fca1aab None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:18.472933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd9490-a4ea-402b-b273-7b0a713d3ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:18.474287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd9490-a4ea-402b-b273-7b0a713d3ec1 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.474577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd9490-a4ea-402b-b273-7b0a713d3ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.475241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd9490-a4ea-402b-b273-7b0a713d3ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.477109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd9490-a4ea-402b-b273-7b0a713d3ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:18.477423 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd9490-a4ea-402b-b273-7b0a713d3ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:18.479688 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd9490-a4ea-402b-b273-7b0a713d3ec1 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:18.497849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 229/469] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:18.499447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61f9eb-d19e-4231-8e05-6080246b882b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.499746 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61f9eb-d19e-4231-8e05-6080246b882b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.500021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61f9eb-d19e-4231-8e05-6080246b882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.524077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8f61f9eb-d19e-4231-8e05-6080246b882b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:18.525830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8f61f9eb-d19e-4231-8e05-6080246b882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:18.577717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706b2e7-8aa8-4fae-b2dd-38542fca1aab None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:18.607734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 230/470] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:18.609466 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61f9eb-d19e-4231-8e05-6080246b882b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:18.618240 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d15113-4e1e-4445-ae17-4333e2d07dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:18.619004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d15113-4e1e-4445-ae17-4333e2d07dd1 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.619382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d15113-4e1e-4445-ae17-4333e2d07dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.619730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d15113-4e1e-4445-ae17-4333e2d07dd1 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.620562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d15113-4e1e-4445-ae17-4333e2d07dd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:18.622788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d15113-4e1e-4445-ae17-4333e2d07dd1 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:18.663775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 241/471] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:58:18 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:58:18.664944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d15113-4e1e-4445-ae17-4333e2d07dd1 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:18.720405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61f9eb-d19e-4231-8e05-6080246b882b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:18.761572 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47d77e-852d-4e75-b460-61a464aa6913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:18.762257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47d77e-852d-4e75-b460-61a464aa6913 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.762543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47d77e-852d-4e75-b460-61a464aa6913 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.763051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47d77e-852d-4e75-b460-61a464aa6913 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.765340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47d77e-852d-4e75-b460-61a464aa6913 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:18.766852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47d77e-852d-4e75-b460-61a464aa6913 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:18.786251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d15113-4e1e-4445-ae17-4333e2d07dd1 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:18.794780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 231/472] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:58:18 2022] POST /identity/v3/users => generated 248 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:58:18.796190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82f527-800e-41e0-b072-7d9cf3ab9d4d None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.796749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82f527-800e-41e0-b072-7d9cf3ab9d4d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.796854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82f527-800e-41e0-b072-7d9cf3ab9d4d None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.798443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 232/473] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:18.805679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3fdea-fed4-4bb0-aabc-75d3c16229bc None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.805984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3fdea-fed4-4bb0-aabc-75d3c16229bc None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.806224 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3fdea-fed4-4bb0-aabc-75d3c16229bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.829398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-12e3fdea-fed4-4bb0-aabc-75d3c16229bc None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:18.830650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-12e3fdea-fed4-4bb0-aabc-75d3c16229bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:18.832938 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d906eb8-c256-491d-9409-15e3879a790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:18.833917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d906eb8-c256-491d-9409-15e3879a790e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:18.834260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d906eb8-c256-491d-9409-15e3879a790e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:18.834603 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d906eb8-c256-491d-9409-15e3879a790e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:18.847580 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d906eb8-c256-491d-9409-15e3879a790e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:18.849222 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d906eb8-c256-491d-9409-15e3879a790e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-0d906eb8-c256-491d-9409-15e3879a790e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:18.867682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:18.868666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:18.869843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:18.869843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:18.869843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:18.869843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:18.869843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 242/474] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:18.875179 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d906eb8-c256-491d-9409-15e3879a790e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:18.925757 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 233/475] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:18.948629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3fdea-fed4-4bb0-aabc-75d3c16229bc None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:18.985367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d906eb8-c256-491d-9409-15e3879a790e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:19.026588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a9085-ecb5-48b6-b95e-435f652f96a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:19.027252 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a9085-ecb5-48b6-b95e-435f652f96a1 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:19.027534 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a9085-ecb5-48b6-b95e-435f652f96a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:19.027809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a9085-ecb5-48b6-b95e-435f652f96a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:19.028653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a9085-ecb5-48b6-b95e-435f652f96a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:19.028962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a9085-ecb5-48b6-b95e-435f652f96a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:19.030339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a9085-ecb5-48b6-b95e-435f652f96a1 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:19.050294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 243/476] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:19.059158 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a9085-ecb5-48b6-b95e-435f652f96a1 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:19.072795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3fdea-fed4-4bb0-aabc-75d3c16229bc None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:19.110244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2fe06-f914-404c-9f9e-64ef5eeefc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:19.110910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2fe06-f914-404c-9f9e-64ef5eeefc95 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:19.111208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2fe06-f914-404c-9f9e-64ef5eeefc95 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:19.111837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2fe06-f914-404c-9f9e-64ef5eeefc95 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:19.112929 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2fe06-f914-404c-9f9e-64ef5eeefc95 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:19.114471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2fe06-f914-404c-9f9e-64ef5eeefc95 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:19.124801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.sql.core [None req-0ad2fe06-f914-404c-9f9e-64ef5eeefc95 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 08:58:19.124801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 08:58:19.124801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [parameters: {'id': 'de181798b91244208a2f1954a81f3ece', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 08:58:19.124801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79901) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-0ad2fe06-f914-404c-9f9e-64ef5eeefc95 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application result = self._query(query) May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application conn.query(q) May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application result.read() May 03 08:58:19.146507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return ref.to_dict() May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 08:58:19.147489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application next(self.gen) May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application yield resource May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application next(self.gen) May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self.session.rollback() May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self.force_reraise() May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise self.value May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application session.commit() May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 08:58:19.148412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._prepare_impl() May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self.session.flush() May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._flush(objects) May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application compat.raise_( May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application flush_context.execute() May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rec.execute(self) May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 08:58:19.149282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 08:58:19.150875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application result = self._query(query) May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application conn.query(q) May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application result.read() May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 08:58:19.151692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [parameters: {'id': 'de181798b91244208a2f1954a81f3ece', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:19.152481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 08:58:19.153282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:19.160518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 234/477] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 3 08:58:18 2022] POST /identity/v3/roles => generated 144 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:19.160518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2fe06-f914-404c-9f9e-64ef5eeefc95 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:19.176906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a9085-ecb5-48b6-b95e-435f652f96a1 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:19.234338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbac9f-6e2d-4e7f-bf8f-e35e5c73fd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:19.235519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbac9f-6e2d-4e7f-bf8f-e35e5c73fd9c None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:19.236355 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbac9f-6e2d-4e7f-bf8f-e35e5c73fd9c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:19.236838 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbac9f-6e2d-4e7f-bf8f-e35e5c73fd9c None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:19.237761 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbac9f-6e2d-4e7f-bf8f-e35e5c73fd9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:19.239975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbac9f-6e2d-4e7f-bf8f-e35e5c73fd9c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:19.266345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 244/478] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:58:19 2022] POST /identity/v3/users => generated 249 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:58:19.297298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2fe06-f914-404c-9f9e-64ef5eeefc95 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:19.337641 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd833e80-e4da-463c-9787-6ccc9be8ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:19.338824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd833e80-e4da-463c-9787-6ccc9be8ccbf None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:19.339329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd833e80-e4da-463c-9787-6ccc9be8ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:19.339800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd833e80-e4da-463c-9787-6ccc9be8ccbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:19.353260 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd833e80-e4da-463c-9787-6ccc9be8ccbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-cd833e80-e4da-463c-9787-6ccc9be8ccbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:19.362256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:19.363204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:19.364032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:19.364032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:19.364032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:19.364032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:19.364032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:19.364032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:19.364032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:19.364032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:19.364032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:19.364032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:19.364032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 08:58:19.364032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:19.367556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 235/479] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:58:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:19.373694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbac9f-6e2d-4e7f-bf8f-e35e5c73fd9c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:19.501935 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbac9f-6e2d-4e7f-bf8f-e35e5c73fd9c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:19.545213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ca035-1895-4f81-a75f-dc29ad961f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:19.545881 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ca035-1895-4f81-a75f-dc29ad961f4d None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:19.546156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ca035-1895-4f81-a75f-dc29ad961f4d None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:19.546424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ca035-1895-4f81-a75f-dc29ad961f4d None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:19.547163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ca035-1895-4f81-a75f-dc29ad961f4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:19.547463 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ca035-1895-4f81-a75f-dc29ad961f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:19.548824 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ca035-1895-4f81-a75f-dc29ad961f4d None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:19.559920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 245/480] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:21.373449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74579f48-725b-4d4a-80f9-f07177e5af0b None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:21.374433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74579f48-725b-4d4a-80f9-f07177e5af0b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:21.374918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74579f48-725b-4d4a-80f9-f07177e5af0b None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:21.376769 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 236/481] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:21.382493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07560a22-e87f-4ef3-860d-e306b992a4a0 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:21.382927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07560a22-e87f-4ef3-860d-e306b992a4a0 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:21.383100 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07560a22-e87f-4ef3-860d-e306b992a4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:21.406335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-07560a22-e87f-4ef3-860d-e306b992a4a0 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:21.407534 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-07560a22-e87f-4ef3-860d-e306b992a4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:21.490814 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 246/482] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:21.527164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74579f48-725b-4d4a-80f9-f07177e5af0b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:21.658733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74579f48-725b-4d4a-80f9-f07177e5af0b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:21.692469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6658b4-f1df-47e8-861f-4e528c7fa050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:21.693638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6658b4-f1df-47e8-861f-4e528c7fa050 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:21.694656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6658b4-f1df-47e8-861f-4e528c7fa050 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:21.695156 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6658b4-f1df-47e8-861f-4e528c7fa050 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:21.706195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6658b4-f1df-47e8-861f-4e528c7fa050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-0e6658b4-f1df-47e8-861f-4e528c7fa050 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:21.714939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:21.715826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:21.716660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:21.716660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:21.716660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:21.716660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:21.716660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:21.716660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:21.716660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:21.716660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:21.716660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:21.716660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:21.716660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:21.716660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:21.719375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 237/483] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:21.725537 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07560a22-e87f-4ef3-860d-e306b992a4a0 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:21.786046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cc5b5-be6c-4a7a-9d64-ee256a63f7c4 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:21.786680 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cc5b5-be6c-4a7a-9d64-ee256a63f7c4 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:21.787159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cc5b5-be6c-4a7a-9d64-ee256a63f7c4 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:21.788856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 238/484] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:58:21.808386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3500500-09d5-408f-a763-572b7eff5203 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:21.808975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3500500-09d5-408f-a763-572b7eff5203 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:21.809456 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3500500-09d5-408f-a763-572b7eff5203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:21.827842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-b3500500-09d5-408f-a763-572b7eff5203 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:21.829378 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b3500500-09d5-408f-a763-572b7eff5203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:21.850469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07560a22-e87f-4ef3-860d-e306b992a4a0 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:21.884379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec16206-11bf-4445-a73c-2f14df4af65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:21.885050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16206-11bf-4445-a73c-2f14df4af65f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:21.885335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16206-11bf-4445-a73c-2f14df4af65f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:21.885612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16206-11bf-4445-a73c-2f14df4af65f None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:21.886522 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec16206-11bf-4445-a73c-2f14df4af65f None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:21.886702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec16206-11bf-4445-a73c-2f14df4af65f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:21.888039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec16206-11bf-4445-a73c-2f14df4af65f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:21.900896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 247/485] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:21.900896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd152f5-4869-42e2-83bc-642e09a81a12 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:21.900896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd152f5-4869-42e2-83bc-642e09a81a12 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:21.900896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd152f5-4869-42e2-83bc-642e09a81a12 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:21.900896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 248/486] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:21.902061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd152f5-4869-42e2-83bc-642e09a81a12 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:21.907007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 239/487] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:21.908646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5f4c4-d7b3-483c-953e-a5ecc3db4a47 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:21.909089 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5f4c4-d7b3-483c-953e-a5ecc3db4a47 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:21.909491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5f4c4-d7b3-483c-953e-a5ecc3db4a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:21.927795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-cbc5f4c4-d7b3-483c-953e-a5ecc3db4a47 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:21.929378 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-cbc5f4c4-d7b3-483c-953e-a5ecc3db4a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:21.997921 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 240/488] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:21.999214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5f4c4-d7b3-483c-953e-a5ecc3db4a47 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:22.027245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd152f5-4869-42e2-83bc-642e09a81a12 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:22.063672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbcb52-2369-45c1-9c4a-15f2ef219e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:22.064467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbcb52-2369-45c1-9c4a-15f2ef219e7e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.064754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbcb52-2369-45c1-9c4a-15f2ef219e7e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.065032 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbcb52-2369-45c1-9c4a-15f2ef219e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.077472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbcb52-2369-45c1-9c4a-15f2ef219e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:22.078964 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbcb52-2369-45c1-9c4a-15f2ef219e7e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-23fbcb52-2369-45c1-9c4a-15f2ef219e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:22.101033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:22.102002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:22.102879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:22.102879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:22.102879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:22.102879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:22.106687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 249/489] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:22.107586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbcb52-2369-45c1-9c4a-15f2ef219e7e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:22.121728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5f4c4-d7b3-483c-953e-a5ecc3db4a47 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:22.158948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc9d11-d5c4-4e9b-8735-50a59b9e2d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:22.160155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc9d11-d5c4-4e9b-8735-50a59b9e2d1a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.160640 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc9d11-d5c4-4e9b-8735-50a59b9e2d1a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.161112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc9d11-d5c4-4e9b-8735-50a59b9e2d1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.171655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc9d11-d5c4-4e9b-8735-50a59b9e2d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-e6fc9d11-d5c4-4e9b-8735-50a59b9e2d1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:22.180411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:22.181276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:22.182155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:22.182155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:22.182155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:22.182155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:22.182155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:22.182155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:22.182155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:22.182155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:22.182155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:22.182155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:22.182155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:22.182155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:22.184961 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 241/490] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:22.185949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc9d11-d5c4-4e9b-8735-50a59b9e2d1a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:22.218199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbcb52-2369-45c1-9c4a-15f2ef219e7e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:22.252153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6b59e-4b31-470e-8fad-fa9a0b92f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:22.252957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6b59e-4b31-470e-8fad-fa9a0b92f432 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.253238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6b59e-4b31-470e-8fad-fa9a0b92f432 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.253584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6b59e-4b31-470e-8fad-fa9a0b92f432 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.263979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6b59e-4b31-470e-8fad-fa9a0b92f432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-e4e6b59e-4b31-470e-8fad-fa9a0b92f432 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:22.271710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:22.272662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:22.273454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 250/491] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:22.274762 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6b59e-4b31-470e-8fad-fa9a0b92f432 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:22.294025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc9d11-d5c4-4e9b-8735-50a59b9e2d1a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:22.326727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155c0de-8783-42aa-ab82-aa263b73f5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:22.327307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155c0de-8783-42aa-ab82-aa263b73f5fc None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.327591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155c0de-8783-42aa-ab82-aa263b73f5fc None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.327862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155c0de-8783-42aa-ab82-aa263b73f5fc None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.328610 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155c0de-8783-42aa-ab82-aa263b73f5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:22.328918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155c0de-8783-42aa-ab82-aa263b73f5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:22.330300 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155c0de-8783-42aa-ab82-aa263b73f5fc None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:22.341457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 242/492] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:22.342642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345ff9d-b6d4-4a5c-8c66-359cf658664e None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.342924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345ff9d-b6d4-4a5c-8c66-359cf658664e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.343199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345ff9d-b6d4-4a5c-8c66-359cf658664e None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.344561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 243/493] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:22.345108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345ff9d-b6d4-4a5c-8c66-359cf658664e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:22.369188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6b59e-4b31-470e-8fad-fa9a0b92f432 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:22.401003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0acea-24b3-4ddd-b17d-f47993c52b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:22.401672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0acea-24b3-4ddd-b17d-f47993c52b06 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.401954 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0acea-24b3-4ddd-b17d-f47993c52b06 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.402235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0acea-24b3-4ddd-b17d-f47993c52b06 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.402972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0acea-24b3-4ddd-b17d-f47993c52b06 None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:22.403277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0acea-24b3-4ddd-b17d-f47993c52b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:22.404677 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0acea-24b3-4ddd-b17d-f47993c52b06 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:22.412608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 251/494] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:22.414476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d0008-42cd-45dd-87c0-fc9c21a6eecb None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.414758 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d0008-42cd-45dd-87c0-fc9c21a6eecb None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.415028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d0008-42cd-45dd-87c0-fc9c21a6eecb None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.416263 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 252/495] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:22.416945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d0008-42cd-45dd-87c0-fc9c21a6eecb None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:22.451449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345ff9d-b6d4-4a5c-8c66-359cf658664e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:22.483030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004dd4b-d33a-4b0f-8893-d7f453913a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:22.483675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004dd4b-d33a-4b0f-8893-d7f453913a4d None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.483958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004dd4b-d33a-4b0f-8893-d7f453913a4d None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.484264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004dd4b-d33a-4b0f-8893-d7f453913a4d None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.485008 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004dd4b-d33a-4b0f-8893-d7f453913a4d None admin] RBAC: Adding query filter params (name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:22.485310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004dd4b-d33a-4b0f-8893-d7f453913a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:22.486679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004dd4b-d33a-4b0f-8893-d7f453913a4d None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:22.494923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 244/496] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:22.496110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9498b84-d843-4557-a66a-5cad2e91716f None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.496399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9498b84-d843-4557-a66a-5cad2e91716f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.496671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9498b84-d843-4557-a66a-5cad2e91716f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.512270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-d9498b84-d843-4557-a66a-5cad2e91716f None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:22.513435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d9498b84-d843-4557-a66a-5cad2e91716f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:22.513562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d0008-42cd-45dd-87c0-fc9c21a6eecb None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:22.544285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b289a-1e35-42ad-b651-2b73f77d59a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:22.545048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b289a-1e35-42ad-b651-2b73f77d59a2 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.545324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b289a-1e35-42ad-b651-2b73f77d59a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.545590 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b289a-1e35-42ad-b651-2b73f77d59a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.553348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b289a-1e35-42ad-b651-2b73f77d59a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:22.555364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b289a-1e35-42ad-b651-2b73f77d59a2 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-de2b289a-1e35-42ad-b651-2b73f77d59a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:22.569955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:22.570992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:22.571930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:22.571930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:22.571930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:22.571930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:22.571930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:22.571930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:22.571930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:22.571930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:22.571930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:58:22.571930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:22.571930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 253/497] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 08:58:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:22.571930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b289a-1e35-42ad-b651-2b73f77d59a2 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:22.580487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 245/498] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:22.581675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a857e-9760-4a5e-a5c2-f353db0cd7fb None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.581962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a857e-9760-4a5e-a5c2-f353db0cd7fb None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.582237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a857e-9760-4a5e-a5c2-f353db0cd7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.597949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-687a857e-9760-4a5e-a5c2-f353db0cd7fb None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:22.599355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-687a857e-9760-4a5e-a5c2-f353db0cd7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:22.661793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 246/499] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:22.662605 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a857e-9760-4a5e-a5c2-f353db0cd7fb None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:22.668406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b289a-1e35-42ad-b651-2b73f77d59a2 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:22.702272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a93730-6b4a-4f3f-a2b4-bc0976876b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:22.703065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a93730-6b4a-4f3f-a2b4-bc0976876b6f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.703346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a93730-6b4a-4f3f-a2b4-bc0976876b6f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.703615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a93730-6b4a-4f3f-a2b4-bc0976876b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.714433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a93730-6b4a-4f3f-a2b4-bc0976876b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:22.715882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a93730-6b4a-4f3f-a2b4-bc0976876b6f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-97a93730-6b4a-4f3f-a2b4-bc0976876b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:22.733033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:22.733953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:22.734875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:22.734875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:22.734875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:22.734875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:22.734875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 254/500] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:22.735139 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a93730-6b4a-4f3f-a2b4-bc0976876b6f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:22.774983 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a857e-9760-4a5e-a5c2-f353db0cd7fb None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:22.806729 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b3ecc-137a-40a4-998f-b00759ce39ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:22.807509 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b3ecc-137a-40a4-998f-b00759ce39ef None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.807788 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b3ecc-137a-40a4-998f-b00759ce39ef None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.808061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b3ecc-137a-40a4-998f-b00759ce39ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.817537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b3ecc-137a-40a4-998f-b00759ce39ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:22.818971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b3ecc-137a-40a4-998f-b00759ce39ef None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:22.826639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a93730-6b4a-4f3f-a2b4-bc0976876b6f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-e96b3ecc-137a-40a4-998f-b00759ce39ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:22.837550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:22.838393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:22.839247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:22.839247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:22.839247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:22.839247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:22.839247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 247/501] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:22.839502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b3ecc-137a-40a4-998f-b00759ce39ef None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:22.858000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76184b98-4658-41d5-81ba-9029d0ab92dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:22.858652 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76184b98-4658-41d5-81ba-9029d0ab92dc None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.858930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76184b98-4658-41d5-81ba-9029d0ab92dc None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.859201 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76184b98-4658-41d5-81ba-9029d0ab92dc None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.860024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76184b98-4658-41d5-81ba-9029d0ab92dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:22.860363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76184b98-4658-41d5-81ba-9029d0ab92dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:22.861754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76184b98-4658-41d5-81ba-9029d0ab92dc None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:22.896449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 255/502] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 08:58:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:22.897763 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76184b98-4658-41d5-81ba-9029d0ab92dc None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:22.933480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b3ecc-137a-40a4-998f-b00759ce39ef None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:22.964861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2b172-58f5-4725-825b-8ef279702f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:22.965637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2b172-58f5-4725-825b-8ef279702f3f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:22.965919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2b172-58f5-4725-825b-8ef279702f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:22.966193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2b172-58f5-4725-825b-8ef279702f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:22.976687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2b172-58f5-4725-825b-8ef279702f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:22.978125 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2b172-58f5-4725-825b-8ef279702f3f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:22.987598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76184b98-4658-41d5-81ba-9029d0ab92dc None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-74b2b172-58f5-4725-825b-8ef279702f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:22.994549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:22.995434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:22.996302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:22.996302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:22.996302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:22.996302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:22.996302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 248/503] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:22.996588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2b172-58f5-4725-825b-8ef279702f3f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:23.020428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74ad4d-07c8-481e-9814-662efe78fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:23.021241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74ad4d-07c8-481e-9814-662efe78fe55 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:23.021527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74ad4d-07c8-481e-9814-662efe78fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:23.021786 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74ad4d-07c8-481e-9814-662efe78fe55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:23.032338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74ad4d-07c8-481e-9814-662efe78fe55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-3f74ad4d-07c8-481e-9814-662efe78fe55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:23.040715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:23.042180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 256/504] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:23.043131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74ad4d-07c8-481e-9814-662efe78fe55 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:23.098087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2b172-58f5-4725-825b-8ef279702f3f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:23.129530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aad87-1192-4492-8db0-58eff43e5d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:23.130263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aad87-1192-4492-8db0-58eff43e5d1d None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:23.130603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aad87-1192-4492-8db0-58eff43e5d1d None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:23.130939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aad87-1192-4492-8db0-58eff43e5d1d None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:23.132277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1aad87-1192-4492-8db0-58eff43e5d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:23.132577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1aad87-1192-4492-8db0-58eff43e5d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:23.133943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1aad87-1192-4492-8db0-58eff43e5d1d None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:23.135255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74ad4d-07c8-481e-9814-662efe78fe55 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:23.145155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 249/505] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:23.145751 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aad87-1192-4492-8db0-58eff43e5d1d None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:23.166858 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a92f3a-07bf-4d32-be79-9f5c485cc09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:23.167502 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a92f3a-07bf-4d32-be79-9f5c485cc09c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:23.167782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a92f3a-07bf-4d32-be79-9f5c485cc09c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:23.168053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a92f3a-07bf-4d32-be79-9f5c485cc09c None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:23.168793 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a92f3a-07bf-4d32-be79-9f5c485cc09c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:23.169101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a92f3a-07bf-4d32-be79-9f5c485cc09c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:23.170466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a92f3a-07bf-4d32-be79-9f5c485cc09c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:23.182682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 257/506] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:23.183463 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a92f3a-07bf-4d32-be79-9f5c485cc09c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:23.243971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aad87-1192-4492-8db0-58eff43e5d1d None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:23.275816 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035562a-bdd5-415b-8eb9-e04a0bcdbb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:23.275969 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a92f3a-07bf-4d32-be79-9f5c485cc09c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:23.276490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035562a-bdd5-415b-8eb9-e04a0bcdbb4f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:23.276770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035562a-bdd5-415b-8eb9-e04a0bcdbb4f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:23.277047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035562a-bdd5-415b-8eb9-e04a0bcdbb4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:23.306626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082fa58-abb4-4053-9422-2346b5e9e82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:23.307272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082fa58-abb4-4053-9422-2346b5e9e82f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:23.307552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082fa58-abb4-4053-9422-2346b5e9e82f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:23.307825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082fa58-abb4-4053-9422-2346b5e9e82f None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:23.308575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082fa58-abb4-4053-9422-2346b5e9e82f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:23.308880 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082fa58-abb4-4053-9422-2346b5e9e82f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:23.310248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082fa58-abb4-4053-9422-2346b5e9e82f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:23.324398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 258/507] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:23.324398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082fa58-abb4-4053-9422-2346b5e9e82f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:23.346051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035562a-bdd5-415b-8eb9-e04a0bcdbb4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:23.347494 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035562a-bdd5-415b-8eb9-e04a0bcdbb4f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:23.415957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082fa58-abb4-4053-9422-2346b5e9e82f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:23.437567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 250/508] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:23.438385 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035562a-bdd5-415b-8eb9-e04a0bcdbb4f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:23.446783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f49e66-3081-4542-8c08-7c7d896f2a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:23.447437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49e66-3081-4542-8c08-7c7d896f2a89 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:23.447713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49e66-3081-4542-8c08-7c7d896f2a89 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:23.447978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49e66-3081-4542-8c08-7c7d896f2a89 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:23.448754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49e66-3081-4542-8c08-7c7d896f2a89 None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:23.449052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49e66-3081-4542-8c08-7c7d896f2a89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:23.450648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49e66-3081-4542-8c08-7c7d896f2a89 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:23.458239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 259/509] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:23.458848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f49e66-3081-4542-8c08-7c7d896f2a89 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:23.531261 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035562a-bdd5-415b-8eb9-e04a0bcdbb4f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:23.550077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f49e66-3081-4542-8c08-7c7d896f2a89 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:23.562540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40578d-c7bc-48a2-8fec-e76b17ec20c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:23.563319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40578d-c7bc-48a2-8fec-e76b17ec20c3 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:23.563601 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40578d-c7bc-48a2-8fec-e76b17ec20c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:23.563871 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40578d-c7bc-48a2-8fec-e76b17ec20c3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:23.571097 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40578d-c7bc-48a2-8fec-e76b17ec20c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:23.572546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40578d-c7bc-48a2-8fec-e76b17ec20c3 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:23.581977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f0d41-652f-4b20-9201-938ab6d24ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:23.582762 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f0d41-652f-4b20-9201-938ab6d24ac9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:23.583040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f0d41-652f-4b20-9201-938ab6d24ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:23.583311 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f0d41-652f-4b20-9201-938ab6d24ac9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-5e40578d-c7bc-48a2-8fec-e76b17ec20c3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:23.588025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:23.589106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:23.589978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:23.589978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:23.589978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:23.589978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:23.589978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:23.589978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:23.589978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:23.589978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:23.589978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 08:58:23.589978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:23.589978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 251/510] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:23.589978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40578d-c7bc-48a2-8fec-e76b17ec20c3 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:23.590598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f0d41-652f-4b20-9201-938ab6d24ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:23.591976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f0d41-652f-4b20-9201-938ab6d24ac9 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-bd2f0d41-652f-4b20-9201-938ab6d24ac9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:23.606249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:23.607117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:23.607979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:23.607979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:23.607979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:23.607979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:23.607979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:23.607979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:23.607979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:23.607979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:23.607979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:58:23.607979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:23.607979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 260/511] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:23.609204 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f0d41-652f-4b20-9201-938ab6d24ac9 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:23.683271 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40578d-c7bc-48a2-8fec-e76b17ec20c3 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:23.701973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f0d41-652f-4b20-9201-938ab6d24ac9 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:23.714945 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45b047-437d-4ed1-9f96-d37f89336e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:23.715600 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45b047-437d-4ed1-9f96-d37f89336e74 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:23.715879 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45b047-437d-4ed1-9f96-d37f89336e74 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:23.716178 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45b047-437d-4ed1-9f96-d37f89336e74 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:23.716882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45b047-437d-4ed1-9f96-d37f89336e74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:23.718721 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45b047-437d-4ed1-9f96-d37f89336e74 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:23.732682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf91951-1166-497b-90c7-c90a2ff5be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:23.733641 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf91951-1166-497b-90c7-c90a2ff5be3b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:23.733996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf91951-1166-497b-90c7-c90a2ff5be3b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:23.734279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf91951-1166-497b-90c7-c90a2ff5be3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:23.737256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 252/512] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:58:23 2022] POST /identity/v3/users => generated 247 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:58:23.738096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45b047-437d-4ed1-9f96-d37f89336e74 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:23.745501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf91951-1166-497b-90c7-c90a2ff5be3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:23.747292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf91951-1166-497b-90c7-c90a2ff5be3b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-abf91951-1166-497b-90c7-c90a2ff5be3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:23.766922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:23.768043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:23.773905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:23.773905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:23.773905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:23.773905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:23.773905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 261/513] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:23.773905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf91951-1166-497b-90c7-c90a2ff5be3b None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:23.856384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45b047-437d-4ed1-9f96-d37f89336e74 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:23.876770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf91951-1166-497b-90c7-c90a2ff5be3b None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:23.891236 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8521f8-2254-4898-bd89-78b3f933af72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:23.892155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8521f8-2254-4898-bd89-78b3f933af72 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:23.892500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8521f8-2254-4898-bd89-78b3f933af72 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:23.892844 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8521f8-2254-4898-bd89-78b3f933af72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:23.904239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8521f8-2254-4898-bd89-78b3f933af72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:23.905838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8521f8-2254-4898-bd89-78b3f933af72 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:23.911637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec397-86b9-4277-932a-71178db2345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:23.912610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec397-86b9-4277-932a-71178db2345f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:23.913991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec397-86b9-4277-932a-71178db2345f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:23.914418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec397-86b9-4277-932a-71178db2345f None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:23.915794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ec397-86b9-4277-932a-71178db2345f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:23.916283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ec397-86b9-4277-932a-71178db2345f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:23.917732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ec397-86b9-4277-932a-71178db2345f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-bf8521f8-2254-4898-bd89-78b3f933af72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:23.924587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:23.925598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:23.926649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:23.926649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:23.926649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:23.926649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:23.928185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 253/514] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:23.929660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8521f8-2254-4898-bd89-78b3f933af72 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:23.936948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 262/515] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 3 08:58:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:23.937711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec397-86b9-4277-932a-71178db2345f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:24.037361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec397-86b9-4277-932a-71178db2345f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:24.042741 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8521f8-2254-4898-bd89-78b3f933af72 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:24.072227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1aa337-2677-49fd-bd00-995c9f4ba9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:24.072980 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1aa337-2677-49fd-bd00-995c9f4ba9a8 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:24.073339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1aa337-2677-49fd-bd00-995c9f4ba9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:24.073614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1aa337-2677-49fd-bd00-995c9f4ba9a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:24.074330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1aa337-2677-49fd-bd00-995c9f4ba9a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:24.074637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1aa337-2677-49fd-bd00-995c9f4ba9a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:24.076281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1aa337-2677-49fd-bd00-995c9f4ba9a8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:24.078776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2bc1c-e024-493b-880e-3a00f755be58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:24.079592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2bc1c-e024-493b-880e-3a00f755be58 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:24.080009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2bc1c-e024-493b-880e-3a00f755be58 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:24.080469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2bc1c-e024-493b-880e-3a00f755be58 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:24.081432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2bc1c-e024-493b-880e-3a00f755be58 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:24.081874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2bc1c-e024-493b-880e-3a00f755be58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:24.083414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2bc1c-e024-493b-880e-3a00f755be58 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:24.089752 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 263/516] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:24.091875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1aa337-2677-49fd-bd00-995c9f4ba9a8 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:24.125250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 254/517] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 3 08:58:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:24.125250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2bc1c-e024-493b-880e-3a00f755be58 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:24.194131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1aa337-2677-49fd-bd00-995c9f4ba9a8 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:24.229542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2bc1c-e024-493b-880e-3a00f755be58 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:24.232522 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea027b7-fa80-4ba8-888c-caa5c773fb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:24.233179 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea027b7-fa80-4ba8-888c-caa5c773fb29 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:24.233456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea027b7-fa80-4ba8-888c-caa5c773fb29 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:24.233725 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea027b7-fa80-4ba8-888c-caa5c773fb29 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:24.234432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea027b7-fa80-4ba8-888c-caa5c773fb29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:24.234730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea027b7-fa80-4ba8-888c-caa5c773fb29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:24.236079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea027b7-fa80-4ba8-888c-caa5c773fb29 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:24.247102 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 264/518] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:24.247870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea027b7-fa80-4ba8-888c-caa5c773fb29 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:24.266623 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437188d-a2d5-4aa5-85aa-ab07adda9438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:24.267268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437188d-a2d5-4aa5-85aa-ab07adda9438 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:24.267549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437188d-a2d5-4aa5-85aa-ab07adda9438 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:24.267824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437188d-a2d5-4aa5-85aa-ab07adda9438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:24.332402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437188d-a2d5-4aa5-85aa-ab07adda9438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:24.333862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437188d-a2d5-4aa5-85aa-ab07adda9438 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:24.345104 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea027b7-fa80-4ba8-888c-caa5c773fb29 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:24.377765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc91f06-0dc3-4721-9c91-3e4703f4fab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:24.378736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc91f06-0dc3-4721-9c91-3e4703f4fab3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:24.379152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc91f06-0dc3-4721-9c91-3e4703f4fab3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:24.379671 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc91f06-0dc3-4721-9c91-3e4703f4fab3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:24.386128 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc91f06-0dc3-4721-9c91-3e4703f4fab3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:24.387687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc91f06-0dc3-4721-9c91-3e4703f4fab3 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-bfc91f06-0dc3-4721-9c91-3e4703f4fab3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:24.402181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:24.403132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:24.404177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:24.404177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:24.404177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:24.404177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:24.404177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:24.404177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:24.404177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:24.404177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:24.405344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 265/519] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:24.406211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc91f06-0dc3-4721-9c91-3e4703f4fab3 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:24.427748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 255/520] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:24.428839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437188d-a2d5-4aa5-85aa-ab07adda9438 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:24.506035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc91f06-0dc3-4721-9c91-3e4703f4fab3 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:24.521990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437188d-a2d5-4aa5-85aa-ab07adda9438 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:24.538842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e2db5-3872-4594-a610-7e23d6db2505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:24.539492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e2db5-3872-4594-a610-7e23d6db2505 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:24.539776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e2db5-3872-4594-a610-7e23d6db2505 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:24.540050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e2db5-3872-4594-a610-7e23d6db2505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:24.555471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a57264-325c-432a-8653-f6176a1946be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:24.556284 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57264-325c-432a-8653-f6176a1946be None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:24.556561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57264-325c-432a-8653-f6176a1946be None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:24.556830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57264-325c-432a-8653-f6176a1946be None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:24.563786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a57264-325c-432a-8653-f6176a1946be None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:24.565284 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a57264-325c-432a-8653-f6176a1946be None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-17a57264-325c-432a-8653-f6176a1946be None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:24.580198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:24.581884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:24.582789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:24.582789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:24.582789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:24.582789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:24.582789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:24.582789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:24.582789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:24.582789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:24.582789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 08:58:24.582789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:24.582789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 256/521] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:24.582789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a57264-325c-432a-8653-f6176a1946be None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:24.606903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e2db5-3872-4594-a610-7e23d6db2505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:24.608708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e2db5-3872-4594-a610-7e23d6db2505 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:24.680928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a57264-325c-432a-8653-f6176a1946be None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:24.707264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 266/522] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:24.707264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e2db5-3872-4594-a610-7e23d6db2505 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:24.719790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d276c-1bef-4ed3-853d-d1caf23cb779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:24.720543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d276c-1bef-4ed3-853d-d1caf23cb779 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:24.720885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d276c-1bef-4ed3-853d-d1caf23cb779 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:24.721224 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d276c-1bef-4ed3-853d-d1caf23cb779 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:24.722072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d276c-1bef-4ed3-853d-d1caf23cb779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:24.722443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d276c-1bef-4ed3-853d-d1caf23cb779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:24.723925 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d276c-1bef-4ed3-853d-d1caf23cb779 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:24.745250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 257/523] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:24.745250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d276c-1bef-4ed3-853d-d1caf23cb779 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:24.796564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e2db5-3872-4594-a610-7e23d6db2505 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:24.829947 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251243-db92-4175-a7fc-b6ff29f1158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:24.830729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251243-db92-4175-a7fc-b6ff29f1158c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:24.831004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251243-db92-4175-a7fc-b6ff29f1158c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:24.831270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251243-db92-4175-a7fc-b6ff29f1158c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:24.841376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251243-db92-4175-a7fc-b6ff29f1158c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:24.842804 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251243-db92-4175-a7fc-b6ff29f1158c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:24.847078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d276c-1bef-4ed3-853d-d1caf23cb779 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-62251243-db92-4175-a7fc-b6ff29f1158c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:24.859834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:24.860889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:24.861916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:24.861916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:24.861916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:24.861916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:24.867122 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 267/524] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:24.867122 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251243-db92-4175-a7fc-b6ff29f1158c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:24.886338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86ba9a-7f4f-4729-a2cf-6deaad9ee01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:24.887173 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86ba9a-7f4f-4729-a2cf-6deaad9ee01a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:24.887759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86ba9a-7f4f-4729-a2cf-6deaad9ee01a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:24.888166 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86ba9a-7f4f-4729-a2cf-6deaad9ee01a None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:24.889105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86ba9a-7f4f-4729-a2cf-6deaad9ee01a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:24.889518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86ba9a-7f4f-4729-a2cf-6deaad9ee01a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:24.891035 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86ba9a-7f4f-4729-a2cf-6deaad9ee01a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:24.916994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 258/525] 10.222.0.23 () {56 vars in 1139 bytes} [Tue May 3 08:58:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:24.916994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86ba9a-7f4f-4729-a2cf-6deaad9ee01a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:24.961506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251243-db92-4175-a7fc-b6ff29f1158c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:24.994674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09e7ba-be28-4b8f-8091-e432054f6bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:24.995454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09e7ba-be28-4b8f-8091-e432054f6bb4 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:24.995733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09e7ba-be28-4b8f-8091-e432054f6bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:24.996004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09e7ba-be28-4b8f-8091-e432054f6bb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:25.005438 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09e7ba-be28-4b8f-8091-e432054f6bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:25.007469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09e7ba-be28-4b8f-8091-e432054f6bb4 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:25.011891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86ba9a-7f4f-4729-a2cf-6deaad9ee01a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-ad09e7ba-be28-4b8f-8091-e432054f6bb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:25.024937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:25.026060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:25.026895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:25.026895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:25.026895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:25.026895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:25.026895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 268/526] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:25.027444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09e7ba-be28-4b8f-8091-e432054f6bb4 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:25.048324 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4cd77-bdc7-49d3-baaa-6c94da163c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:25.048989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4cd77-bdc7-49d3-baaa-6c94da163c60 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:25.049337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4cd77-bdc7-49d3-baaa-6c94da163c60 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:25.049679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4cd77-bdc7-49d3-baaa-6c94da163c60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:25.050992 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4cd77-bdc7-49d3-baaa-6c94da163c60 None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=2b863628035e4767b08fb5efc5c80958) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:25.051636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4cd77-bdc7-49d3-baaa-6c94da163c60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:25.054171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4cd77-bdc7-49d3-baaa-6c94da163c60 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:25.068381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 259/527] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:24 2022] GET /identity/v3/role_assignments?user.id=2b863628035e4767b08fb5efc5c80958&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:25.068381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4cd77-bdc7-49d3-baaa-6c94da163c60 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:25.147543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09e7ba-be28-4b8f-8091-e432054f6bb4 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:25.180677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4cd77-bdc7-49d3-baaa-6c94da163c60 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:25.193231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fce6d-ac86-4f72-905d-f7b48f3961cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:25.194736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fce6d-ac86-4f72-905d-f7b48f3961cc None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:25.195087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fce6d-ac86-4f72-905d-f7b48f3961cc None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:25.195814 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fce6d-ac86-4f72-905d-f7b48f3961cc None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:25.196947 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fce6d-ac86-4f72-905d-f7b48f3961cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:25.197327 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fce6d-ac86-4f72-905d-f7b48f3961cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:25.199304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fce6d-ac86-4f72-905d-f7b48f3961cc None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:25.215427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 269/528] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:25.216413 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fce6d-ac86-4f72-905d-f7b48f3961cc None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:25.228243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f376a-14d1-43fc-9e73-aa9063397fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:25.229149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f376a-14d1-43fc-9e73-aa9063397fbf None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:25.229574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f376a-14d1-43fc-9e73-aa9063397fbf None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:25.229986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f376a-14d1-43fc-9e73-aa9063397fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:25.318177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f376a-14d1-43fc-9e73-aa9063397fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:25.320336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f376a-14d1-43fc-9e73-aa9063397fbf None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:25.329623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fce6d-ac86-4f72-905d-f7b48f3961cc None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:25.362927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adc5b-a05d-4ce7-9a16-e23f56e7bb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:25.363698 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adc5b-a05d-4ce7-9a16-e23f56e7bb03 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:25.364058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adc5b-a05d-4ce7-9a16-e23f56e7bb03 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:25.364472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adc5b-a05d-4ce7-9a16-e23f56e7bb03 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:25.365303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6adc5b-a05d-4ce7-9a16-e23f56e7bb03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:25.365712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6adc5b-a05d-4ce7-9a16-e23f56e7bb03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:25.367758 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6adc5b-a05d-4ce7-9a16-e23f56e7bb03 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:25.388561 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 270/529] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:25.389570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adc5b-a05d-4ce7-9a16-e23f56e7bb03 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:25.423891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 260/530] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:25.424901 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f376a-14d1-43fc-9e73-aa9063397fbf None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:25.495499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adc5b-a05d-4ce7-9a16-e23f56e7bb03 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:25.524916 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f376a-14d1-43fc-9e73-aa9063397fbf None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:25.532825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa7b26-b782-4bd0-acd3-e0fbfe6dcdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:25.536106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa7b26-b782-4bd0-acd3-e0fbfe6dcdbe None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:25.536106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa7b26-b782-4bd0-acd3-e0fbfe6dcdbe None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:25.536106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa7b26-b782-4bd0-acd3-e0fbfe6dcdbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:25.541580 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa7b26-b782-4bd0-acd3-e0fbfe6dcdbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:25.543013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa7b26-b782-4bd0-acd3-e0fbfe6dcdbe None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-ccaa7b26-b782-4bd0-acd3-e0fbfe6dcdbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:25.557058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:25.557900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:25.559425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:25.559425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:25.559425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:25.559425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:25.559425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:25.559425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:25.559425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:25.559425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:25.559425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 271/531] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:25.559425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa7b26-b782-4bd0-acd3-e0fbfe6dcdbe None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:25.566842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee40fdf-3410-4459-ab47-ea4dd78f2c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:25.567638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee40fdf-3410-4459-ab47-ea4dd78f2c10 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:25.567964 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee40fdf-3410-4459-ab47-ea4dd78f2c10 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:25.571203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee40fdf-3410-4459-ab47-ea4dd78f2c10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:25.581019 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee40fdf-3410-4459-ab47-ea4dd78f2c10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:25.583118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee40fdf-3410-4459-ab47-ea4dd78f2c10 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-bee40fdf-3410-4459-ab47-ea4dd78f2c10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:25.601723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:25.602754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:25.603690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:25.603690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:25.603690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:25.603690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:25.603690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:25.603690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:25.603690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:25.603690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:25.610061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 261/532] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:25.610061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee40fdf-3410-4459-ab47-ea4dd78f2c10 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:25.667754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa7b26-b782-4bd0-acd3-e0fbfe6dcdbe None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:25.701051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81147862-74ec-4be3-b1b4-848a5dd3ce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:25.702210 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81147862-74ec-4be3-b1b4-848a5dd3ce1f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:25.702684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81147862-74ec-4be3-b1b4-848a5dd3ce1f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:25.703174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81147862-74ec-4be3-b1b4-848a5dd3ce1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:25.706768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee40fdf-3410-4459-ab47-ea4dd78f2c10 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:25.714716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81147862-74ec-4be3-b1b4-848a5dd3ce1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:25.716413 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81147862-74ec-4be3-b1b4-848a5dd3ce1f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-81147862-74ec-4be3-b1b4-848a5dd3ce1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:25.734346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:25.735280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:25.736114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:25.736114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:25.736114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:25.736114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:25.742325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 272/533] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:25.742325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81147862-74ec-4be3-b1b4-848a5dd3ce1f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:25.745577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6db1b-8ab0-4179-a2f9-ce122b21a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:25.746932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6db1b-8ab0-4179-a2f9-ce122b21a311 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:25.746932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6db1b-8ab0-4179-a2f9-ce122b21a311 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:25.746932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6db1b-8ab0-4179-a2f9-ce122b21a311 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:25.747597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6db1b-8ab0-4179-a2f9-ce122b21a311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:25.747912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6db1b-8ab0-4179-a2f9-ce122b21a311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:25.749372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6db1b-8ab0-4179-a2f9-ce122b21a311 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:25.766982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 262/534] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:25.767895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6db1b-8ab0-4179-a2f9-ce122b21a311 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:25.843999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81147862-74ec-4be3-b1b4-848a5dd3ce1f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:25.877338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a5998-4d90-4e6b-a959-6d9b919388e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:25.878273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6db1b-8ab0-4179-a2f9-ce122b21a311 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:25.878653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a5998-4d90-4e6b-a959-6d9b919388e9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:25.879140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a5998-4d90-4e6b-a959-6d9b919388e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:25.879606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a5998-4d90-4e6b-a959-6d9b919388e9 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:25.880686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a5998-4d90-4e6b-a959-6d9b919388e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:25.881232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a5998-4d90-4e6b-a959-6d9b919388e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:25.883088 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a5998-4d90-4e6b-a959-6d9b919388e9 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:25.903399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 273/535] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:25.904525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a5998-4d90-4e6b-a959-6d9b919388e9 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:25.921443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee2ec2-ca12-4a40-8b01-68cc40cb0d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:25.922363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee2ec2-ca12-4a40-8b01-68cc40cb0d96 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:25.922660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee2ec2-ca12-4a40-8b01-68cc40cb0d96 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:25.923035 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee2ec2-ca12-4a40-8b01-68cc40cb0d96 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:25.923860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee2ec2-ca12-4a40-8b01-68cc40cb0d96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:25.924331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee2ec2-ca12-4a40-8b01-68cc40cb0d96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:25.925855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee2ec2-ca12-4a40-8b01-68cc40cb0d96 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:25.942691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 263/536] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:25.942691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee2ec2-ca12-4a40-8b01-68cc40cb0d96 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:26.009477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a5998-4d90-4e6b-a959-6d9b919388e9 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:26.043277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee202b-c707-45d8-b5fe-c7eb5e7b101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:26.044217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee202b-c707-45d8-b5fe-c7eb5e7b101c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:26.044635 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee202b-c707-45d8-b5fe-c7eb5e7b101c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:26.045047 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee202b-c707-45d8-b5fe-c7eb5e7b101c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:26.046021 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee202b-c707-45d8-b5fe-c7eb5e7b101c None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=1848679bce324613b4a92de808165ba8) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:26.046472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee202b-c707-45d8-b5fe-c7eb5e7b101c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:26.048031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee202b-c707-45d8-b5fe-c7eb5e7b101c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:26.054865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 274/537] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:25 2022] GET /identity/v3/role_assignments?user.id=1848679bce324613b4a92de808165ba8&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:26.055884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee202b-c707-45d8-b5fe-c7eb5e7b101c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:26.076850 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee2ec2-ca12-4a40-8b01-68cc40cb0d96 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:26.121995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd385c-4724-4b78-8e0f-55484ce52197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:26.122587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd385c-4724-4b78-8e0f-55484ce52197 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:26.122901 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd385c-4724-4b78-8e0f-55484ce52197 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:26.123171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd385c-4724-4b78-8e0f-55484ce52197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:26.124340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd385c-4724-4b78-8e0f-55484ce52197 None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=17e1e2dc0a0a45f4a36d1369edcc6e5b) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:26.124819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd385c-4724-4b78-8e0f-55484ce52197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:26.127059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd385c-4724-4b78-8e0f-55484ce52197 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:26.135309 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 264/538] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:25 2022] GET /identity/v3/role_assignments?user.id=17e1e2dc0a0a45f4a36d1369edcc6e5b&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:26.137221 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e1804-a943-4465-b70f-c6de31551aa5 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:26.137507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e1804-a943-4465-b70f-c6de31551aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:26.137781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e1804-a943-4465-b70f-c6de31551aa5 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:26.140233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 265/539] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:26.149936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f4fbd-98ab-4398-97de-af094b4fdb30 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:26.150274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f4fbd-98ab-4398-97de-af094b4fdb30 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:26.150544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f4fbd-98ab-4398-97de-af094b4fdb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:26.190544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5c9f4fbd-98ab-4398-97de-af094b4fdb30 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:26.191766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5c9f4fbd-98ab-4398-97de-af094b4fdb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:26.276728 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee202b-c707-45d8-b5fe-c7eb5e7b101c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:26.318340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bec891-9074-4558-869b-b24496dd8bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:26.319196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bec891-9074-4558-869b-b24496dd8bff None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:26.319471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bec891-9074-4558-869b-b24496dd8bff None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:26.319740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bec891-9074-4558-869b-b24496dd8bff None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:26.332811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bec891-9074-4558-869b-b24496dd8bff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:26.335786 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bec891-9074-4558-869b-b24496dd8bff None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:26.360790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 266/540] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-85bec891-9074-4558-869b-b24496dd8bff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:26.361849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:26.362660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:26.363868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:26.363868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:26.363868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:26.363868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:26.363868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:26.363868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:26.363868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:26.363868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:26.363868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 275/541] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:26.369204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f4fbd-98ab-4398-97de-af094b4fdb30 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:26.422358 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bec891-9074-4558-869b-b24496dd8bff None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:26.539473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f4fbd-98ab-4398-97de-af094b4fdb30 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:26.571810 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bec891-9074-4558-869b-b24496dd8bff None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:26.587921 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afdaf6-35f0-4530-9f7f-1a86f297e5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:26.588617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afdaf6-35f0-4530-9f7f-1a86f297e5ba None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:26.588903 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afdaf6-35f0-4530-9f7f-1a86f297e5ba None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:26.589179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afdaf6-35f0-4530-9f7f-1a86f297e5ba None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:26.589972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afdaf6-35f0-4530-9f7f-1a86f297e5ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:26.590282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afdaf6-35f0-4530-9f7f-1a86f297e5ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:26.591724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afdaf6-35f0-4530-9f7f-1a86f297e5ba None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:26.608737 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 267/542] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:26.613701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99608a5-edfc-4c01-91fc-aa9853d10162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:26.614276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afdaf6-35f0-4530-9f7f-1a86f297e5ba None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:26.614509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99608a5-edfc-4c01-91fc-aa9853d10162 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:26.614900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99608a5-edfc-4c01-91fc-aa9853d10162 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:26.615172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99608a5-edfc-4c01-91fc-aa9853d10162 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:26.632924 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99608a5-edfc-4c01-91fc-aa9853d10162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-f99608a5-edfc-4c01-91fc-aa9853d10162 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:26.648760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:26.650929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:26.652899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 276/543] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:26.656195 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99608a5-edfc-4c01-91fc-aa9853d10162 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:26.720150 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afdaf6-35f0-4530-9f7f-1a86f297e5ba None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:26.775195 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99608a5-edfc-4c01-91fc-aa9853d10162 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:26.781346 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c5729-4efc-46f2-aa03-f2cd72f90ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:26.782004 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c5729-4efc-46f2-aa03-f2cd72f90ebd None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:26.782290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c5729-4efc-46f2-aa03-f2cd72f90ebd None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:26.782565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c5729-4efc-46f2-aa03-f2cd72f90ebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:26.783397 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c5729-4efc-46f2-aa03-f2cd72f90ebd None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=418178b7e70f47d291e239a1297ccf0a) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:26.783708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c5729-4efc-46f2-aa03-f2cd72f90ebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:26.785155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c5729-4efc-46f2-aa03-f2cd72f90ebd None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:26.798405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 268/544] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:26 2022] GET /identity/v3/role_assignments?user.id=418178b7e70f47d291e239a1297ccf0a&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:26.815840 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d66ae-1f0b-4b0c-9fd6-d50086f7288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:26.816565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d66ae-1f0b-4b0c-9fd6-d50086f7288a None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:26.816847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d66ae-1f0b-4b0c-9fd6-d50086f7288a None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:26.817120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d66ae-1f0b-4b0c-9fd6-d50086f7288a None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:26.817882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d66ae-1f0b-4b0c-9fd6-d50086f7288a None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:26.818186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d66ae-1f0b-4b0c-9fd6-d50086f7288a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:26.819659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d66ae-1f0b-4b0c-9fd6-d50086f7288a None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:26.838594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 277/545] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:26.843931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c5729-4efc-46f2-aa03-f2cd72f90ebd None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:26.978886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c5729-4efc-46f2-aa03-f2cd72f90ebd None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:27.012997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd09df-5ac9-4401-a58d-5ecf00bc76d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:27.013791 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd09df-5ac9-4401-a58d-5ecf00bc76d2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:27.014093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd09df-5ac9-4401-a58d-5ecf00bc76d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:27.014343 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd09df-5ac9-4401-a58d-5ecf00bc76d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:27.025436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd09df-5ac9-4401-a58d-5ecf00bc76d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:27.026890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd09df-5ac9-4401-a58d-5ecf00bc76d2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-e4dd09df-5ac9-4401-a58d-5ecf00bc76d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:27.044863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:27.047038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:27.049109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:27.049109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:27.049109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:27.049109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:27.049109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 269/546] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:27.051895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d66ae-1f0b-4b0c-9fd6-d50086f7288a None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:27.191613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d66ae-1f0b-4b0c-9fd6-d50086f7288a None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:27.227794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389baf-3d3d-4f47-a10b-a8e319669768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:27.228494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389baf-3d3d-4f47-a10b-a8e319669768 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:27.228773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389baf-3d3d-4f47-a10b-a8e319669768 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:27.229097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389baf-3d3d-4f47-a10b-a8e319669768 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:27.229782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389baf-3d3d-4f47-a10b-a8e319669768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:27.230085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389baf-3d3d-4f47-a10b-a8e319669768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:27.231442 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389baf-3d3d-4f47-a10b-a8e319669768 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:27.243620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 278/547] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:27.249092 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd09df-5ac9-4401-a58d-5ecf00bc76d2 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:27.364416 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd09df-5ac9-4401-a58d-5ecf00bc76d2 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:27.406192 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa0e63-e358-4e59-b1cc-2530ccd4741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:27.410177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa0e63-e358-4e59-b1cc-2530ccd4741f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:27.410467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa0e63-e358-4e59-b1cc-2530ccd4741f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:27.410745 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa0e63-e358-4e59-b1cc-2530ccd4741f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:27.419646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa0e63-e358-4e59-b1cc-2530ccd4741f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:27.425182 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa0e63-e358-4e59-b1cc-2530ccd4741f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-40aa0e63-e358-4e59-b1cc-2530ccd4741f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:27.439685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:27.440622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:27.441474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:27.441474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:27.441474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:27.441474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:27.441474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:27.441474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:27.441474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:27.441474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:27.441474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 08:58:27.441474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:27.445500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 270/548] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:27.452341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389baf-3d3d-4f47-a10b-a8e319669768 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:27.627212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389baf-3d3d-4f47-a10b-a8e319669768 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:27.678895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee634f42-82c7-482e-ac72-6950d2d31a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:27.680380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee634f42-82c7-482e-ac72-6950d2d31a0d None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:27.680958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee634f42-82c7-482e-ac72-6950d2d31a0d None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:27.681454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee634f42-82c7-482e-ac72-6950d2d31a0d None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:27.682480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee634f42-82c7-482e-ac72-6950d2d31a0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:27.682977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee634f42-82c7-482e-ac72-6950d2d31a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:27.684623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee634f42-82c7-482e-ac72-6950d2d31a0d None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:27.709384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 279/549] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 3 08:58:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:27.715721 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa0e63-e358-4e59-b1cc-2530ccd4741f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:27.797317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cad0d7-7592-49c2-883c-be4f1f562ef3 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:27.797907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cad0d7-7592-49c2-883c-be4f1f562ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:27.798381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cad0d7-7592-49c2-883c-be4f1f562ef3 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:27.800212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 280/550] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:58:27.804807 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84437cf2-1323-44ce-b2f6-3e25053d9dae None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:27.805089 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84437cf2-1323-44ce-b2f6-3e25053d9dae None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:27.805360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84437cf2-1323-44ce-b2f6-3e25053d9dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:27.828516 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-84437cf2-1323-44ce-b2f6-3e25053d9dae None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:27.830321 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-84437cf2-1323-44ce-b2f6-3e25053d9dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:27.885225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa0e63-e358-4e59-b1cc-2530ccd4741f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:27.944787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7059eb-bc02-4d05-ad99-8baa26790cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:27.945433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7059eb-bc02-4d05-ad99-8baa26790cfd None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:27.945720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7059eb-bc02-4d05-ad99-8baa26790cfd None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:27.945994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7059eb-bc02-4d05-ad99-8baa26790cfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:27.952154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 281/551] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:58:27.986821 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84437cf2-1323-44ce-b2f6-3e25053d9dae None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:28.057808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7059eb-bc02-4d05-ad99-8baa26790cfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:28.059901 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7059eb-bc02-4d05-ad99-8baa26790cfd None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:28.164501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84437cf2-1323-44ce-b2f6-3e25053d9dae None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:28.237151 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12d812-e44f-4e3b-8697-ddef8d2fb775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:28.237961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12d812-e44f-4e3b-8697-ddef8d2fb775 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:28.238239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12d812-e44f-4e3b-8697-ddef8d2fb775 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:28.238510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12d812-e44f-4e3b-8697-ddef8d2fb775 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:28.241884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 271/552] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:28.247510 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7059eb-bc02-4d05-ad99-8baa26790cfd None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:28.266308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12d812-e44f-4e3b-8697-ddef8d2fb775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-4d12d812-e44f-4e3b-8697-ddef8d2fb775 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:28.275501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:28.276433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:28.277215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:28.277215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:28.277215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:28.277215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:28.277215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:28.277215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:28.277215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:28.277215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:28.277215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:28.277215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:28.277215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:28.277215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:28.282389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 282/553] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:28.285582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12d812-e44f-4e3b-8697-ddef8d2fb775 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:28.403996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7059eb-bc02-4d05-ad99-8baa26790cfd None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:28.461830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12d812-e44f-4e3b-8697-ddef8d2fb775 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:28.464395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442562c-25b9-4854-87ee-fd06be26409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:28.465189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442562c-25b9-4854-87ee-fd06be26409f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:28.465464 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442562c-25b9-4854-87ee-fd06be26409f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:28.465730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442562c-25b9-4854-87ee-fd06be26409f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:28.485894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442562c-25b9-4854-87ee-fd06be26409f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:28.487373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442562c-25b9-4854-87ee-fd06be26409f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-1442562c-25b9-4854-87ee-fd06be26409f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:28.519087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:28.521241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:28.523852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:28.523852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:28.523852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:28.523852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:28.523852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 272/554] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:28.533868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442562c-25b9-4854-87ee-fd06be26409f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:28.540481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c3dd7-a3a0-4f71-86d5-aa4e4a58dcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:28.541215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c3dd7-a3a0-4f71-86d5-aa4e4a58dcfb None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:28.541501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c3dd7-a3a0-4f71-86d5-aa4e4a58dcfb None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:28.541773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c3dd7-a3a0-4f71-86d5-aa4e4a58dcfb None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:28.542529 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c3dd7-a3a0-4f71-86d5-aa4e4a58dcfb None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:28.542837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c3dd7-a3a0-4f71-86d5-aa4e4a58dcfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:28.550696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c3dd7-a3a0-4f71-86d5-aa4e4a58dcfb None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:28.562736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 283/555] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:28.568380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c3dd7-a3a0-4f71-86d5-aa4e4a58dcfb None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:28.721071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442562c-25b9-4854-87ee-fd06be26409f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:28.732687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c3dd7-a3a0-4f71-86d5-aa4e4a58dcfb None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:28.759298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ed5a6-a429-40cb-9baf-e384b84bfb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:28.760360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ed5a6-a429-40cb-9baf-e384b84bfb16 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:28.760852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ed5a6-a429-40cb-9baf-e384b84bfb16 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:28.761330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ed5a6-a429-40cb-9baf-e384b84bfb16 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:28.762236 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ed5a6-a429-40cb-9baf-e384b84bfb16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:28.762743 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ed5a6-a429-40cb-9baf-e384b84bfb16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:28.764327 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ed5a6-a429-40cb-9baf-e384b84bfb16 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:28.774072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3fc55-f939-4226-994e-3d772c193017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:28.774877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3fc55-f939-4226-994e-3d772c193017 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:28.775160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3fc55-f939-4226-994e-3d772c193017 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:28.775436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3fc55-f939-4226-994e-3d772c193017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:28.777074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 273/556] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:28.778533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2287dc3-1c36-442a-933e-fb08ec9ebe63 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:28.779040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2287dc3-1c36-442a-933e-fb08ec9ebe63 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:28.779502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2287dc3-1c36-442a-933e-fb08ec9ebe63 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:28.781202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 274/557] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:28.786053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2287dc3-1c36-442a-933e-fb08ec9ebe63 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:28.795695 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3fc55-f939-4226-994e-3d772c193017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:28.797289 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3fc55-f939-4226-994e-3d772c193017 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-d9e3fc55-f939-4226-994e-3d772c193017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:28.814710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:28.815565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:28.816504 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:28.816504 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:28.816504 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:28.816504 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:28.816504 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 284/558] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:28.817412 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f7f00-7aa6-4f31-8ccd-7424319eeefe None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:28.817695 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f7f00-7aa6-4f31-8ccd-7424319eeefe None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:28.817969 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f7f00-7aa6-4f31-8ccd-7424319eeefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:28.836193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-2e5f7f00-7aa6-4f31-8ccd-7424319eeefe None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:28.837359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-2e5f7f00-7aa6-4f31-8ccd-7424319eeefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:28.887532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2287dc3-1c36-442a-933e-fb08ec9ebe63 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:28.901551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 285/559] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:28.903018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9b23c-49e4-4d13-a4da-64bbdde4c254 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:28.903308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9b23c-49e4-4d13-a4da-64bbdde4c254 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:28.903584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9b23c-49e4-4d13-a4da-64bbdde4c254 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:28.904857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 286/560] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:28.905531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9b23c-49e4-4d13-a4da-64bbdde4c254 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:28.933514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a0fc3-df9d-4456-8423-1b299fcac457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:28.934305 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0fc3-df9d-4456-8423-1b299fcac457 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:28.934578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0fc3-df9d-4456-8423-1b299fcac457 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:28.934850 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0fc3-df9d-4456-8423-1b299fcac457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:28.942145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a0fc3-df9d-4456-8423-1b299fcac457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:28.943586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a0fc3-df9d-4456-8423-1b299fcac457 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-a31a0fc3-df9d-4456-8423-1b299fcac457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:28.958719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:28.959624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:28.961143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:28.961143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:28.961143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:28.961143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:28.961143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:28.961143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:28.961143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:28.961143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:28.961143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 275/561] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:28.961620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8d039-bd06-4cfd-acb8-71f2caadfca2 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:28.961910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8d039-bd06-4cfd-acb8-71f2caadfca2 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:28.962190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8d039-bd06-4cfd-acb8-71f2caadfca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:28.979589 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a9f8d039-bd06-4cfd-acb8-71f2caadfca2 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:28.980730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a9f8d039-bd06-4cfd-acb8-71f2caadfca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:29.018979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9b23c-49e4-4d13-a4da-64bbdde4c254 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:29.056119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 276/562] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:29.056119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8d039-bd06-4cfd-acb8-71f2caadfca2 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:29.066690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77301931-ead4-444c-916b-6ed605793480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:29.067375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77301931-ead4-444c-916b-6ed605793480 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.067661 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77301931-ead4-444c-916b-6ed605793480 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.067937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77301931-ead4-444c-916b-6ed605793480 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.068759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77301931-ead4-444c-916b-6ed605793480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:29.069654 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77301931-ead4-444c-916b-6ed605793480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:29.071132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77301931-ead4-444c-916b-6ed605793480 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:29.089573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 287/563] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:29.089979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77301931-ead4-444c-916b-6ed605793480 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:29.155266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8d039-bd06-4cfd-acb8-71f2caadfca2 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:29.190478 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77301931-ead4-444c-916b-6ed605793480 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:29.192073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6fe83-5f63-4b5a-bcda-820214a5e578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:29.193624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6fe83-5f63-4b5a-bcda-820214a5e578 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.193936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6fe83-5f63-4b5a-bcda-820214a5e578 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.194215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6fe83-5f63-4b5a-bcda-820214a5e578 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.209137 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6fe83-5f63-4b5a-bcda-820214a5e578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-f6d6fe83-5f63-4b5a-bcda-820214a5e578 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:29.216956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:29.218357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 277/564] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:29.219919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6fe83-5f63-4b5a-bcda-820214a5e578 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:29.232421 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbaa2c-715b-4cfb-b979-7167065b3655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:29.233030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbaa2c-715b-4cfb-b979-7167065b3655 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.233319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbaa2c-715b-4cfb-b979-7167065b3655 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.233596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbaa2c-715b-4cfb-b979-7167065b3655 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.234399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbaa2c-715b-4cfb-b979-7167065b3655 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:29.234710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbaa2c-715b-4cfb-b979-7167065b3655 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:29.236203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbaa2c-715b-4cfb-b979-7167065b3655 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:29.249865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 288/565] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:29.256038 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbaa2c-715b-4cfb-b979-7167065b3655 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:29.323794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6fe83-5f63-4b5a-bcda-820214a5e578 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:29.355864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbaa2c-715b-4cfb-b979-7167065b3655 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:29.356849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ccd96-028d-4eb6-b979-3880113256e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:29.357634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ccd96-028d-4eb6-b979-3880113256e9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.357974 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ccd96-028d-4eb6-b979-3880113256e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.358244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ccd96-028d-4eb6-b979-3880113256e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.367999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ccd96-028d-4eb6-b979-3880113256e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-fe3ccd96-028d-4eb6-b979-3880113256e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:29.375730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:29.376734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 278/566] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:29.377733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ccd96-028d-4eb6-b979-3880113256e9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:29.395255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2907894-ce81-40c8-9662-8fe1ab970aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:29.396400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2907894-ce81-40c8-9662-8fe1ab970aa7 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.396826 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2907894-ce81-40c8-9662-8fe1ab970aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.397818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2907894-ce81-40c8-9662-8fe1ab970aa7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.405368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2907894-ce81-40c8-9662-8fe1ab970aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:29.406789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2907894-ce81-40c8-9662-8fe1ab970aa7 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-c2907894-ce81-40c8-9662-8fe1ab970aa7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:29.420828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:29.421801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:29.422709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:29.422709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:29.422709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:29.422709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:29.422709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:29.422709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:29.422709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:29.422709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:29.422709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:58:29.422709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:29.422709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 289/567] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 08:58:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:29.424182 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2907894-ce81-40c8-9662-8fe1ab970aa7 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:29.478108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ccd96-028d-4eb6-b979-3880113256e9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:29.509808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780ec2-105e-4661-85e5-d6fbc0f14f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:29.510454 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780ec2-105e-4661-85e5-d6fbc0f14f61 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.510730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780ec2-105e-4661-85e5-d6fbc0f14f61 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.510999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780ec2-105e-4661-85e5-d6fbc0f14f61 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.511730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b780ec2-105e-4661-85e5-d6fbc0f14f61 None admin] RBAC: Adding query filter params (name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:29.512030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b780ec2-105e-4661-85e5-d6fbc0f14f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:29.513412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b780ec2-105e-4661-85e5-d6fbc0f14f61 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:29.515973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2907894-ce81-40c8-9662-8fe1ab970aa7 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:29.520870 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 279/568] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:29.521630 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780ec2-105e-4661-85e5-d6fbc0f14f61 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:29.547457 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf08e4-712c-44ab-ba89-8f145e1a1144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:29.548127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf08e4-712c-44ab-ba89-8f145e1a1144 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.548409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf08e4-712c-44ab-ba89-8f145e1a1144 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.548685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf08e4-712c-44ab-ba89-8f145e1a1144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.549503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf08e4-712c-44ab-ba89-8f145e1a1144 None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=2360e3a110b042a8839c45aa50a39724) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:29.549813 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf08e4-712c-44ab-ba89-8f145e1a1144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:29.551226 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf08e4-712c-44ab-ba89-8f145e1a1144 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:29.556929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 290/569] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:29 2022] GET /identity/v3/role_assignments?user.id=2360e3a110b042a8839c45aa50a39724&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:29.558184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72797fa-13d4-4274-abbd-bd3f26f3b147 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.558474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72797fa-13d4-4274-abbd-bd3f26f3b147 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.558753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72797fa-13d4-4274-abbd-bd3f26f3b147 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.564128 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 291/570] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:29.564128 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72797fa-13d4-4274-abbd-bd3f26f3b147 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:29.619876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780ec2-105e-4661-85e5-d6fbc0f14f61 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:29.655602 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20362a72-a506-45f0-a36c-99724aa06d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:29.656294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20362a72-a506-45f0-a36c-99724aa06d8e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.656579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20362a72-a506-45f0-a36c-99724aa06d8e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.656839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20362a72-a506-45f0-a36c-99724aa06d8e None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.657605 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20362a72-a506-45f0-a36c-99724aa06d8e None admin] RBAC: Adding query filter params (name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:29.657905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20362a72-a506-45f0-a36c-99724aa06d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:29.659290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20362a72-a506-45f0-a36c-99724aa06d8e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:29.672460 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 280/571] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:29.672460 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20362a72-a506-45f0-a36c-99724aa06d8e None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:29.674748 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72797fa-13d4-4274-abbd-bd3f26f3b147 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:29.710387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11d8da-8e43-4fc6-ad8a-74bf3a879866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:29.711548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11d8da-8e43-4fc6-ad8a-74bf3a879866 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.712020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11d8da-8e43-4fc6-ad8a-74bf3a879866 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.712416 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11d8da-8e43-4fc6-ad8a-74bf3a879866 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.713822 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11d8da-8e43-4fc6-ad8a-74bf3a879866 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:29.713822 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11d8da-8e43-4fc6-ad8a-74bf3a879866 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:29.715346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11d8da-8e43-4fc6-ad8a-74bf3a879866 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:29.733444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 292/572] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 08:58:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:29.735505 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd15b-aae7-4c37-8e71-e98bbc9e9091 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.735818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd15b-aae7-4c37-8e71-e98bbc9e9091 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.736112 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd15b-aae7-4c37-8e71-e98bbc9e9091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.753909 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-85ecd15b-aae7-4c37-8e71-e98bbc9e9091 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:29.755097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-85ecd15b-aae7-4c37-8e71-e98bbc9e9091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:29.774905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20362a72-a506-45f0-a36c-99724aa06d8e None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:29.807673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e6295-0eb8-4af7-846c-182a7a0cd7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:29.808759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e6295-0eb8-4af7-846c-182a7a0cd7b0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.809217 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e6295-0eb8-4af7-846c-182a7a0cd7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.809675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e6295-0eb8-4af7-846c-182a7a0cd7b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.818435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 293/573] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:29.828703 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd15b-aae7-4c37-8e71-e98bbc9e9091 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:29.828882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e6295-0eb8-4af7-846c-182a7a0cd7b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:29.828882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e6295-0eb8-4af7-846c-182a7a0cd7b0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-d33e6295-0eb8-4af7-846c-182a7a0cd7b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:29.845984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:29.846927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:29.847793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:29.847793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:29.847793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:29.847793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:29.852397 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 281/574] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:29.853208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e6295-0eb8-4af7-846c-182a7a0cd7b0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:29.914821 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd15b-aae7-4c37-8e71-e98bbc9e9091 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:29.946588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82e529-cfa6-4007-a3f0-6a075b776714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:29.947369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e529-cfa6-4007-a3f0-6a075b776714 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.947642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e529-cfa6-4007-a3f0-6a075b776714 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.947905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e529-cfa6-4007-a3f0-6a075b776714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.948838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e6295-0eb8-4af7-846c-182a7a0cd7b0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:29.957779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82e529-cfa6-4007-a3f0-6a075b776714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:29.959208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82e529-cfa6-4007-a3f0-6a075b776714 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-db82e529-cfa6-4007-a3f0-6a075b776714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:29.976444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:29.977519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:29.978487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:29.978487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:29.978487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:29.978487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:29.978487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 294/575] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:29.978487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82e529-cfa6-4007-a3f0-6a075b776714 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:29.986784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0765e17-fe5a-4731-be95-98585a68d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:29.987580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0765e17-fe5a-4731-be95-98585a68d9b9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:29.987861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0765e17-fe5a-4731-be95-98585a68d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:29.988162 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0765e17-fe5a-4731-be95-98585a68d9b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:29.998971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0765e17-fe5a-4731-be95-98585a68d9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:30.000565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0765e17-fe5a-4731-be95-98585a68d9b9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-c0765e17-fe5a-4731-be95-98585a68d9b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:30.018258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:30.019175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:30.020034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:30.020034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:30.020034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:30.020034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:30.024073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 282/576] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:30.024963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0765e17-fe5a-4731-be95-98585a68d9b9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:30.080687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82e529-cfa6-4007-a3f0-6a075b776714 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:30.118612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2eabe-6016-463a-89d1-f19eb65347b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:30.119405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2eabe-6016-463a-89d1-f19eb65347b1 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:30.119688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2eabe-6016-463a-89d1-f19eb65347b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:30.119961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2eabe-6016-463a-89d1-f19eb65347b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:30.120863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0765e17-fe5a-4731-be95-98585a68d9b9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:30.129862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2eabe-6016-463a-89d1-f19eb65347b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-12b2eabe-6016-463a-89d1-f19eb65347b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:30.137637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:30.138519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 295/577] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:30.144499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2eabe-6016-463a-89d1-f19eb65347b1 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:30.159144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a2f99-6489-42a3-956d-c3891a0ed805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:30.159791 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a2f99-6489-42a3-956d-c3891a0ed805 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:30.160069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a2f99-6489-42a3-956d-c3891a0ed805 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:30.160361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a2f99-6489-42a3-956d-c3891a0ed805 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:30.161073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a2f99-6489-42a3-956d-c3891a0ed805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:30.161373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a2f99-6489-42a3-956d-c3891a0ed805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:30.163253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a2f99-6489-42a3-956d-c3891a0ed805 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:30.174692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 283/578] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:30.175489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a2f99-6489-42a3-956d-c3891a0ed805 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:30.250667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2eabe-6016-463a-89d1-f19eb65347b1 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:30.278972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a2f99-6489-42a3-956d-c3891a0ed805 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:30.283049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b84c5c-3b6c-4f24-918c-c61c22e1a85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:30.283870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b84c5c-3b6c-4f24-918c-c61c22e1a85b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:30.284332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b84c5c-3b6c-4f24-918c-c61c22e1a85b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:30.284747 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b84c5c-3b6c-4f24-918c-c61c22e1a85b None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:30.285621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b84c5c-3b6c-4f24-918c-c61c22e1a85b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:30.286084 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b84c5c-3b6c-4f24-918c-c61c22e1a85b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:30.287433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b84c5c-3b6c-4f24-918c-c61c22e1a85b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:30.304010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 296/579] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:30.304639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b84c5c-3b6c-4f24-918c-c61c22e1a85b None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:30.311685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37d612-71b5-4a60-8bbf-245419231699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:30.312436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37d612-71b5-4a60-8bbf-245419231699 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:30.312724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37d612-71b5-4a60-8bbf-245419231699 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:30.313070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37d612-71b5-4a60-8bbf-245419231699 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:30.313804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37d612-71b5-4a60-8bbf-245419231699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:30.314109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37d612-71b5-4a60-8bbf-245419231699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:30.315477 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37d612-71b5-4a60-8bbf-245419231699 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:30.326793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 284/580] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:30.329026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37d612-71b5-4a60-8bbf-245419231699 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:30.412059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b84c5c-3b6c-4f24-918c-c61c22e1a85b None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:30.426973 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37d612-71b5-4a60-8bbf-245419231699 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:30.446724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbde8f-b825-4095-a529-284e500796ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:30.447394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbde8f-b825-4095-a529-284e500796ec None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:30.447762 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbde8f-b825-4095-a529-284e500796ec None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:30.447940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbde8f-b825-4095-a529-284e500796ec None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:30.448711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbde8f-b825-4095-a529-284e500796ec None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:30.449014 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbde8f-b825-4095-a529-284e500796ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:30.450788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbde8f-b825-4095-a529-284e500796ec None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:30.460072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 297/581] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:30.460879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbde8f-b825-4095-a529-284e500796ec None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:30.466034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cd34e-a2b4-41e9-a353-46a50ba95d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:30.467002 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cd34e-a2b4-41e9-a353-46a50ba95d16 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:30.467448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cd34e-a2b4-41e9-a353-46a50ba95d16 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:30.468016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cd34e-a2b4-41e9-a353-46a50ba95d16 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:30.476510 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cd34e-a2b4-41e9-a353-46a50ba95d16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:30.477938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cd34e-a2b4-41e9-a353-46a50ba95d16 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-6b0cd34e-a2b4-41e9-a353-46a50ba95d16 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:30.491545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:30.492691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:30.498518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:30.498518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:30.498518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:30.498518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:30.498518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:30.498518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:30.498518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:30.498518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:30.498518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 08:58:30.498518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:30.498518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 285/582] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:30.498518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cd34e-a2b4-41e9-a353-46a50ba95d16 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:30.557051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbde8f-b825-4095-a529-284e500796ec None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:30.589560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95655504-ea61-4e48-9e0a-3aee42d13c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:30.590362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95655504-ea61-4e48-9e0a-3aee42d13c95 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:30.590580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cd34e-a2b4-41e9-a353-46a50ba95d16 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:30.590684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95655504-ea61-4e48-9e0a-3aee42d13c95 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:30.590896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95655504-ea61-4e48-9e0a-3aee42d13c95 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:30.598344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95655504-ea61-4e48-9e0a-3aee42d13c95 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:30.600718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95655504-ea61-4e48-9e0a-3aee42d13c95 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-95655504-ea61-4e48-9e0a-3aee42d13c95 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:30.614566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:30.615573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:30.616564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:30.616564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:30.616564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:30.616564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:30.616564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:30.616564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:30.616564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:30.616564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:30.616564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:58:30.616564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:30.620610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 298/583] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:30.621444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95655504-ea61-4e48-9e0a-3aee42d13c95 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:30.624116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8eed0-7606-4531-a422-7e4310bc9a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:30.624919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8eed0-7606-4531-a422-7e4310bc9a62 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:30.625199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8eed0-7606-4531-a422-7e4310bc9a62 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:30.625474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8eed0-7606-4531-a422-7e4310bc9a62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:30.632652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8eed0-7606-4531-a422-7e4310bc9a62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:30.634111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8eed0-7606-4531-a422-7e4310bc9a62 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-aba8eed0-7606-4531-a422-7e4310bc9a62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:30.649726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:30.650631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:30.651503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:30.651503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:30.651503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:30.651503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:30.651503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:30.651503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:30.651503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:30.651503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:30.651503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 286/584] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:30.652738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8eed0-7606-4531-a422-7e4310bc9a62 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:30.727854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95655504-ea61-4e48-9e0a-3aee42d13c95 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:30.749238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8eed0-7606-4531-a422-7e4310bc9a62 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:30.759583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adfbe9-bb75-4edf-b6c5-04db912a705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:30.760405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adfbe9-bb75-4edf-b6c5-04db912a705f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:30.760687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adfbe9-bb75-4edf-b6c5-04db912a705f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:30.760964 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adfbe9-bb75-4edf-b6c5-04db912a705f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:30.770889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adfbe9-bb75-4edf-b6c5-04db912a705f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:30.772962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adfbe9-bb75-4edf-b6c5-04db912a705f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:30.781843 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac32c31-675b-423c-ae8a-960c429cac64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:30.782504 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac32c31-675b-423c-ae8a-960c429cac64 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:30.782782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac32c31-675b-423c-ae8a-960c429cac64 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:30.783053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac32c31-675b-423c-ae8a-960c429cac64 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:30.783874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac32c31-675b-423c-ae8a-960c429cac64 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:30.784219 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac32c31-675b-423c-ae8a-960c429cac64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:30.785610 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac32c31-675b-423c-ae8a-960c429cac64 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-f7adfbe9-bb75-4edf-b6c5-04db912a705f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:30.789387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:30.790234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:30.791136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:30.791136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:30.791136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:30.791136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:30.795091 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 299/585] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:30.795776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adfbe9-bb75-4edf-b6c5-04db912a705f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:30.807177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 287/586] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:30.807177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac32c31-675b-423c-ae8a-960c429cac64 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:30.889415 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adfbe9-bb75-4edf-b6c5-04db912a705f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:30.900270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac32c31-675b-423c-ae8a-960c429cac64 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:30.922128 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40454061-d749-4d09-97fe-ed64061395e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:30.922791 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454061-d749-4d09-97fe-ed64061395e6 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:30.923071 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454061-d749-4d09-97fe-ed64061395e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:30.923344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454061-d749-4d09-97fe-ed64061395e6 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:30.924190 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40454061-d749-4d09-97fe-ed64061395e6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:30.924498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40454061-d749-4d09-97fe-ed64061395e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:30.925903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40454061-d749-4d09-97fe-ed64061395e6 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:30.932697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4dfa2-a791-4290-bd71-4a248e90eca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:30.933349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4dfa2-a791-4290-bd71-4a248e90eca1 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:30.933632 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4dfa2-a791-4290-bd71-4a248e90eca1 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:30.933907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4dfa2-a791-4290-bd71-4a248e90eca1 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:30.934691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4dfa2-a791-4290-bd71-4a248e90eca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:30.935011 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4dfa2-a791-4290-bd71-4a248e90eca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:30.936437 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4dfa2-a791-4290-bd71-4a248e90eca1 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:30.942851 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 300/587] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:30.943645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40454061-d749-4d09-97fe-ed64061395e6 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:30.955266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 288/588] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:30.956078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4dfa2-a791-4290-bd71-4a248e90eca1 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:31.040720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40454061-d749-4d09-97fe-ed64061395e6 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:31.052502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4dfa2-a791-4290-bd71-4a248e90eca1 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:31.073915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e3d61-4b82-40ff-a30c-fdb4c4f9cd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:31.074507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e3d61-4b82-40ff-a30c-fdb4c4f9cd12 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.075040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e3d61-4b82-40ff-a30c-fdb4c4f9cd12 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.075311 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e3d61-4b82-40ff-a30c-fdb4c4f9cd12 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.076025 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e3d61-4b82-40ff-a30c-fdb4c4f9cd12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:31.076354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e3d61-4b82-40ff-a30c-fdb4c4f9cd12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:31.077720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e3d61-4b82-40ff-a30c-fdb4c4f9cd12 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:31.087265 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae536-ae11-403b-9e77-8f5556d3ee34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:31.088256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae536-ae11-403b-9e77-8f5556d3ee34 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.088705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae536-ae11-403b-9e77-8f5556d3ee34 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.088814 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 301/589] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:31.089198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae536-ae11-403b-9e77-8f5556d3ee34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.089548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e3d61-4b82-40ff-a30c-fdb4c4f9cd12 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:31.102859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ae536-ae11-403b-9e77-8f5556d3ee34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:31.104609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ae536-ae11-403b-9e77-8f5556d3ee34 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-233ae536-ae11-403b-9e77-8f5556d3ee34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:31.122679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:31.123593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:31.124539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:31.124539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:31.124539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:31.124539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:31.124539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 289/590] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:31.124828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae536-ae11-403b-9e77-8f5556d3ee34 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:31.187303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e3d61-4b82-40ff-a30c-fdb4c4f9cd12 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:31.224809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7f6ac-4b06-4b44-b275-abf7eff0381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:31.225654 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7f6ac-4b06-4b44-b275-abf7eff0381a None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.225930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7f6ac-4b06-4b44-b275-abf7eff0381a None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.226200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7f6ac-4b06-4b44-b275-abf7eff0381a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.234990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae536-ae11-403b-9e77-8f5556d3ee34 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:31.236911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7f6ac-4b06-4b44-b275-abf7eff0381a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:31.238552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7f6ac-4b06-4b44-b275-abf7eff0381a None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-4ea7f6ac-4b06-4b44-b275-abf7eff0381a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:31.255937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:31.257540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:31.258424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:31.258424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:31.258424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:31.258424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:31.258424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 302/591] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:31.258720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7f6ac-4b06-4b44-b275-abf7eff0381a None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:31.273303 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c747ea9-bbdc-43f4-b933-1bb441c425a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:31.274188 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c747ea9-bbdc-43f4-b933-1bb441c425a0 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.274468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c747ea9-bbdc-43f4-b933-1bb441c425a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.274746 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c747ea9-bbdc-43f4-b933-1bb441c425a0 None admin] PATH_INFO: `/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/2b863628035e4767b08fb5efc5c80958/roles/4bf5d4bd3a884670a5898236973cff13` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.289059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c747ea9-bbdc-43f4-b933-1bb441c425a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=250761bd5a9e48e0b26fedcf65d88a5d, user_id=2b863628035e4767b08fb5efc5c80958, role_id=4bf5d4bd3a884670a5898236973cff13)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:31.290522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c747ea9-bbdc-43f4-b933-1bb441c425a0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:31.303584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 290/592] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:58:31 2022] PUT /identity/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/2b863628035e4767b08fb5efc5c80958/roles/4bf5d4bd3a884670a5898236973cff13 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:58:31.304294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c747ea9-bbdc-43f4-b933-1bb441c425a0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:31.390305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7f6ac-4b06-4b44-b275-abf7eff0381a None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:31.426687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c747ea9-bbdc-43f4-b933-1bb441c425a0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:31.438905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65189f49-b881-464a-a897-19a9b08f19d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:31.439797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65189f49-b881-464a-a897-19a9b08f19d9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.440073 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65189f49-b881-464a-a897-19a9b08f19d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.440369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65189f49-b881-464a-a897-19a9b08f19d9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.449039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65189f49-b881-464a-a897-19a9b08f19d9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:31.451020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65189f49-b881-464a-a897-19a9b08f19d9 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-65189f49-b881-464a-a897-19a9b08f19d9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:31.466117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:31.467329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:31.468403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:31.468403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:31.468403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:31.468403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:31.468403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:31.468403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:31.468403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:31.468403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:31.468403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 08:58:31.468403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:31.472355 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 303/593] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:31.473293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1486023-9a55-473c-9984-fd994f58668b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:31.473448 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65189f49-b881-464a-a897-19a9b08f19d9 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:31.474248 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1486023-9a55-473c-9984-fd994f58668b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.474684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1486023-9a55-473c-9984-fd994f58668b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.475658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1486023-9a55-473c-9984-fd994f58668b None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.476589 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1486023-9a55-473c-9984-fd994f58668b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:31.477039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1486023-9a55-473c-9984-fd994f58668b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:31.478611 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1486023-9a55-473c-9984-fd994f58668b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:31.496162 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 291/594] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:31.497352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1486023-9a55-473c-9984-fd994f58668b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:31.576681 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65189f49-b881-464a-a897-19a9b08f19d9 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:31.597057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1486023-9a55-473c-9984-fd994f58668b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:31.610329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53b6ff-8d9d-407a-955c-85dae0a8d58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:31.611097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53b6ff-8d9d-407a-955c-85dae0a8d58e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.611452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53b6ff-8d9d-407a-955c-85dae0a8d58e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.611801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53b6ff-8d9d-407a-955c-85dae0a8d58e None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.612709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53b6ff-8d9d-407a-955c-85dae0a8d58e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:31.613001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53b6ff-8d9d-407a-955c-85dae0a8d58e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:31.614442 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53b6ff-8d9d-407a-955c-85dae0a8d58e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:31.628044 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 304/595] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:31.629117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53b6ff-8d9d-407a-955c-85dae0a8d58e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:31.635828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d337a-7157-4a6e-bce8-f9e9b2e38e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:31.636844 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d337a-7157-4a6e-bce8-f9e9b2e38e96 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.637305 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d337a-7157-4a6e-bce8-f9e9b2e38e96 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.637806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d337a-7157-4a6e-bce8-f9e9b2e38e96 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.638936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d337a-7157-4a6e-bce8-f9e9b2e38e96 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:31.639437 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d337a-7157-4a6e-bce8-f9e9b2e38e96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:31.641240 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d337a-7157-4a6e-bce8-f9e9b2e38e96 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:31.661354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 292/596] 10.222.0.23 () {56 vars in 1139 bytes} [Tue May 3 08:58:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:31.663009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d337a-7157-4a6e-bce8-f9e9b2e38e96 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:31.734742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53b6ff-8d9d-407a-955c-85dae0a8d58e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:31.767969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d337a-7157-4a6e-bce8-f9e9b2e38e96 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:31.772863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070c690-2bde-4562-9c58-610e90813a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:31.773958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070c690-2bde-4562-9c58-610e90813a9e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.774314 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070c690-2bde-4562-9c58-610e90813a9e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.774659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070c690-2bde-4562-9c58-610e90813a9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.783978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070c690-2bde-4562-9c58-610e90813a9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:31.785614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070c690-2bde-4562-9c58-610e90813a9e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-4070c690-2bde-4562-9c58-610e90813a9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:31.800367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:31.801281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:31.802167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:31.802167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:31.802167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:31.802167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:31.802167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:31.802167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:31.802167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:31.802167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:31.806490 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 305/597] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:31.807492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070c690-2bde-4562-9c58-610e90813a9e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:31.809814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c846dbc-5488-4da7-9603-90d27e172b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:31.811127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c846dbc-5488-4da7-9603-90d27e172b52 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.811582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c846dbc-5488-4da7-9603-90d27e172b52 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.812074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c846dbc-5488-4da7-9603-90d27e172b52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.819735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c846dbc-5488-4da7-9603-90d27e172b52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:31.821930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c846dbc-5488-4da7-9603-90d27e172b52 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-7c846dbc-5488-4da7-9603-90d27e172b52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:31.836593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:31.837637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:31.838719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:31.838719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:31.838719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:31.838719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:31.838719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:31.838719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:31.838719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:31.838719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:31.840505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 293/598] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:31.841413 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c846dbc-5488-4da7-9603-90d27e172b52 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:31.905334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070c690-2bde-4562-9c58-610e90813a9e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:31.934349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c846dbc-5488-4da7-9603-90d27e172b52 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:31.937139 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c09288-a147-4654-b7d8-0b89d8311a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:31.937922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c09288-a147-4654-b7d8-0b89d8311a03 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.938202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c09288-a147-4654-b7d8-0b89d8311a03 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.938476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c09288-a147-4654-b7d8-0b89d8311a03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.949388 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c09288-a147-4654-b7d8-0b89d8311a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:31.951102 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c09288-a147-4654-b7d8-0b89d8311a03 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:31.966631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25ae80-e781-46c9-ab74-8927098a78c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:31.967277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25ae80-e781-46c9-ab74-8927098a78c3 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.967559 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25ae80-e781-46c9-ab74-8927098a78c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.967833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25ae80-e781-46c9-ab74-8927098a78c3 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-76c09288-a147-4654-b7d8-0b89d8311a03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:31.967949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:31.968772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:31.969672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:31.969672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:31.969672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:31.969672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:31.969900 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25ae80-e781-46c9-ab74-8927098a78c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:31.969900 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25ae80-e781-46c9-ab74-8927098a78c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:31.970446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25ae80-e781-46c9-ab74-8927098a78c3 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:31.973670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 306/599] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:31.974697 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3060c08-b235-4241-bfe4-310994a02280 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:31.975528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3060c08-b235-4241-bfe4-310994a02280 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:31.975803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3060c08-b235-4241-bfe4-310994a02280 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:31.981352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 307/600] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:31.981352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3060c08-b235-4241-bfe4-310994a02280 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:31.986860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 294/601] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:31.991635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25ae80-e781-46c9-ab74-8927098a78c3 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:32.078313 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3060c08-b235-4241-bfe4-310994a02280 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:32.086952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25ae80-e781-46c9-ab74-8927098a78c3 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:32.111357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8933d4-1bd8-4531-b3bd-e14980576ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:32.112015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8933d4-1bd8-4531-b3bd-e14980576ea7 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:32.112338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8933d4-1bd8-4531-b3bd-e14980576ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:32.112613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8933d4-1bd8-4531-b3bd-e14980576ea7 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:32.113578 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8933d4-1bd8-4531-b3bd-e14980576ea7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:32.113886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8933d4-1bd8-4531-b3bd-e14980576ea7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:32.115342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8933d4-1bd8-4531-b3bd-e14980576ea7 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:32.126876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efafc0-f91d-4a83-a96a-c579b88c3084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:32.132559 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efafc0-f91d-4a83-a96a-c579b88c3084 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:32.132716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 308/602] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:32.132814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efafc0-f91d-4a83-a96a-c579b88c3084 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:32.132814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efafc0-f91d-4a83-a96a-c579b88c3084 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:32.132814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efafc0-f91d-4a83-a96a-c579b88c3084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:32.133011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42685463-52ab-4b2c-8161-3b5f96547d30 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:32.133011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42685463-52ab-4b2c-8161-3b5f96547d30 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:32.133218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efafc0-f91d-4a83-a96a-c579b88c3084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:32.133318 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42685463-52ab-4b2c-8161-3b5f96547d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:32.133504 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efafc0-f91d-4a83-a96a-c579b88c3084 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:32.143183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 295/603] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:32.148191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efafc0-f91d-4a83-a96a-c579b88c3084 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:32.152562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-42685463-52ab-4b2c-8161-3b5f96547d30 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:32.153759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-42685463-52ab-4b2c-8161-3b5f96547d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:32.227200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 309/604] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:32.227907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42685463-52ab-4b2c-8161-3b5f96547d30 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:32.260016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efafc0-f91d-4a83-a96a-c579b88c3084 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:32.292656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67052d13-928f-43cd-978e-8164700ef26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:32.293525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67052d13-928f-43cd-978e-8164700ef26c None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:32.293801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67052d13-928f-43cd-978e-8164700ef26c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:32.294080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67052d13-928f-43cd-978e-8164700ef26c None admin] PATH_INFO: `/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/1848679bce324613b4a92de808165ba8/roles/4bf5d4bd3a884670a5898236973cff13` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:32.307831 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67052d13-928f-43cd-978e-8164700ef26c None admin] RBAC: Authorizing `identity:create_grant(project_id=250761bd5a9e48e0b26fedcf65d88a5d, user_id=1848679bce324613b4a92de808165ba8, role_id=4bf5d4bd3a884670a5898236973cff13)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:32.309285 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67052d13-928f-43cd-978e-8164700ef26c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:32.321962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 296/605] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:58:32 2022] PUT /identity/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/1848679bce324613b4a92de808165ba8/roles/4bf5d4bd3a884670a5898236973cff13 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:58:32.322765 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67052d13-928f-43cd-978e-8164700ef26c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:32.338424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42685463-52ab-4b2c-8161-3b5f96547d30 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:32.384518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8ad4d-0a53-41e2-911f-226cd85d85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:32.385937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8ad4d-0a53-41e2-911f-226cd85d85cb None admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:32.386768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8ad4d-0a53-41e2-911f-226cd85d85cb None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:32.387251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8ad4d-0a53-41e2-911f-226cd85d85cb None admin] PATH_INFO: `/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/17e1e2dc0a0a45f4a36d1369edcc6e5b/roles/4bf5d4bd3a884670a5898236973cff13` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:32.408462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8ad4d-0a53-41e2-911f-226cd85d85cb None admin] RBAC: Authorizing `identity:create_grant(project_id=250761bd5a9e48e0b26fedcf65d88a5d, user_id=17e1e2dc0a0a45f4a36d1369edcc6e5b, role_id=4bf5d4bd3a884670a5898236973cff13)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:32.411123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8ad4d-0a53-41e2-911f-226cd85d85cb None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:32.436487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 310/606] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:58:32 2022] PUT /identity/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/17e1e2dc0a0a45f4a36d1369edcc6e5b/roles/4bf5d4bd3a884670a5898236973cff13 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:58:32.437844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8ad4d-0a53-41e2-911f-226cd85d85cb None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:32.444940 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67052d13-928f-43cd-978e-8164700ef26c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:32.495223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ec06e-d5ad-4fde-b319-1e9ffe923317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:32.496229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ec06e-d5ad-4fde-b319-1e9ffe923317 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:32.496511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ec06e-d5ad-4fde-b319-1e9ffe923317 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:32.496784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ec06e-d5ad-4fde-b319-1e9ffe923317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:32.512736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ec06e-d5ad-4fde-b319-1e9ffe923317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:32.517302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ec06e-d5ad-4fde-b319-1e9ffe923317 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-2c0ec06e-d5ad-4fde-b319-1e9ffe923317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:32.546617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:32.547568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:32.548491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:32.548491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:32.548491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:32.548491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:32.548491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:32.548491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:32.548491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:32.548491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:32.548491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 297/607] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:32.561177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ec06e-d5ad-4fde-b319-1e9ffe923317 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:32.603301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8ad4d-0a53-41e2-911f-226cd85d85cb None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:32.653725 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b52856-8b92-4fe4-9ce7-8a9d981711cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:32.654538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b52856-8b92-4fe4-9ce7-8a9d981711cd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:32.654821 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b52856-8b92-4fe4-9ce7-8a9d981711cd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:32.655095 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b52856-8b92-4fe4-9ce7-8a9d981711cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:32.673669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ec06e-d5ad-4fde-b319-1e9ffe923317 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:32.674882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b52856-8b92-4fe4-9ce7-8a9d981711cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-95b52856-8b92-4fe4-9ce7-8a9d981711cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:32.686499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:32.687447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:32.688307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:32.688307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:32.688307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:32.688307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:32.688307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:32.688307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:32.688307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:32.688307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:32.688307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:32.688307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:32.688307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:32.688307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:32.691060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 311/608] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:32.697147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b52856-8b92-4fe4-9ce7-8a9d981711cd None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:32.720886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab909f-f9a6-4d40-8ee7-674368ce7007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:32.721481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab909f-f9a6-4d40-8ee7-674368ce7007 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:32.721764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab909f-f9a6-4d40-8ee7-674368ce7007 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:32.722037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab909f-f9a6-4d40-8ee7-674368ce7007 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:32.722832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab909f-f9a6-4d40-8ee7-674368ce7007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:32.723151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab909f-f9a6-4d40-8ee7-674368ce7007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:32.724600 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab909f-f9a6-4d40-8ee7-674368ce7007 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:32.743861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 298/609] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:32.745118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab909f-f9a6-4d40-8ee7-674368ce7007 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:32.800654 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b52856-8b92-4fe4-9ce7-8a9d981711cd None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:32.834952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d408-1e44-4ab5-882a-c9eb1570b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:32.836042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d408-1e44-4ab5-882a-c9eb1570b27a None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:32.836553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d408-1e44-4ab5-882a-c9eb1570b27a None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:32.837041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d408-1e44-4ab5-882a-c9eb1570b27a None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:32.837981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286d408-1e44-4ab5-882a-c9eb1570b27a None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:32.838491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286d408-1e44-4ab5-882a-c9eb1570b27a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:32.840110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286d408-1e44-4ab5-882a-c9eb1570b27a None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:32.843337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab909f-f9a6-4d40-8ee7-674368ce7007 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:32.849531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 312/610] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:32.857033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d408-1e44-4ab5-882a-c9eb1570b27a None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:32.879640 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4398-06de-4860-a445-2540c38f5387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:32.880617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4398-06de-4860-a445-2540c38f5387 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:32.881205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4398-06de-4860-a445-2540c38f5387 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:32.881489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4398-06de-4860-a445-2540c38f5387 None admin] PATH_INFO: `/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/418178b7e70f47d291e239a1297ccf0a/roles/4bf5d4bd3a884670a5898236973cff13` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:32.897307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c4398-06de-4860-a445-2540c38f5387 None admin] RBAC: Authorizing `identity:create_grant(project_id=250761bd5a9e48e0b26fedcf65d88a5d, user_id=418178b7e70f47d291e239a1297ccf0a, role_id=4bf5d4bd3a884670a5898236973cff13)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:32.899133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c4398-06de-4860-a445-2540c38f5387 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:32.924436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 299/611] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:58:32 2022] PUT /identity/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/418178b7e70f47d291e239a1297ccf0a/roles/4bf5d4bd3a884670a5898236973cff13 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:58:33.050844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d408-1e44-4ab5-882a-c9eb1570b27a None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:33.097064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca009e2-3d77-49aa-8728-1a9013bad2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:33.097899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca009e2-3d77-49aa-8728-1a9013bad2a9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:33.098179 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca009e2-3d77-49aa-8728-1a9013bad2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:33.098449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca009e2-3d77-49aa-8728-1a9013bad2a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:33.114032 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca009e2-3d77-49aa-8728-1a9013bad2a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:33.116131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca009e2-3d77-49aa-8728-1a9013bad2a9 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-4ca009e2-3d77-49aa-8728-1a9013bad2a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:33.134248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:33.135251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:33.136169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:33.136169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:33.136169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:33.136169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:33.136169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 313/612] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:33.141480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4398-06de-4860-a445-2540c38f5387 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:33.247208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4398-06de-4860-a445-2540c38f5387 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:33.290387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37ae48-420d-48b0-8a26-d34fc7c6c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:33.291055 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37ae48-420d-48b0-8a26-d34fc7c6c9d0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:33.291338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37ae48-420d-48b0-8a26-d34fc7c6c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:33.291612 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37ae48-420d-48b0-8a26-d34fc7c6c9d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:33.292364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37ae48-420d-48b0-8a26-d34fc7c6c9d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:33.292669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37ae48-420d-48b0-8a26-d34fc7c6c9d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:33.294043 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37ae48-420d-48b0-8a26-d34fc7c6c9d0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:33.310853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 300/613] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:33.316610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca009e2-3d77-49aa-8728-1a9013bad2a9 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:33.445101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca009e2-3d77-49aa-8728-1a9013bad2a9 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:33.494322 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2523c98-058b-4116-8c58-f8ed8d88c7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:33.495127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523c98-058b-4116-8c58-f8ed8d88c7ee None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:33.495410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523c98-058b-4116-8c58-f8ed8d88c7ee None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:33.495680 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523c98-058b-4116-8c58-f8ed8d88c7ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:33.505699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2523c98-058b-4116-8c58-f8ed8d88c7ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:33.507382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2523c98-058b-4116-8c58-f8ed8d88c7ee None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-d2523c98-058b-4116-8c58-f8ed8d88c7ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:33.525847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:33.526945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:33.527916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:33.527916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:33.527916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:33.527916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:33.527916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:33.527916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:33.527916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:33.527916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:33.527916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 08:58:33.527916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:33.527916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 314/614] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:33.532666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37ae48-420d-48b0-8a26-d34fc7c6c9d0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:33.673418 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37ae48-420d-48b0-8a26-d34fc7c6c9d0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:33.719236 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa3692-3890-4d47-90b4-d99dac800ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:33.719897 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa3692-3890-4d47-90b4-d99dac800ba3 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:33.720210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa3692-3890-4d47-90b4-d99dac800ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:33.720484 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa3692-3890-4d47-90b4-d99dac800ba3 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:33.721320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa3692-3890-4d47-90b4-d99dac800ba3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:33.721625 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa3692-3890-4d47-90b4-d99dac800ba3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:33.723033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa3692-3890-4d47-90b4-d99dac800ba3 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:33.740537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 301/615] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 3 08:58:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:33.745477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2523c98-058b-4116-8c58-f8ed8d88c7ee None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:33.875301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2523c98-058b-4116-8c58-f8ed8d88c7ee None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:33.917473 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c977f5-a0eb-4166-a70d-e5a39b0f9781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:33.918264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c977f5-a0eb-4166-a70d-e5a39b0f9781 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:33.918539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c977f5-a0eb-4166-a70d-e5a39b0f9781 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:33.918812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c977f5-a0eb-4166-a70d-e5a39b0f9781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:33.930388 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c977f5-a0eb-4166-a70d-e5a39b0f9781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:33.931748 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c977f5-a0eb-4166-a70d-e5a39b0f9781 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-f1c977f5-a0eb-4166-a70d-e5a39b0f9781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:33.954796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:33.955719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:33.956617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:33.956617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:33.956617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:33.956617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:33.960228 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 315/616] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:33.961985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa3692-3890-4d47-90b4-d99dac800ba3 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:33.995031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0a62c-23ee-4d3b-a424-aa5a4c90d2dc None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:33.995371 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0a62c-23ee-4d3b-a424-aa5a4c90d2dc None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:33.995584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0a62c-23ee-4d3b-a424-aa5a4c90d2dc None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:33.997520 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 316/617] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:34.010797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01522df3-705a-46af-8ebd-516fc4ad6941 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:34.011120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01522df3-705a-46af-8ebd-516fc4ad6941 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:34.011402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01522df3-705a-46af-8ebd-516fc4ad6941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:34.039695 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-01522df3-705a-46af-8ebd-516fc4ad6941 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:34.041481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-01522df3-705a-46af-8ebd-516fc4ad6941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:34.116147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa3692-3890-4d47-90b4-d99dac800ba3 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:34.159247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3daf2-2a9b-4d99-aac1-751acc2ecab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:34.159778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3daf2-2a9b-4d99-aac1-751acc2ecab5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:34.160066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3daf2-2a9b-4d99-aac1-751acc2ecab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:34.160361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3daf2-2a9b-4d99-aac1-751acc2ecab5 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:34.161221 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3daf2-2a9b-4d99-aac1-751acc2ecab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:34.161404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3daf2-2a9b-4d99-aac1-751acc2ecab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:34.162801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3daf2-2a9b-4d99-aac1-751acc2ecab5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:34.174676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 302/618] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:34.183802 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3daf2-2a9b-4d99-aac1-751acc2ecab5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:34.212222 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 317/619] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:34.252313 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01522df3-705a-46af-8ebd-516fc4ad6941 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:34.301211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3daf2-2a9b-4d99-aac1-751acc2ecab5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:34.342903 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fe9cc-e272-416b-8975-975698147f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:34.343701 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fe9cc-e272-416b-8975-975698147f4a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:34.343987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fe9cc-e272-416b-8975-975698147f4a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:34.344340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fe9cc-e272-416b-8975-975698147f4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:34.352561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fe9cc-e272-416b-8975-975698147f4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:34.354078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fe9cc-e272-416b-8975-975698147f4a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-ac8fe9cc-e272-416b-8975-975698147f4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:34.370190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:34.371114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:34.371975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:34.371975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:34.371975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:34.371975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:34.371975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:34.371975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:34.371975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:34.371975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:34.371975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 303/620] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:34.377205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fe9cc-e272-416b-8975-975698147f4a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:34.477071 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01522df3-705a-46af-8ebd-516fc4ad6941 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:34.541546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03599dc9-65ae-4ad7-b597-af81ae693a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:34.542344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03599dc9-65ae-4ad7-b597-af81ae693a00 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:34.542616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03599dc9-65ae-4ad7-b597-af81ae693a00 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:34.542880 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03599dc9-65ae-4ad7-b597-af81ae693a00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:34.562303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03599dc9-65ae-4ad7-b597-af81ae693a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-03599dc9-65ae-4ad7-b597-af81ae693a00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:34.570110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:34.571027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:34.571861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:34.571861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:34.571861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:34.571861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:34.571861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:34.571861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:34.571861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:34.571861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:34.571861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:34.571861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:34.571861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:34.571861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:34.575442 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fe9cc-e272-416b-8975-975698147f4a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:34.583412 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 318/621] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:34.584383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03599dc9-65ae-4ad7-b597-af81ae693a00 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:34.643223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd333f0f-687a-46ee-83d9-a0ef05aef5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:34.643868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd333f0f-687a-46ee-83d9-a0ef05aef5a2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:34.644149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd333f0f-687a-46ee-83d9-a0ef05aef5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:34.644558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd333f0f-687a-46ee-83d9-a0ef05aef5a2 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:34.645353 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd333f0f-687a-46ee-83d9-a0ef05aef5a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:34.645655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd333f0f-687a-46ee-83d9-a0ef05aef5a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:34.647112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd333f0f-687a-46ee-83d9-a0ef05aef5a2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:34.666053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 304/622] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:34.671724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd333f0f-687a-46ee-83d9-a0ef05aef5a2 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:34.782729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03599dc9-65ae-4ad7-b597-af81ae693a00 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:34.827020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58665d94-b95d-4794-827d-b583b85a3dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:34.827696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58665d94-b95d-4794-827d-b583b85a3dcc None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:34.827981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58665d94-b95d-4794-827d-b583b85a3dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:34.828278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58665d94-b95d-4794-827d-b583b85a3dcc None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:34.829006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58665d94-b95d-4794-827d-b583b85a3dcc None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:34.829303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58665d94-b95d-4794-827d-b583b85a3dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:34.830683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58665d94-b95d-4794-827d-b583b85a3dcc None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:34.846474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 319/623] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:34.854013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58665d94-b95d-4794-827d-b583b85a3dcc None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:34.879928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd333f0f-687a-46ee-83d9-a0ef05aef5a2 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:34.951387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730a877-c359-4ad8-a22b-a7c97af007a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:34.952339 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a877-c359-4ad8-a22b-a7c97af007a9 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:34.953290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a877-c359-4ad8-a22b-a7c97af007a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:34.953667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a877-c359-4ad8-a22b-a7c97af007a9 None admin] PATH_INFO: `/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/2360e3a110b042a8839c45aa50a39724/roles/4bf5d4bd3a884670a5898236973cff13` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:34.976039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730a877-c359-4ad8-a22b-a7c97af007a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=250761bd5a9e48e0b26fedcf65d88a5d, user_id=2360e3a110b042a8839c45aa50a39724, role_id=4bf5d4bd3a884670a5898236973cff13)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:34.978313 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730a877-c359-4ad8-a22b-a7c97af007a9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:34.979706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58665d94-b95d-4794-827d-b583b85a3dcc None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:34.996164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 305/624] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:58:34 2022] PUT /identity/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/2360e3a110b042a8839c45aa50a39724/roles/4bf5d4bd3a884670a5898236973cff13 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 08:58:34.997671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62daee-a039-470b-a597-fc561ed6ea0d None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:34.998041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62daee-a039-470b-a597-fc561ed6ea0d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:34.998319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62daee-a039-470b-a597-fc561ed6ea0d None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:34.999988 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 306/625] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:35.016182 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8798-7aba-4458-9d10-d17d60046cfd None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.016499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8798-7aba-4458-9d10-d17d60046cfd None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.016733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8798-7aba-4458-9d10-d17d60046cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.038888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7294d24-1e1e-4bb7-81a4-df0fff8828c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:35.039619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7294d24-1e1e-4bb7-81a4-df0fff8828c3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.039893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7294d24-1e1e-4bb7-81a4-df0fff8828c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.040184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7294d24-1e1e-4bb7-81a4-df0fff8828c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.044530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5cbd8798-7aba-4458-9d10-d17d60046cfd None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:35.046144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5cbd8798-7aba-4458-9d10-d17d60046cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:35.062380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7294d24-1e1e-4bb7-81a4-df0fff8828c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:35.063874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7294d24-1e1e-4bb7-81a4-df0fff8828c3 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-b7294d24-1e1e-4bb7-81a4-df0fff8828c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:35.101080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:35.102092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:35.102974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:35.102974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:35.102974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:35.102974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:35.112599 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 320/626] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:35.119281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7294d24-1e1e-4bb7-81a4-df0fff8828c3 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:35.129659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 307/627] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 03 08:58:35.142293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38925aa-95a9-4553-a5c9-f0974f088fe4 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.142945 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38925aa-95a9-4553-a5c9-f0974f088fe4 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.143508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38925aa-95a9-4553-a5c9-f0974f088fe4 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.145480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 308/628] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:58:35.151407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91640b-e43f-40cd-80fe-98d6ab6a8ee8 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.152014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91640b-e43f-40cd-80fe-98d6ab6a8ee8 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.152533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91640b-e43f-40cd-80fe-98d6ab6a8ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.170708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-7a91640b-e43f-40cd-80fe-98d6ab6a8ee8 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:35.172249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7a91640b-e43f-40cd-80fe-98d6ab6a8ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:35.248244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 309/629] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:58:35.249347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91640b-e43f-40cd-80fe-98d6ab6a8ee8 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:35.259764 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7294d24-1e1e-4bb7-81a4-df0fff8828c3 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:35.293326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775f490-1960-4449-aa0f-88ba728b3d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:35.293913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775f490-1960-4449-aa0f-88ba728b3d02 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.294195 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775f490-1960-4449-aa0f-88ba728b3d02 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.294472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775f490-1960-4449-aa0f-88ba728b3d02 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.295205 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775f490-1960-4449-aa0f-88ba728b3d02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:35.295511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775f490-1960-4449-aa0f-88ba728b3d02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:35.296904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775f490-1960-4449-aa0f-88ba728b3d02 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:35.308862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 321/630] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:35.309681 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775f490-1960-4449-aa0f-88ba728b3d02 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:35.370212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91640b-e43f-40cd-80fe-98d6ab6a8ee8 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:35.409992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775f490-1960-4449-aa0f-88ba728b3d02 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:35.412042 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c70b6f-6224-4261-9762-9649d198b2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:35.413840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c70b6f-6224-4261-9762-9649d198b2d5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.414267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c70b6f-6224-4261-9762-9649d198b2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.414690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c70b6f-6224-4261-9762-9649d198b2d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.436117 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c70b6f-6224-4261-9762-9649d198b2d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-25c70b6f-6224-4261-9762-9649d198b2d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:35.439085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:35.440212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:35.441232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:35.441232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:35.441232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:35.441232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:35.441232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:35.441232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:35.441232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:35.441232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:35.441232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:35.441232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:35.441232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:35.441232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:35.444059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 310/631] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:35.444059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c70b6f-6224-4261-9762-9649d198b2d5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:35.451919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa3e1-8ff2-4c5a-9301-6029c2917396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:35.452802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa3e1-8ff2-4c5a-9301-6029c2917396 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.453081 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa3e1-8ff2-4c5a-9301-6029c2917396 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.453356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa3e1-8ff2-4c5a-9301-6029c2917396 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.464819 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afa3e1-8ff2-4c5a-9301-6029c2917396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-19afa3e1-8ff2-4c5a-9301-6029c2917396 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:35.472864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:35.475147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 322/632] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:35.477221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa3e1-8ff2-4c5a-9301-6029c2917396 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:35.545858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c70b6f-6224-4261-9762-9649d198b2d5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:35.576465 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa3e1-8ff2-4c5a-9301-6029c2917396 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:35.579974 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968285e-d14c-41ee-8134-c9ca57b22af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:35.580976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968285e-d14c-41ee-8134-c9ca57b22af5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.581423 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968285e-d14c-41ee-8134-c9ca57b22af5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.581852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968285e-d14c-41ee-8134-c9ca57b22af5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.589624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968285e-d14c-41ee-8134-c9ca57b22af5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:35.591247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968285e-d14c-41ee-8134-c9ca57b22af5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-d968285e-d14c-41ee-8134-c9ca57b22af5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:35.605270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:35.606451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:35.607671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:35.607671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:35.607671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:35.607671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:35.607671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:35.607671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:35.607671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:35.607671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:35.607671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:58:35.607671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:35.609966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 311/633] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 08:58:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:35.611004 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968285e-d14c-41ee-8134-c9ca57b22af5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:35.611121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee8991-7bdd-41b1-93fa-cd40b43391c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:35.611799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee8991-7bdd-41b1-93fa-cd40b43391c2 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.612173 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee8991-7bdd-41b1-93fa-cd40b43391c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.612519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee8991-7bdd-41b1-93fa-cd40b43391c2 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.613338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee8991-7bdd-41b1-93fa-cd40b43391c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:35.613716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee8991-7bdd-41b1-93fa-cd40b43391c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:35.615319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee8991-7bdd-41b1-93fa-cd40b43391c2 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:35.628148 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 323/634] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:35.628148 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee8991-7bdd-41b1-93fa-cd40b43391c2 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:35.719820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968285e-d14c-41ee-8134-c9ca57b22af5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:35.727320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee8991-7bdd-41b1-93fa-cd40b43391c2 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:35.753685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f4266-a45b-482b-b684-305d124410eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:35.754616 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f4266-a45b-482b-b684-305d124410eb None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.755056 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f4266-a45b-482b-b684-305d124410eb None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.755487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f4266-a45b-482b-b684-305d124410eb None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.756979 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f4266-a45b-482b-b684-305d124410eb None admin] RBAC: Adding query filter params (name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:35.757451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f4266-a45b-482b-b684-305d124410eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:35.759014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f4266-a45b-482b-b684-305d124410eb None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:35.761588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e0d80-cf53-498a-8f44-881479d2d637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:35.762121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e0d80-cf53-498a-8f44-881479d2d637 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.762404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e0d80-cf53-498a-8f44-881479d2d637 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.762676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e0d80-cf53-498a-8f44-881479d2d637 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.763510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e0d80-cf53-498a-8f44-881479d2d637 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:35.763817 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e0d80-cf53-498a-8f44-881479d2d637 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:35.765402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e0d80-cf53-498a-8f44-881479d2d637 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:35.769578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 312/635] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:35.770754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f4266-a45b-482b-b684-305d124410eb None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:35.783614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 324/636] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 08:58:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:35.784597 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e0d80-cf53-498a-8f44-881479d2d637 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:35.871163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f4266-a45b-482b-b684-305d124410eb None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:35.883826 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e0d80-cf53-498a-8f44-881479d2d637 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:35.909882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea38fd5-1a5e-4eaa-8ade-5b8c4f1f86a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:35.910673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea38fd5-1a5e-4eaa-8ade-5b8c4f1f86a4 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.910953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea38fd5-1a5e-4eaa-8ade-5b8c4f1f86a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.911230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea38fd5-1a5e-4eaa-8ade-5b8c4f1f86a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.917169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59aad6-70b2-49bb-a43a-dc6135f42081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:35.917959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59aad6-70b2-49bb-a43a-dc6135f42081 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.918498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59aad6-70b2-49bb-a43a-dc6135f42081 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.918498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59aad6-70b2-49bb-a43a-dc6135f42081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.922319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea38fd5-1a5e-4eaa-8ade-5b8c4f1f86a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:35.923753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea38fd5-1a5e-4eaa-8ade-5b8c4f1f86a4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:35.929155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59aad6-70b2-49bb-a43a-dc6135f42081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:35.930573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59aad6-70b2-49bb-a43a-dc6135f42081 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-fea38fd5-1a5e-4eaa-8ade-5b8c4f1f86a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:35.941058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:35.941963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:35.947622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:35.947622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:35.947622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:35.947622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:35.947622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 313/637] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:35.947622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea38fd5-1a5e-4eaa-8ade-5b8c4f1f86a4 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-0e59aad6-70b2-49bb-a43a-dc6135f42081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:35.947959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:35.948787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:35.949941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:35.949941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:35.949941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:35.949941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:35.949941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 325/638] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:35.951446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67403bca-da5c-465e-840a-2750656717cb None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:35.951446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67403bca-da5c-465e-840a-2750656717cb None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:35.951446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67403bca-da5c-465e-840a-2750656717cb None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:35.954076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 326/639] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:35.955679 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67403bca-da5c-465e-840a-2750656717cb None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:36.047832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea38fd5-1a5e-4eaa-8ade-5b8c4f1f86a4 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:36.052063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67403bca-da5c-465e-840a-2750656717cb None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:36.081414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33db73-d57d-42c0-8c81-b4b697d45290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:36.082044 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33db73-d57d-42c0-8c81-b4b697d45290 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.082326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33db73-d57d-42c0-8c81-b4b697d45290 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.082597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33db73-d57d-42c0-8c81-b4b697d45290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.084701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939ef1f-52db-42ce-8948-956fd25cbcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:36.085356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939ef1f-52db-42ce-8948-956fd25cbcc9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.085640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939ef1f-52db-42ce-8948-956fd25cbcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.085923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939ef1f-52db-42ce-8948-956fd25cbcc9 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.086637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939ef1f-52db-42ce-8948-956fd25cbcc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:36.086941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939ef1f-52db-42ce-8948-956fd25cbcc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:36.088341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939ef1f-52db-42ce-8948-956fd25cbcc9 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:36.104052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 327/640] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:36.104052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939ef1f-52db-42ce-8948-956fd25cbcc9 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:36.164165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33db73-d57d-42c0-8c81-b4b697d45290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:36.165607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33db73-d57d-42c0-8c81-b4b697d45290 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:36.205560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939ef1f-52db-42ce-8948-956fd25cbcc9 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:36.247224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888e6b0-e634-4da1-9aef-50f92df3fbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:36.247893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888e6b0-e634-4da1-9aef-50f92df3fbcc None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.248202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888e6b0-e634-4da1-9aef-50f92df3fbcc None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.248470 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888e6b0-e634-4da1-9aef-50f92df3fbcc None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.249193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888e6b0-e634-4da1-9aef-50f92df3fbcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:36.249496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888e6b0-e634-4da1-9aef-50f92df3fbcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:36.250849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888e6b0-e634-4da1-9aef-50f92df3fbcc None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:36.263267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 328/641] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:36.264516 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eb54d-668b-45ba-b3a7-99940f82aa9a None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.264797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eb54d-668b-45ba-b3a7-99940f82aa9a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.265069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eb54d-668b-45ba-b3a7-99940f82aa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.274139 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 314/642] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:36.275194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33db73-d57d-42c0-8c81-b4b697d45290 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:36.281268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f66eb54d-668b-45ba-b3a7-99940f82aa9a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:36.282454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f66eb54d-668b-45ba-b3a7-99940f82aa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:36.360118 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 329/643] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:36.360118 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eb54d-668b-45ba-b3a7-99940f82aa9a None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:36.395506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33db73-d57d-42c0-8c81-b4b697d45290 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:36.433861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8a9cd-f629-43a5-a9ef-bebd0ab15784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:36.435112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a9cd-f629-43a5-a9ef-bebd0ab15784 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.435869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a9cd-f629-43a5-a9ef-bebd0ab15784 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.436645 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a9cd-f629-43a5-a9ef-bebd0ab15784 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.443434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eb54d-668b-45ba-b3a7-99940f82aa9a None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:36.446381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8a9cd-f629-43a5-a9ef-bebd0ab15784 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:36.448061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8a9cd-f629-43a5-a9ef-bebd0ab15784 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-4da8a9cd-f629-43a5-a9ef-bebd0ab15784 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:36.466237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:36.467283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:36.468642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:36.468642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:36.468642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:36.468642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:36.468642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:36.468642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:36.468642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:36.468642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:36.468642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 08:58:36.468642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:36.474581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 315/644] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:36.476423 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8a9cd-f629-43a5-a9ef-bebd0ab15784 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:36.479784 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde19e5-b002-4bde-ac64-4cee8c79dff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:36.480613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde19e5-b002-4bde-ac64-4cee8c79dff3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.480894 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde19e5-b002-4bde-ac64-4cee8c79dff3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.481168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde19e5-b002-4bde-ac64-4cee8c79dff3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.488213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde19e5-b002-4bde-ac64-4cee8c79dff3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:36.489663 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde19e5-b002-4bde-ac64-4cee8c79dff3 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-2dde19e5-b002-4bde-ac64-4cee8c79dff3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:36.505067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:36.506267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:36.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:36.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:36.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:36.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:36.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:36.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:36.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:36.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:36.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:58:36.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:36.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 330/645] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:36.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde19e5-b002-4bde-ac64-4cee8c79dff3 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:36.609280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8a9cd-f629-43a5-a9ef-bebd0ab15784 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:36.614602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde19e5-b002-4bde-ac64-4cee8c79dff3 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:36.642726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0746a9-1484-4bfa-9878-ca529c37ca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:36.643502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0746a9-1484-4bfa-9878-ca529c37ca01 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.643777 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0746a9-1484-4bfa-9878-ca529c37ca01 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.644043 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0746a9-1484-4bfa-9878-ca529c37ca01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.647492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299d39a-8b54-4a05-8631-4641e07b9f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:36.648303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299d39a-8b54-4a05-8631-4641e07b9f53 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.648577 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299d39a-8b54-4a05-8631-4641e07b9f53 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.648842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299d39a-8b54-4a05-8631-4641e07b9f53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.654276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0746a9-1484-4bfa-9878-ca529c37ca01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:36.655721 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0746a9-1484-4bfa-9878-ca529c37ca01 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:36.658628 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299d39a-8b54-4a05-8631-4641e07b9f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-7299d39a-8b54-4a05-8631-4641e07b9f53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:36.666409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:36.667342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:36.668213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:36.668213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:36.668213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:36.668213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:36.668213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:36.668213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:36.668213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:36.668213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:36.668213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:36.668213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:36.668213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:36.668213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:36.672521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 331/646] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:36.673345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299d39a-8b54-4a05-8631-4641e07b9f53 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-1e0746a9-1484-4bfa-9878-ca529c37ca01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:36.674243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:36.675079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:36.675969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:36.675969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:36.675969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:36.675969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:36.675969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 316/647] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:36.676689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0746a9-1484-4bfa-9878-ca529c37ca01 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:36.770064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0746a9-1484-4bfa-9878-ca529c37ca01 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:36.770989 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299d39a-8b54-4a05-8631-4641e07b9f53 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:36.802383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827561e-f5fa-4cd3-9107-03105e8422f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:36.802719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bec25-ce9b-4a44-b457-01c15ca68fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:36.803073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827561e-f5fa-4cd3-9107-03105e8422f2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.803353 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827561e-f5fa-4cd3-9107-03105e8422f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.803452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bec25-ce9b-4a44-b457-01c15ca68fb9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.803621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827561e-f5fa-4cd3-9107-03105e8422f2 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.803719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bec25-ce9b-4a44-b457-01c15ca68fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.803898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bec25-ce9b-4a44-b457-01c15ca68fb9 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.804476 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827561e-f5fa-4cd3-9107-03105e8422f2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:36.804756 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bec25-ce9b-4a44-b457-01c15ca68fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:36.804850 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827561e-f5fa-4cd3-9107-03105e8422f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:36.805061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bec25-ce9b-4a44-b457-01c15ca68fb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:36.806173 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827561e-f5fa-4cd3-9107-03105e8422f2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:36.806447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bec25-ce9b-4a44-b457-01c15ca68fb9 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:36.827888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 317/648] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 3 08:58:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:36.827888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827561e-f5fa-4cd3-9107-03105e8422f2 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:36.828649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 332/649] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 3 08:58:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:36.828649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bec25-ce9b-4a44-b457-01c15ca68fb9 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:36.924798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bec25-ce9b-4a44-b457-01c15ca68fb9 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:36.930802 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827561e-f5fa-4cd3-9107-03105e8422f2 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:36.957223 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcd91e-bd5f-49eb-8f47-a45d984d77be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:36.957871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd91e-bd5f-49eb-8f47-a45d984d77be None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.958147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd91e-bd5f-49eb-8f47-a45d984d77be None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.958408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd91e-bd5f-49eb-8f47-a45d984d77be None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.959177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd91e-bd5f-49eb-8f47-a45d984d77be None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:36.959972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd91e-bd5f-49eb-8f47-a45d984d77be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:36.961339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd91e-bd5f-49eb-8f47-a45d984d77be None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:36.964439 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910812a-9c90-47ba-bbbb-a8c85ae09505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:36.965097 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910812a-9c90-47ba-bbbb-a8c85ae09505 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:36.965381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910812a-9c90-47ba-bbbb-a8c85ae09505 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:36.965655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910812a-9c90-47ba-bbbb-a8c85ae09505 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:36.966407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910812a-9c90-47ba-bbbb-a8c85ae09505 None admin] RBAC: Adding query filter params (name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:36.966697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910812a-9c90-47ba-bbbb-a8c85ae09505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:36.968044 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910812a-9c90-47ba-bbbb-a8c85ae09505 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:36.972150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 333/650] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:36.972937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcd91e-bd5f-49eb-8f47-a45d984d77be None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:36.980779 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 318/651] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:36.980779 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910812a-9c90-47ba-bbbb-a8c85ae09505 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:37.072177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcd91e-bd5f-49eb-8f47-a45d984d77be None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:37.074979 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910812a-9c90-47ba-bbbb-a8c85ae09505 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:37.104662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773482e6-6924-4343-865e-de00d4528b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:37.105308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773482e6-6924-4343-865e-de00d4528b27 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:37.105590 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773482e6-6924-4343-865e-de00d4528b27 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:37.105863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773482e6-6924-4343-865e-de00d4528b27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:37.107520 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aa333-5e90-42e3-81b3-db65be34c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:37.108177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aa333-5e90-42e3-81b3-db65be34c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:37.108458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aa333-5e90-42e3-81b3-db65be34c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:37.108729 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aa333-5e90-42e3-81b3-db65be34c6d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:37.170820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773482e6-6924-4343-865e-de00d4528b27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:37.172317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773482e6-6924-4343-865e-de00d4528b27 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:37.174748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05aa333-5e90-42e3-81b3-db65be34c6d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:37.176254 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05aa333-5e90-42e3-81b3-db65be34c6d6 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:37.283701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 334/652] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:37.283701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773482e6-6924-4343-865e-de00d4528b27 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:37.283976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 319/653] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:37.283976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aa333-5e90-42e3-81b3-db65be34c6d6 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:37.380983 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773482e6-6924-4343-865e-de00d4528b27 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:37.385161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aa333-5e90-42e3-81b3-db65be34c6d6 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:37.411326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf0c81-6344-4565-b846-5fc3f9149adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:37.412116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf0c81-6344-4565-b846-5fc3f9149adb None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:37.412973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf0c81-6344-4565-b846-5fc3f9149adb None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:37.413233 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf0c81-6344-4565-b846-5fc3f9149adb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:37.416775 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a6f87-392b-4476-bc28-b05e73b25428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:37.417556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6f87-392b-4476-bc28-b05e73b25428 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:37.417835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6f87-392b-4476-bc28-b05e73b25428 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:37.418105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6f87-392b-4476-bc28-b05e73b25428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:37.419528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf0c81-6344-4565-b846-5fc3f9149adb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:37.421001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf0c81-6344-4565-b846-5fc3f9149adb None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:37.427600 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a6f87-392b-4476-bc28-b05e73b25428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:37.429669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a6f87-392b-4476-bc28-b05e73b25428 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-8ecf0c81-6344-4565-b846-5fc3f9149adb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:37.434863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:37.435904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:37.437187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:37.437187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:37.437187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:37.437187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:37.437187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:37.437187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:37.437187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:37.437187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:37.437187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 335/654] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:37.437187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf0c81-6344-4565-b846-5fc3f9149adb None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-6a3a6f87-392b-4476-bc28-b05e73b25428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:37.448545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:37.449836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:37.450725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:37.450725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:37.450725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:37.450725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:37.450725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 320/655] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:37.451003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a6f87-392b-4476-bc28-b05e73b25428 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:37.528749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf0c81-6344-4565-b846-5fc3f9149adb None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:37.542147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a6f87-392b-4476-bc28-b05e73b25428 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:37.560101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b180a-08d0-4539-9616-edd50b6cd8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:37.560888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b180a-08d0-4539-9616-edd50b6cd8dd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:37.561159 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b180a-08d0-4539-9616-edd50b6cd8dd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:37.561426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b180a-08d0-4539-9616-edd50b6cd8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:37.571187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b180a-08d0-4539-9616-edd50b6cd8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:37.572630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b180a-08d0-4539-9616-edd50b6cd8dd None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:37.573890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76eb1a-2362-4312-af7b-d8856aed9031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:37.574917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76eb1a-2362-4312-af7b-d8856aed9031 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:37.575191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76eb1a-2362-4312-af7b-d8856aed9031 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:37.575463 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76eb1a-2362-4312-af7b-d8856aed9031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:37.584792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76eb1a-2362-4312-af7b-d8856aed9031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:37.586188 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76eb1a-2362-4312-af7b-d8856aed9031 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-de7b180a-08d0-4539-9616-edd50b6cd8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:37.588956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:37.589809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:37.590684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:37.590684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:37.590684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:37.590684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:37.590684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 336/656] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:37.591334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59101e63-6726-4bb5-bf95-0a8d69932038 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:37.591617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59101e63-6726-4bb5-bf95-0a8d69932038 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:37.591884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59101e63-6726-4bb5-bf95-0a8d69932038 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:37.594942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 337/657] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:37.594942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59101e63-6726-4bb5-bf95-0a8d69932038 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-df76eb1a-2362-4312-af7b-d8856aed9031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:37.603808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:37.604753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:37.605624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:37.605624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:37.605624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:37.605624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:37.605624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 321/658] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:37.605892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76eb1a-2362-4312-af7b-d8856aed9031 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:37.691744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59101e63-6726-4bb5-bf95-0a8d69932038 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:37.698603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76eb1a-2362-4312-af7b-d8856aed9031 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:37.722224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f10f3-58bd-4438-b614-849035053f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:37.722882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f10f3-58bd-4438-b614-849035053f56 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:37.723157 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f10f3-58bd-4438-b614-849035053f56 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:37.723423 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f10f3-58bd-4438-b614-849035053f56 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:37.724210 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f10f3-58bd-4438-b614-849035053f56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:37.724511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f10f3-58bd-4438-b614-849035053f56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:37.726476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f10f3-58bd-4438-b614-849035053f56 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:37.731104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4dbf-bf4a-4b4c-ac6e-5789ce38106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:37.731733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4dbf-bf4a-4b4c-ac6e-5789ce38106e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:37.732010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4dbf-bf4a-4b4c-ac6e-5789ce38106e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:37.732306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4dbf-bf4a-4b4c-ac6e-5789ce38106e None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:37.733020 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e4dbf-bf4a-4b4c-ac6e-5789ce38106e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:37.733313 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e4dbf-bf4a-4b4c-ac6e-5789ce38106e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:37.734634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e4dbf-bf4a-4b4c-ac6e-5789ce38106e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:37.737743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 338/659] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:37.738492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f10f3-58bd-4438-b614-849035053f56 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:37.750016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 322/660] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:37.750016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4b74e-b23f-4cce-baed-2e62014bbc85 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:37.750016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4b74e-b23f-4cce-baed-2e62014bbc85 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:37.750016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4b74e-b23f-4cce-baed-2e62014bbc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:37.763664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-40e4b74e-b23f-4cce-baed-2e62014bbc85 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:37.764868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-40e4b74e-b23f-4cce-baed-2e62014bbc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:37.826736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 323/661] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:37.827528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4b74e-b23f-4cce-baed-2e62014bbc85 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:37.829940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f10f3-58bd-4438-b614-849035053f56 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:37.862446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ab4ef-b3b8-4dba-90c4-cb9b95aa99cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:37.863097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ab4ef-b3b8-4dba-90c4-cb9b95aa99cd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:37.863368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ab4ef-b3b8-4dba-90c4-cb9b95aa99cd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:37.863633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ab4ef-b3b8-4dba-90c4-cb9b95aa99cd None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:37.864377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ab4ef-b3b8-4dba-90c4-cb9b95aa99cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:37.864676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ab4ef-b3b8-4dba-90c4-cb9b95aa99cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:37.866053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ab4ef-b3b8-4dba-90c4-cb9b95aa99cd None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:37.876426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 339/662] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:37.877181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ab4ef-b3b8-4dba-90c4-cb9b95aa99cd None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:37.926279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4b74e-b23f-4cce-baed-2e62014bbc85 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:37.958495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e26b9-bb21-4815-ab11-cc8bec871e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:37.959571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e26b9-bb21-4815-ab11-cc8bec871e6b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:37.959848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e26b9-bb21-4815-ab11-cc8bec871e6b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:37.960143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e26b9-bb21-4815-ab11-cc8bec871e6b None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:37.960854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e26b9-bb21-4815-ab11-cc8bec871e6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:37.961153 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e26b9-bb21-4815-ab11-cc8bec871e6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:37.962522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e26b9-bb21-4815-ab11-cc8bec871e6b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:37.973295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 324/663] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:37.974082 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e26b9-bb21-4815-ab11-cc8bec871e6b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:37.985466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ab4ef-b3b8-4dba-90c4-cb9b95aa99cd None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:38.015808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7959e8-83d0-47a8-8b75-e0a77ba83d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:38.016489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7959e8-83d0-47a8-8b75-e0a77ba83d0a None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:38.016765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7959e8-83d0-47a8-8b75-e0a77ba83d0a None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:38.017035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7959e8-83d0-47a8-8b75-e0a77ba83d0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:38.017849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7959e8-83d0-47a8-8b75-e0a77ba83d0a None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=2b863628035e4767b08fb5efc5c80958) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:38.018157 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7959e8-83d0-47a8-8b75-e0a77ba83d0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:38.019561 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7959e8-83d0-47a8-8b75-e0a77ba83d0a None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:38.025582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 340/664] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:37 2022] GET /identity/v3/role_assignments?user.id=2b863628035e4767b08fb5efc5c80958&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:38.026335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7959e8-83d0-47a8-8b75-e0a77ba83d0a None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:38.071626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e26b9-bb21-4815-ab11-cc8bec871e6b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:38.107029 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef2d7e-8aa7-41bc-855b-caf62fd97876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:38.107942 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef2d7e-8aa7-41bc-855b-caf62fd97876 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:38.108249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef2d7e-8aa7-41bc-855b-caf62fd97876 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:38.108515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef2d7e-8aa7-41bc-855b-caf62fd97876 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:38.117563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef2d7e-8aa7-41bc-855b-caf62fd97876 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:38.119036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef2d7e-8aa7-41bc-855b-caf62fd97876 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:38.129538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7959e8-83d0-47a8-8b75-e0a77ba83d0a None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-75ef2d7e-8aa7-41bc-855b-caf62fd97876 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:38.134377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:38.135326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:38.136286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:38.136286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:38.136286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:38.136286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:38.136286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:38.136286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:38.136286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:38.136286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:38.136286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 08:58:38.136286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:38.140502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 325/665] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:38.141234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef2d7e-8aa7-41bc-855b-caf62fd97876 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:38.171369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17a736-0ce6-47ec-96f6-c06976f6f114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:38.172204 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17a736-0ce6-47ec-96f6-c06976f6f114 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:38.172488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17a736-0ce6-47ec-96f6-c06976f6f114 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:38.172767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17a736-0ce6-47ec-96f6-c06976f6f114 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:38.183452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17a736-0ce6-47ec-96f6-c06976f6f114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-bd17a736-0ce6-47ec-96f6-c06976f6f114 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:38.191434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:38.192469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:38.193308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 341/666] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:38.194566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17a736-0ce6-47ec-96f6-c06976f6f114 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:38.262738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef2d7e-8aa7-41bc-855b-caf62fd97876 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:38.309091 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabc07c-c474-4f0d-9d2b-311a4a3c84ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:38.309297 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17a736-0ce6-47ec-96f6-c06976f6f114 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:38.310359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabc07c-c474-4f0d-9d2b-311a4a3c84ae None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:38.310853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabc07c-c474-4f0d-9d2b-311a4a3c84ae None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:38.311330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabc07c-c474-4f0d-9d2b-311a4a3c84ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:38.317905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabc07c-c474-4f0d-9d2b-311a4a3c84ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:38.319347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabc07c-c474-4f0d-9d2b-311a4a3c84ae None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-5fabc07c-c474-4f0d-9d2b-311a4a3c84ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:38.333579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:38.334481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:38.335764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:38.335764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:38.335764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:38.335764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:38.335764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:38.335764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:38.335764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:38.335764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:38.335764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 326/667] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:38.335764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabc07c-c474-4f0d-9d2b-311a4a3c84ae None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:38.347070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af577b-5b8f-43a1-b552-ee9f1ebaa99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:38.347867 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af577b-5b8f-43a1-b552-ee9f1ebaa99f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:38.348180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af577b-5b8f-43a1-b552-ee9f1ebaa99f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:38.348455 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af577b-5b8f-43a1-b552-ee9f1ebaa99f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:38.355756 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af577b-5b8f-43a1-b552-ee9f1ebaa99f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:38.357230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af577b-5b8f-43a1-b552-ee9f1ebaa99f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-e3af577b-5b8f-43a1-b552-ee9f1ebaa99f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:38.371591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:38.372616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:38.373486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:38.373486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:38.373486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:38.373486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:38.373486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:38.373486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:38.373486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:38.373486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:38.373486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 342/668] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:38.373981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af577b-5b8f-43a1-b552-ee9f1ebaa99f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:38.438274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabc07c-c474-4f0d-9d2b-311a4a3c84ae None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:38.469129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af577b-5b8f-43a1-b552-ee9f1ebaa99f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:38.471531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390e3f8-2bcd-41f0-8841-c5930b0392e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:38.472221 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390e3f8-2bcd-41f0-8841-c5930b0392e4 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:38.472499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390e3f8-2bcd-41f0-8841-c5930b0392e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:38.472766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390e3f8-2bcd-41f0-8841-c5930b0392e4 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:38.473589 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390e3f8-2bcd-41f0-8841-c5930b0392e4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:38.473892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390e3f8-2bcd-41f0-8841-c5930b0392e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:38.475919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390e3f8-2bcd-41f0-8841-c5930b0392e4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:38.497096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 327/669] 10.222.0.23 () {56 vars in 1139 bytes} [Tue May 3 08:58:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:38.497096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390e3f8-2bcd-41f0-8841-c5930b0392e4 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:38.507939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c02c7-86e2-40e7-8ce7-b06838fe7a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:38.508633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c02c7-86e2-40e7-8ce7-b06838fe7a18 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:38.508914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c02c7-86e2-40e7-8ce7-b06838fe7a18 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:38.509193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c02c7-86e2-40e7-8ce7-b06838fe7a18 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:38.509939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c02c7-86e2-40e7-8ce7-b06838fe7a18 None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:38.510245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c02c7-86e2-40e7-8ce7-b06838fe7a18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:38.511607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c02c7-86e2-40e7-8ce7-b06838fe7a18 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:38.520558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 343/670] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:38.521347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c02c7-86e2-40e7-8ce7-b06838fe7a18 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:38.600571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390e3f8-2bcd-41f0-8841-c5930b0392e4 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:38.621984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c02c7-86e2-40e7-8ce7-b06838fe7a18 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:38.636899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348c58d-fb5a-4998-9fd8-b2c25415b1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:38.637844 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348c58d-fb5a-4998-9fd8-b2c25415b1ec None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:38.638133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348c58d-fb5a-4998-9fd8-b2c25415b1ec None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:38.638407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348c58d-fb5a-4998-9fd8-b2c25415b1ec None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:38.639186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348c58d-fb5a-4998-9fd8-b2c25415b1ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:38.639495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348c58d-fb5a-4998-9fd8-b2c25415b1ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:38.641608 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348c58d-fb5a-4998-9fd8-b2c25415b1ec None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:38.653570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dbd5f-3efb-4155-af7f-f476a8623992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:38.654218 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dbd5f-3efb-4155-af7f-f476a8623992 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:38.654498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dbd5f-3efb-4155-af7f-f476a8623992 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:38.654770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dbd5f-3efb-4155-af7f-f476a8623992 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:38.655541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dbd5f-3efb-4155-af7f-f476a8623992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:38.655710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 328/671] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:38.656479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348c58d-fb5a-4998-9fd8-b2c25415b1ec None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:38.660597 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dbd5f-3efb-4155-af7f-f476a8623992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:38.662038 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dbd5f-3efb-4155-af7f-f476a8623992 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:38.679488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 344/672] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:38.679488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dbd5f-3efb-4155-af7f-f476a8623992 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:38.752446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348c58d-fb5a-4998-9fd8-b2c25415b1ec None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:38.771217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dbd5f-3efb-4155-af7f-f476a8623992 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:38.785381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336030c-d959-47a3-bb06-00df832b109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:38.786032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336030c-d959-47a3-bb06-00df832b109c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:38.786308 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336030c-d959-47a3-bb06-00df832b109c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:38.786579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336030c-d959-47a3-bb06-00df832b109c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:38.805410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d4017-8cf2-4834-8c33-c4c309f49ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:38.806195 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d4017-8cf2-4834-8c33-c4c309f49ea8 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:38.806467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d4017-8cf2-4834-8c33-c4c309f49ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:38.806733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d4017-8cf2-4834-8c33-c4c309f49ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:38.816349 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d4017-8cf2-4834-8c33-c4c309f49ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:38.817765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d4017-8cf2-4834-8c33-c4c309f49ea8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-897d4017-8cf2-4834-8c33-c4c309f49ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:38.834988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:38.835877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:38.836847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:38.836847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:38.836847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:38.836847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:38.836847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 345/673] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:38.837536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d4017-8cf2-4834-8c33-c4c309f49ea8 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:38.855578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336030c-d959-47a3-bb06-00df832b109c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:38.857059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336030c-d959-47a3-bb06-00df832b109c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:38.938433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d4017-8cf2-4834-8c33-c4c309f49ea8 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:38.956477 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 329/674] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:38.956477 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336030c-d959-47a3-bb06-00df832b109c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:38.978232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154e539-c218-48c1-b8d7-bcd1c6bc95bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:38.978880 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e539-c218-48c1-b8d7-bcd1c6bc95bc None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:38.979168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e539-c218-48c1-b8d7-bcd1c6bc95bc None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:38.979441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e539-c218-48c1-b8d7-bcd1c6bc95bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:38.980290 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154e539-c218-48c1-b8d7-bcd1c6bc95bc None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=17e1e2dc0a0a45f4a36d1369edcc6e5b) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:38.980604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154e539-c218-48c1-b8d7-bcd1c6bc95bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:38.982007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154e539-c218-48c1-b8d7-bcd1c6bc95bc None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:38.996113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 346/675] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:38 2022] GET /identity/v3/role_assignments?user.id=17e1e2dc0a0a45f4a36d1369edcc6e5b&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:38.996113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154e539-c218-48c1-b8d7-bcd1c6bc95bc None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:39.051760 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336030c-d959-47a3-bb06-00df832b109c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:39.089154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d68991-9247-4856-8176-b7f10200d610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:39.089911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d68991-9247-4856-8176-b7f10200d610 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:39.090263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d68991-9247-4856-8176-b7f10200d610 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:39.090536 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d68991-9247-4856-8176-b7f10200d610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:39.091387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d68991-9247-4856-8176-b7f10200d610 None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=1848679bce324613b4a92de808165ba8) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:39.091711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d68991-9247-4856-8176-b7f10200d610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:39.093263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d68991-9247-4856-8176-b7f10200d610 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:39.099710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 330/676] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:38 2022] GET /identity/v3/role_assignments?user.id=1848679bce324613b4a92de808165ba8&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:39.100154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154e539-c218-48c1-b8d7-bcd1c6bc95bc None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:39.109185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d68991-9247-4856-8176-b7f10200d610 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:39.165571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e3b05-7f93-4ee4-88d3-41005eda3871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:39.167082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e3b05-7f93-4ee4-88d3-41005eda3871 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:39.167870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e3b05-7f93-4ee4-88d3-41005eda3871 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:39.168771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e3b05-7f93-4ee4-88d3-41005eda3871 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:39.172240 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e3b05-7f93-4ee4-88d3-41005eda3871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:39.173152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e3b05-7f93-4ee4-88d3-41005eda3871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:39.176027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e3b05-7f93-4ee4-88d3-41005eda3871 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:39.201174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 347/677] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:39.207009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e3b05-7f93-4ee4-88d3-41005eda3871 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:39.300576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d68991-9247-4856-8176-b7f10200d610 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:39.350461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bf2bc-d109-4d55-805f-492f56f01930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:39.351543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bf2bc-d109-4d55-805f-492f56f01930 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:39.352017 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bf2bc-d109-4d55-805f-492f56f01930 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:39.352529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bf2bc-d109-4d55-805f-492f56f01930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:39.358255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e3b05-7f93-4ee4-88d3-41005eda3871 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:39.364671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bf2bc-d109-4d55-805f-492f56f01930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:39.366716 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bf2bc-d109-4d55-805f-492f56f01930 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-6d6bf2bc-d109-4d55-805f-492f56f01930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:39.389045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:39.390190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:39.391320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:39.391320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:39.391320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:39.391320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:39.391320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 331/678] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:39.397390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bf2bc-d109-4d55-805f-492f56f01930 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:39.399121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f167689-c6b9-40df-b3d5-136ee6ed6712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:39.399914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f167689-c6b9-40df-b3d5-136ee6ed6712 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:39.400233 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f167689-c6b9-40df-b3d5-136ee6ed6712 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:39.400503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f167689-c6b9-40df-b3d5-136ee6ed6712 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:39.407712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f167689-c6b9-40df-b3d5-136ee6ed6712 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:39.409169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f167689-c6b9-40df-b3d5-136ee6ed6712 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-0f167689-c6b9-40df-b3d5-136ee6ed6712 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:39.423772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:39.425051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:39.426130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:39.426130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:39.426130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:39.426130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:39.426130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:39.426130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:39.426130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:39.426130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:39.426130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 08:58:39.426130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:39.426130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 348/679] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:39.431284 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f167689-c6b9-40df-b3d5-136ee6ed6712 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:39.501880 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bf2bc-d109-4d55-805f-492f56f01930 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:39.529169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f167689-c6b9-40df-b3d5-136ee6ed6712 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:39.536898 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5ba4a-be96-41f1-905f-77bd937178cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:39.537781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5ba4a-be96-41f1-905f-77bd937178cd None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:39.538235 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5ba4a-be96-41f1-905f-77bd937178cd None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:39.538652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5ba4a-be96-41f1-905f-77bd937178cd None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:39.539518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5ba4a-be96-41f1-905f-77bd937178cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:39.539969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5ba4a-be96-41f1-905f-77bd937178cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:39.541540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5ba4a-be96-41f1-905f-77bd937178cd None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:39.555273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 332/680] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:39.560749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5ba4a-be96-41f1-905f-77bd937178cd None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:39.563186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fb1e1-ad08-452b-b8a9-3c1ce190a6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:39.563856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fb1e1-ad08-452b-b8a9-3c1ce190a6ea None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:39.564181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fb1e1-ad08-452b-b8a9-3c1ce190a6ea None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:39.564456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fb1e1-ad08-452b-b8a9-3c1ce190a6ea None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:39.565730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fb1e1-ad08-452b-b8a9-3c1ce190a6ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:39.565730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fb1e1-ad08-452b-b8a9-3c1ce190a6ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:39.566974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fb1e1-ad08-452b-b8a9-3c1ce190a6ea None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:39.585281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 349/681] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 3 08:58:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:39.590606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fb1e1-ad08-452b-b8a9-3c1ce190a6ea None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:39.663083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5ba4a-be96-41f1-905f-77bd937178cd None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:39.687181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fb1e1-ad08-452b-b8a9-3c1ce190a6ea None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:39.699164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc88537-4270-4f01-aec7-e3255fa14d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:39.700557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc88537-4270-4f01-aec7-e3255fa14d94 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:39.701086 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc88537-4270-4f01-aec7-e3255fa14d94 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:39.701534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc88537-4270-4f01-aec7-e3255fa14d94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:39.708653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc88537-4270-4f01-aec7-e3255fa14d94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:39.710332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc88537-4270-4f01-aec7-e3255fa14d94 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:39.720403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76427e67-854b-4f86-9a19-323674a64113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:39.721040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76427e67-854b-4f86-9a19-323674a64113 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:39.721323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76427e67-854b-4f86-9a19-323674a64113 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:39.721583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76427e67-854b-4f86-9a19-323674a64113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-1dc88537-4270-4f01-aec7-e3255fa14d94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:39.726258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:39.727143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:39.728021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:39.728021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:39.728021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:39.728021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:39.728021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:39.728021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:39.728021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:39.728021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:39.730275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 333/682] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:39.735818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc88537-4270-4f01-aec7-e3255fa14d94 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:39.789257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76427e67-854b-4f86-9a19-323674a64113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:39.790697 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76427e67-854b-4f86-9a19-323674a64113 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:39.836047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc88537-4270-4f01-aec7-e3255fa14d94 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:39.878192 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57aeed4-8b7c-4fa0-aaa9-d932d193ff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:39.879105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57aeed4-8b7c-4fa0-aaa9-d932d193ff93 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:39.879535 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57aeed4-8b7c-4fa0-aaa9-d932d193ff93 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:39.879971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57aeed4-8b7c-4fa0-aaa9-d932d193ff93 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:39.880965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57aeed4-8b7c-4fa0-aaa9-d932d193ff93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:39.881419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57aeed4-8b7c-4fa0-aaa9-d932d193ff93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:39.882994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57aeed4-8b7c-4fa0-aaa9-d932d193ff93 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:39.892109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 350/683] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 08:58:39.892282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76427e67-854b-4f86-9a19-323674a64113 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:39.908546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 334/684] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:39.915201 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57aeed4-8b7c-4fa0-aaa9-d932d193ff93 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:39.988563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76427e67-854b-4f86-9a19-323674a64113 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:40.014452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57aeed4-8b7c-4fa0-aaa9-d932d193ff93 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:40.022308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38ef4a-46b9-40a4-a476-347f4c529c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:40.023216 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38ef4a-46b9-40a4-a476-347f4c529c6d None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:40.023366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38ef4a-46b9-40a4-a476-347f4c529c6d None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:40.023634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38ef4a-46b9-40a4-a476-347f4c529c6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:40.041323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38ef4a-46b9-40a4-a476-347f4c529c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:40.042832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38ef4a-46b9-40a4-a476-347f4c529c6d None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:40.051078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9c69e-98c1-4779-9bbe-c55146ad340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:40.052076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9c69e-98c1-4779-9bbe-c55146ad340f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:40.052586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9c69e-98c1-4779-9bbe-c55146ad340f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:40.053089 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9c69e-98c1-4779-9bbe-c55146ad340f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:40.054119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9c69e-98c1-4779-9bbe-c55146ad340f None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=418178b7e70f47d291e239a1297ccf0a) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:40.054689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9c69e-98c1-4779-9bbe-c55146ad340f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:40.056320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9c69e-98c1-4779-9bbe-c55146ad340f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-7e38ef4a-46b9-40a4-a476-347f4c529c6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:40.060639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:40.061513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:40.062382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:40.062382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:40.062382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:40.062382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:40.062382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 351/685] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:40.065437 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 335/686] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:39 2022] GET /identity/v3/role_assignments?user.id=418178b7e70f47d291e239a1297ccf0a&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:40.072245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38ef4a-46b9-40a4-a476-347f4c529c6d None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:40.172527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38ef4a-46b9-40a4-a476-347f4c529c6d None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:40.223003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c604c47-f74f-4cce-8546-a6a76ccdb7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:40.223003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604c47-f74f-4cce-8546-a6a76ccdb7ab None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:40.223003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604c47-f74f-4cce-8546-a6a76ccdb7ab None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:40.223003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604c47-f74f-4cce-8546-a6a76ccdb7ab None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:40.223406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c604c47-f74f-4cce-8546-a6a76ccdb7ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:40.223406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c604c47-f74f-4cce-8546-a6a76ccdb7ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:40.224443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c604c47-f74f-4cce-8546-a6a76ccdb7ab None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:40.245662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 352/687] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:40.250898 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9c69e-98c1-4779-9bbe-c55146ad340f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:40.375167 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9c69e-98c1-4779-9bbe-c55146ad340f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:40.410445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d0e5-5475-4c0f-8885-059e99427ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:40.411679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d0e5-5475-4c0f-8885-059e99427ac2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:40.412766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d0e5-5475-4c0f-8885-059e99427ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:40.413253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d0e5-5475-4c0f-8885-059e99427ac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:40.421634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6d0e5-5475-4c0f-8885-059e99427ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:40.423558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6d0e5-5475-4c0f-8885-059e99427ac2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-85b6d0e5-5475-4c0f-8885-059e99427ac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:40.440253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:40.441189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:40.442151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:40.442151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:40.442151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:40.442151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:40.442151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:40.442151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:40.442151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:40.442151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:40.444817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 336/688] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:40.450625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c604c47-f74f-4cce-8546-a6a76ccdb7ab None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:40.558144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c604c47-f74f-4cce-8546-a6a76ccdb7ab None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:40.591725 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f8a84-d55e-4db9-a098-3bdadb14258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:40.592415 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f8a84-d55e-4db9-a098-3bdadb14258c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:40.592691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f8a84-d55e-4db9-a098-3bdadb14258c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:40.592960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f8a84-d55e-4db9-a098-3bdadb14258c None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:40.593738 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f8a84-d55e-4db9-a098-3bdadb14258c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:40.594041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f8a84-d55e-4db9-a098-3bdadb14258c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:40.595444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f8a84-d55e-4db9-a098-3bdadb14258c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:40.612198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 353/689] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:40.613957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d0e5-5475-4c0f-8885-059e99427ac2 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:40.616387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6595ce-6aca-4da8-8091-12367cf748b8 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:40.616680 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6595ce-6aca-4da8-8091-12367cf748b8 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:40.616957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6595ce-6aca-4da8-8091-12367cf748b8 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:40.618279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 354/690] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:40.623279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342bac9-3894-48ac-8438-6aabbccb3496 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:40.623572 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342bac9-3894-48ac-8438-6aabbccb3496 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:40.623853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342bac9-3894-48ac-8438-6aabbccb3496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:40.643886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-a342bac9-3894-48ac-8438-6aabbccb3496 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:40.645136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a342bac9-3894-48ac-8438-6aabbccb3496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:40.744498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 355/691] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:58:40.747684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d0e5-5475-4c0f-8885-059e99427ac2 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:40.781190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79feff4-9809-4950-b821-c36f70c6d5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:40.781834 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79feff4-9809-4950-b821-c36f70c6d5c0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:40.782108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79feff4-9809-4950-b821-c36f70c6d5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:40.782376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79feff4-9809-4950-b821-c36f70c6d5c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:40.783202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79feff4-9809-4950-b821-c36f70c6d5c0 None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=2360e3a110b042a8839c45aa50a39724) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:40.783499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79feff4-9809-4950-b821-c36f70c6d5c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:40.784953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79feff4-9809-4950-b821-c36f70c6d5c0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:40.791996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342bac9-3894-48ac-8438-6aabbccb3496 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:40.802576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 337/692] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:40 2022] GET /identity/v3/role_assignments?user.id=2360e3a110b042a8839c45aa50a39724&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:40.894891 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342bac9-3894-48ac-8438-6aabbccb3496 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:40.933050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38343d-4ca8-4ef9-b0bd-f335a788ead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:40.933871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38343d-4ca8-4ef9-b0bd-f335a788ead7 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:40.934147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38343d-4ca8-4ef9-b0bd-f335a788ead7 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:40.934415 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38343d-4ca8-4ef9-b0bd-f335a788ead7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:40.946404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38343d-4ca8-4ef9-b0bd-f335a788ead7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-1d38343d-4ca8-4ef9-b0bd-f335a788ead7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:40.954776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:40.955797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:40.956684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:40.956684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:40.956684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:40.956684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:40.956684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:40.956684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:40.956684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:40.956684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:40.956684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:40.956684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:40.956684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:40.956684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:40.957365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 356/693] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:40.967424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79feff4-9809-4950-b821-c36f70c6d5c0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:41.093765 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79feff4-9809-4950-b821-c36f70c6d5c0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:41.134302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb39cbb-9da5-4f8b-a746-9d8fbe9db21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:41.134960 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb39cbb-9da5-4f8b-a746-9d8fbe9db21e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:41.135235 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb39cbb-9da5-4f8b-a746-9d8fbe9db21e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:41.135501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb39cbb-9da5-4f8b-a746-9d8fbe9db21e None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:41.136297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb39cbb-9da5-4f8b-a746-9d8fbe9db21e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:41.136596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb39cbb-9da5-4f8b-a746-9d8fbe9db21e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:41.137941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb39cbb-9da5-4f8b-a746-9d8fbe9db21e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:41.147623 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 338/694] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:41.153049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38343d-4ca8-4ef9-b0bd-f335a788ead7 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:41.257945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38343d-4ca8-4ef9-b0bd-f335a788ead7 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:41.291203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9844f-cbbb-4156-aa13-3248de0bdf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:41.292004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9844f-cbbb-4156-aa13-3248de0bdf09 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:41.292307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9844f-cbbb-4156-aa13-3248de0bdf09 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:41.292575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9844f-cbbb-4156-aa13-3248de0bdf09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:41.304850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9844f-cbbb-4156-aa13-3248de0bdf09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:41.306314 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9844f-cbbb-4156-aa13-3248de0bdf09 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-76a9844f-cbbb-4156-aa13-3248de0bdf09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:41.324167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:41.325359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:41.326237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:41.326237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:41.326237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:41.326237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:41.326237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 357/695] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:41.332865 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb39cbb-9da5-4f8b-a746-9d8fbe9db21e None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:41.449297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb39cbb-9da5-4f8b-a746-9d8fbe9db21e None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:41.507796 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ad8b0-c14f-4dec-a5b1-f06107292be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:41.508499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ad8b0-c14f-4dec-a5b1-f06107292be5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:41.508784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ad8b0-c14f-4dec-a5b1-f06107292be5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:41.509059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ad8b0-c14f-4dec-a5b1-f06107292be5 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:41.509786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ad8b0-c14f-4dec-a5b1-f06107292be5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:41.510091 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ad8b0-c14f-4dec-a5b1-f06107292be5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:41.511461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ad8b0-c14f-4dec-a5b1-f06107292be5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:41.530615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 339/696] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:41.536121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9844f-cbbb-4156-aa13-3248de0bdf09 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:41.713462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9844f-cbbb-4156-aa13-3248de0bdf09 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:41.760648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd440b-9ccf-4e75-b209-f081cf9f2598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:41.761447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd440b-9ccf-4e75-b209-f081cf9f2598 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:41.761731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd440b-9ccf-4e75-b209-f081cf9f2598 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:41.762008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd440b-9ccf-4e75-b209-f081cf9f2598 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:41.775971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd440b-9ccf-4e75-b209-f081cf9f2598 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:41.777445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd440b-9ccf-4e75-b209-f081cf9f2598 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-25cd440b-9ccf-4e75-b209-f081cf9f2598 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:41.793586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:41.794564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:41.795518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:41.795518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:41.795518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:41.795518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:41.795518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:41.795518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:41.795518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:41.795518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:41.795518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:58:41.795518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:41.795518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 358/697] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 08:58:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:41.802145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ad8b0-c14f-4dec-a5b1-f06107292be5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:41.939226 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ad8b0-c14f-4dec-a5b1-f06107292be5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:41.942228 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b477c-cb74-488f-84cc-8bce25dd6ad5 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:41.942511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b477c-cb74-488f-84cc-8bce25dd6ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:41.942780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b477c-cb74-488f-84cc-8bce25dd6ad5 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:41.944310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 359/698] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:41.950556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcf0bd-f1e5-42c2-8d20-069cdda18705 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:41.950838 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcf0bd-f1e5-42c2-8d20-069cdda18705 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:41.951110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcf0bd-f1e5-42c2-8d20-069cdda18705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:41.973052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f3fcf0bd-f1e5-42c2-8d20-069cdda18705 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:41.974174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f3fcf0bd-f1e5-42c2-8d20-069cdda18705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:41.980285 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c486c-9125-4b14-a96d-001f89115d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:41.981203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c486c-9125-4b14-a96d-001f89115d6c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:41.981679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c486c-9125-4b14-a96d-001f89115d6c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:41.982233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c486c-9125-4b14-a96d-001f89115d6c None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:41.983256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c486c-9125-4b14-a96d-001f89115d6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:41.983761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c486c-9125-4b14-a96d-001f89115d6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:41.985389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c486c-9125-4b14-a96d-001f89115d6c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:42.020260 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 340/699] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 08:58:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:42.026524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c486c-9125-4b14-a96d-001f89115d6c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:42.100109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 360/700] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:58:42.140807 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcf0bd-f1e5-42c2-8d20-069cdda18705 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:42.185103 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c486c-9125-4b14-a96d-001f89115d6c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:42.260834 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc3c7-5a60-41a7-8ac0-0a0af0d38f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:42.261500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc3c7-5a60-41a7-8ac0-0a0af0d38f4f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:42.261794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc3c7-5a60-41a7-8ac0-0a0af0d38f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:42.262062 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc3c7-5a60-41a7-8ac0-0a0af0d38f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:42.290316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcf0bd-f1e5-42c2-8d20-069cdda18705 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:42.326075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b56dc9-02f7-4ba8-85c2-1fa23adaef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:42.327397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56dc9-02f7-4ba8-85c2-1fa23adaef51 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:42.328043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56dc9-02f7-4ba8-85c2-1fa23adaef51 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:42.328546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56dc9-02f7-4ba8-85c2-1fa23adaef51 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:42.329417 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b56dc9-02f7-4ba8-85c2-1fa23adaef51 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:42.331046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b56dc9-02f7-4ba8-85c2-1fa23adaef51 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-84b56dc9-02f7-4ba8-85c2-1fa23adaef51 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:42.348469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:42.350106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:58:42.350962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:42.354256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 361/701] 10.222.0.23 () {56 vars in 1129 bytes} [Tue May 3 08:58:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:42.360679 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b56dc9-02f7-4ba8-85c2-1fa23adaef51 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:42.414998 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc3c7-5a60-41a7-8ac0-0a0af0d38f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:42.416519 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc3c7-5a60-41a7-8ac0-0a0af0d38f4f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:42.479790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b56dc9-02f7-4ba8-85c2-1fa23adaef51 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:42.520146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 341/702] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:42.520146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57254af8-247f-47ec-9553-be767a2aa220 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:42.520146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57254af8-247f-47ec-9553-be767a2aa220 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:42.520146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57254af8-247f-47ec-9553-be767a2aa220 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:42.524917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 342/703] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:42.525705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57254af8-247f-47ec-9553-be767a2aa220 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:42.525886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253c531-7ecb-4277-9fee-92c91707a238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:42.526730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253c531-7ecb-4277-9fee-92c91707a238 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:42.527116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253c531-7ecb-4277-9fee-92c91707a238 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:42.527530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253c531-7ecb-4277-9fee-92c91707a238 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:42.528620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253c531-7ecb-4277-9fee-92c91707a238 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:42.529881 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253c531-7ecb-4277-9fee-92c91707a238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:42.531423 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253c531-7ecb-4277-9fee-92c91707a238 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:42.540176 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 362/704] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 3 08:58:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:42.541637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a2f90-f1bb-46fe-989f-d7d2d2235803 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:42.541936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a2f90-f1bb-46fe-989f-d7d2d2235803 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:42.542215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a2f90-f1bb-46fe-989f-d7d2d2235803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:42.565105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ca3a2f90-f1bb-46fe-989f-d7d2d2235803 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:42.566763 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ca3a2f90-f1bb-46fe-989f-d7d2d2235803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:42.649822 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57254af8-247f-47ec-9553-be767a2aa220 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:42.655345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 363/705] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:42.656359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a2f90-f1bb-46fe-989f-d7d2d2235803 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:42.706502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a27cc-3536-4b2a-9a36-0c084018a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:42.707294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a27cc-3536-4b2a-9a36-0c084018a347 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:42.707573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a27cc-3536-4b2a-9a36-0c084018a347 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:42.707847 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a27cc-3536-4b2a-9a36-0c084018a347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:42.718618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a27cc-3536-4b2a-9a36-0c084018a347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:42.720075 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a27cc-3536-4b2a-9a36-0c084018a347 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-b17a27cc-3536-4b2a-9a36-0c084018a347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:42.739671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:42.741755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:42.743939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:42.743939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:42.743939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:42.743939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:42.752105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 343/706] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:42.752105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a27cc-3536-4b2a-9a36-0c084018a347 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:42.769646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a2f90-f1bb-46fe-989f-d7d2d2235803 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:42.808853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94b84a-c3b6-4663-a84d-10a993f6aa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:42.809531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94b84a-c3b6-4663-a84d-10a993f6aa1f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:42.809813 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94b84a-c3b6-4663-a84d-10a993f6aa1f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:42.810087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94b84a-c3b6-4663-a84d-10a993f6aa1f None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:42.810807 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94b84a-c3b6-4663-a84d-10a993f6aa1f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:42.811114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94b84a-c3b6-4663-a84d-10a993f6aa1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:42.812687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94b84a-c3b6-4663-a84d-10a993f6aa1f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:42.819917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 364/707] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 3 08:58:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:42.820870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94b84a-c3b6-4663-a84d-10a993f6aa1f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:42.895517 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a27cc-3536-4b2a-9a36-0c084018a347 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:42.939723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecb587-2edf-461c-80ee-31f6c255f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:42.940676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecb587-2edf-461c-80ee-31f6c255f037 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:42.941181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecb587-2edf-461c-80ee-31f6c255f037 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:42.941525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecb587-2edf-461c-80ee-31f6c255f037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:42.954338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deecb587-2edf-461c-80ee-31f6c255f037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:42.955821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deecb587-2edf-461c-80ee-31f6c255f037 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-deecb587-2edf-461c-80ee-31f6c255f037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:42.975687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:42.976682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:42.978022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:42.978022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:42.978022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:42.978022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:42.978022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 344/708] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:42.983197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecb587-2edf-461c-80ee-31f6c255f037 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:43.060643 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94b84a-c3b6-4663-a84d-10a993f6aa1f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:43.099649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8ed87-09b1-485c-8eb2-e68c6ff51ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:43.100892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8ed87-09b1-485c-8eb2-e68c6ff51ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:43.101615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8ed87-09b1-485c-8eb2-e68c6ff51ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:43.102327 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8ed87-09b1-485c-8eb2-e68c6ff51ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:43.103199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8ed87-09b1-485c-8eb2-e68c6ff51ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:43.103651 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8ed87-09b1-485c-8eb2-e68c6ff51ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:43.104351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecb587-2edf-461c-80ee-31f6c255f037 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:43.105356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8ed87-09b1-485c-8eb2-e68c6ff51ed8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:43.120151 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 365/709] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:43.121794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dfd64-38b9-4ec5-adda-4343cdea48dc None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:43.122274 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dfd64-38b9-4ec5-adda-4343cdea48dc None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:43.122778 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dfd64-38b9-4ec5-adda-4343cdea48dc None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:43.128213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 366/710] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:43.129170 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dfd64-38b9-4ec5-adda-4343cdea48dc None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:43.144975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920e091-f2f9-4f4b-8f07-5472c94ab8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:43.145918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920e091-f2f9-4f4b-8f07-5472c94ab8a1 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:43.146512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920e091-f2f9-4f4b-8f07-5472c94ab8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:43.146967 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920e091-f2f9-4f4b-8f07-5472c94ab8a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:43.147868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920e091-f2f9-4f4b-8f07-5472c94ab8a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:43.148378 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920e091-f2f9-4f4b-8f07-5472c94ab8a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:43.149915 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920e091-f2f9-4f4b-8f07-5472c94ab8a1 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:43.163025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 345/711] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:43.165318 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05552b09-91cb-4d27-b7c2-73888fb70167 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:43.165770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05552b09-91cb-4d27-b7c2-73888fb70167 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:43.166231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05552b09-91cb-4d27-b7c2-73888fb70167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:43.191093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-05552b09-91cb-4d27-b7c2-73888fb70167 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:43.192410 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-05552b09-91cb-4d27-b7c2-73888fb70167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:43.245647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dfd64-38b9-4ec5-adda-4343cdea48dc None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:43.284113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 346/712] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:43.284113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05552b09-91cb-4d27-b7c2-73888fb70167 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:43.286838 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9965ab0-a3a2-44d1-83c1-6dce667f1fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:43.287937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965ab0-a3a2-44d1-83c1-6dce667f1fdf None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:43.288423 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965ab0-a3a2-44d1-83c1-6dce667f1fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:43.288874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965ab0-a3a2-44d1-83c1-6dce667f1fdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:43.305259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9965ab0-a3a2-44d1-83c1-6dce667f1fdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:43.307469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9965ab0-a3a2-44d1-83c1-6dce667f1fdf None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-b9965ab0-a3a2-44d1-83c1-6dce667f1fdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:43.329359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:43.330254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:43.331138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:43.331138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:43.331138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:43.331138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:43.331138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:43.331138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:43.331138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:43.331138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:43.333967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 367/713] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:43.334922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9965ab0-a3a2-44d1-83c1-6dce667f1fdf None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:43.392940 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05552b09-91cb-4d27-b7c2-73888fb70167 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:43.426774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d7944-8f16-4c87-8015-4b7392df076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:43.427447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d7944-8f16-4c87-8015-4b7392df076e None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:43.428403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d7944-8f16-4c87-8015-4b7392df076e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:43.428750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d7944-8f16-4c87-8015-4b7392df076e None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:43.429523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d7944-8f16-4c87-8015-4b7392df076e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:43.431050 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d7944-8f16-4c87-8015-4b7392df076e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:43.439397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9965ab0-a3a2-44d1-83c1-6dce667f1fdf None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:43.456174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 347/714] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:58:43 2022] POST /identity/v3/users => generated 254 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:58:43.457395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d7944-8f16-4c87-8015-4b7392df076e None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:43.502782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ff520-c3ed-45da-8737-e9d8e5f372f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:43.503623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ff520-c3ed-45da-8737-e9d8e5f372f3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:43.503901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ff520-c3ed-45da-8737-e9d8e5f372f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:43.504200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ff520-c3ed-45da-8737-e9d8e5f372f3 None admin] PATH_INFO: `/v3/services/network` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:43.504911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ff520-c3ed-45da-8737-e9d8e5f372f3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:43.506435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ff520-c3ed-45da-8737-e9d8e5f372f3 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-c79ff520-c3ed-45da-8737-e9d8e5f372f3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:43.528514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:43.529605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:58:43.530462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:43.536286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 368/715] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:43 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:43.547410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ff520-c3ed-45da-8737-e9d8e5f372f3 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:43.639807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d7944-8f16-4c87-8015-4b7392df076e None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:43.708016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9beb8dd-c4d2-4c10-89c9-19172bc0a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:43.709604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9beb8dd-c4d2-4c10-89c9-19172bc0a961 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:43.710086 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9beb8dd-c4d2-4c10-89c9-19172bc0a961 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:43.710593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9beb8dd-c4d2-4c10-89c9-19172bc0a961 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:43.711565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9beb8dd-c4d2-4c10-89c9-19172bc0a961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:43.712256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9beb8dd-c4d2-4c10-89c9-19172bc0a961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:43.713867 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9beb8dd-c4d2-4c10-89c9-19172bc0a961 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:43.728848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 348/716] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:43.730072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ff520-c3ed-45da-8737-e9d8e5f372f3 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:43.736960 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9beb8dd-c4d2-4c10-89c9-19172bc0a961 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:43.770553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac27c9c-450b-4309-9009-8fe4e8a6ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:43.771212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac27c9c-450b-4309-9009-8fe4e8a6ca2d None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:43.772018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac27c9c-450b-4309-9009-8fe4e8a6ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:43.772335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac27c9c-450b-4309-9009-8fe4e8a6ca2d None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:43.773040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac27c9c-450b-4309-9009-8fe4e8a6ca2d None admin] RBAC: Adding query filter params (name=network) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:43.773342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac27c9c-450b-4309-9009-8fe4e8a6ca2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:43.774688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac27c9c-450b-4309-9009-8fe4e8a6ca2d None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:43.778933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 369/717] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:58:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:43.780206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9cd3c-1e10-4319-99f1-60a795eb1a68 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:43.780494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9cd3c-1e10-4319-99f1-60a795eb1a68 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:43.780766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9cd3c-1e10-4319-99f1-60a795eb1a68 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:43.782264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 370/718] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:43.786829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9cd3c-1e10-4319-99f1-60a795eb1a68 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:43.849297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9beb8dd-c4d2-4c10-89c9-19172bc0a961 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:43.890860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b92ca1-549f-4544-86e3-528914e50d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:43.891991 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b92ca1-549f-4544-86e3-528914e50d88 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:43.892444 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b92ca1-549f-4544-86e3-528914e50d88 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:43.892857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b92ca1-549f-4544-86e3-528914e50d88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:43.893873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b92ca1-549f-4544-86e3-528914e50d88 None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=2b863628035e4767b08fb5efc5c80958) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:43.894732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b92ca1-549f-4544-86e3-528914e50d88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:43.897252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b92ca1-549f-4544-86e3-528914e50d88 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:43.905288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 349/719] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:43 2022] GET /identity/v3/role_assignments?user.id=2b863628035e4767b08fb5efc5c80958&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:43.906837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc8b3c-0795-49ce-b840-28a1ae7b486b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:43.907279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc8b3c-0795-49ce-b840-28a1ae7b486b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:43.907677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc8b3c-0795-49ce-b840-28a1ae7b486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:43.915554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9cd3c-1e10-4319-99f1-60a795eb1a68 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:43.947660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-1ebc8b3c-0795-49ce-b840-28a1ae7b486b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:43.951808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1ebc8b3c-0795-49ce-b840-28a1ae7b486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:43.998583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b81453-ece1-4500-abd8-355c95d6c1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:44.001332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b81453-ece1-4500-abd8-355c95d6c1ea None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:44.003022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b81453-ece1-4500-abd8-355c95d6c1ea None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:44.003505 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b81453-ece1-4500-abd8-355c95d6c1ea None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:44.004417 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b81453-ece1-4500-abd8-355c95d6c1ea None admin] RBAC: Adding query filter params (type=network) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:44.006733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b81453-ece1-4500-abd8-355c95d6c1ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:44.008454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b81453-ece1-4500-abd8-355c95d6c1ea None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:44.018956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 371/720] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:58:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:44.066560 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 350/721] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:44.091713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b81453-ece1-4500-abd8-355c95d6c1ea None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:44.204546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b81453-ece1-4500-abd8-355c95d6c1ea None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:44.252703 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367492de-f9a9-47e9-91e5-7b27bf743b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:44.253494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367492de-f9a9-47e9-91e5-7b27bf743b17 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:44.253770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367492de-f9a9-47e9-91e5-7b27bf743b17 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:44.254036 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367492de-f9a9-47e9-91e5-7b27bf743b17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:44.264440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367492de-f9a9-47e9-91e5-7b27bf743b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-367492de-f9a9-47e9-91e5-7b27bf743b17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:44.272666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:44.273584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:44.274409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 372/722] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:44.280051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc8b3c-0795-49ce-b840-28a1ae7b486b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:44.377271 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc8b3c-0795-49ce-b840-28a1ae7b486b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:44.411239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601c94e-4600-427a-b2ed-060d3cac0a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:44.411976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601c94e-4600-427a-b2ed-060d3cac0a99 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:44.412277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601c94e-4600-427a-b2ed-060d3cac0a99 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:44.412549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601c94e-4600-427a-b2ed-060d3cac0a99 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:44.413292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601c94e-4600-427a-b2ed-060d3cac0a99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:44.413590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601c94e-4600-427a-b2ed-060d3cac0a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:44.414943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601c94e-4600-427a-b2ed-060d3cac0a99 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:44.423249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 351/723] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:44.428935 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367492de-f9a9-47e9-91e5-7b27bf743b17 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:44.546017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367492de-f9a9-47e9-91e5-7b27bf743b17 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:44.587781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6122a-4358-4c52-b94d-27f373591762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:44.588609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6122a-4358-4c52-b94d-27f373591762 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:44.588886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6122a-4358-4c52-b94d-27f373591762 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:44.589152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6122a-4358-4c52-b94d-27f373591762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:44.610125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6122a-4358-4c52-b94d-27f373591762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:44.611565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6122a-4358-4c52-b94d-27f373591762 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-1cc6122a-4358-4c52-b94d-27f373591762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:44.632146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:44.634167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:44.636347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:44.636347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:44.636347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:44.636347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:44.636347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 373/724] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:44.644233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601c94e-4600-427a-b2ed-060d3cac0a99 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:44.737563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601c94e-4600-427a-b2ed-060d3cac0a99 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:44.787153 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa819d-bae7-48f2-a937-303d9d5e6096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:44.787814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa819d-bae7-48f2-a937-303d9d5e6096 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:44.788110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa819d-bae7-48f2-a937-303d9d5e6096 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:44.788381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa819d-bae7-48f2-a937-303d9d5e6096 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:44.789101 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa819d-bae7-48f2-a937-303d9d5e6096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:44.789405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa819d-bae7-48f2-a937-303d9d5e6096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:44.790759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa819d-bae7-48f2-a937-303d9d5e6096 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:44.809482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 352/725] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:44.814844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6122a-4358-4c52-b94d-27f373591762 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:44.963540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6122a-4358-4c52-b94d-27f373591762 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:45.003374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e59f40-8c3f-4aca-a38a-aa3784b2c2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:45.004210 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e59f40-8c3f-4aca-a38a-aa3784b2c2a1 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:45.004487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e59f40-8c3f-4aca-a38a-aa3784b2c2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:45.004752 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e59f40-8c3f-4aca-a38a-aa3784b2c2a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:45.018407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e59f40-8c3f-4aca-a38a-aa3784b2c2a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:45.019836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e59f40-8c3f-4aca-a38a-aa3784b2c2a1 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-97e59f40-8c3f-4aca-a38a-aa3784b2c2a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:45.034009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:45.036219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:45.039001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:45.039001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:45.039001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:45.039001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:45.039001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:45.039001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:45.039001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:45.039001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:45.039001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 08:58:45.039001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:45.039001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 374/726] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:45.044120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa819d-bae7-48f2-a937-303d9d5e6096 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:45.155141 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa819d-bae7-48f2-a937-303d9d5e6096 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:45.198544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a04ccf-662a-4256-ba15-d47912fd5394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:45.199272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a04ccf-662a-4256-ba15-d47912fd5394 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:45.199814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a04ccf-662a-4256-ba15-d47912fd5394 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:45.200080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a04ccf-662a-4256-ba15-d47912fd5394 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:45.200957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a04ccf-662a-4256-ba15-d47912fd5394 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:45.201258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a04ccf-662a-4256-ba15-d47912fd5394 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:45.202718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a04ccf-662a-4256-ba15-d47912fd5394 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:45.221854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 353/727] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 3 08:58:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:45.233323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e59f40-8c3f-4aca-a38a-aa3784b2c2a1 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:45.369243 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e59f40-8c3f-4aca-a38a-aa3784b2c2a1 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:45.395498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df226b-52d6-4523-9046-13938ad14f17 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:45.395821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df226b-52d6-4523-9046-13938ad14f17 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:45.396049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df226b-52d6-4523-9046-13938ad14f17 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:45.398115 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 354/728] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:45.404035 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd5b9-76ba-4baa-b35d-dfeee408b32b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:45.404344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd5b9-76ba-4baa-b35d-dfeee408b32b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:45.404617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd5b9-76ba-4baa-b35d-dfeee408b32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:45.421786 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbc6a9-e6c0-4785-81af-b543d6b36c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:45.422767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbc6a9-e6c0-4785-81af-b543d6b36c81 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:45.423271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbc6a9-e6c0-4785-81af-b543d6b36c81 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:45.423741 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbc6a9-e6c0-4785-81af-b543d6b36c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:45.432203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f83dd5b9-76ba-4baa-b35d-dfeee408b32b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:45.433377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f83dd5b9-76ba-4baa-b35d-dfeee408b32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:45.492978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbc6a9-e6c0-4785-81af-b543d6b36c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:45.495143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbc6a9-e6c0-4785-81af-b543d6b36c81 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:45.586864 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 355/729] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 08:58:45.608504 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 375/730] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 08:58:45.613603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd5b9-76ba-4baa-b35d-dfeee408b32b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:45.622901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbc6a9-e6c0-4785-81af-b543d6b36c81 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:45.721036 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbc6a9-e6c0-4785-81af-b543d6b36c81 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:45.728734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd5b9-76ba-4baa-b35d-dfeee408b32b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:45.754835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12450b-8ac2-44ed-b675-7ae22c45fc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:45.756391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12450b-8ac2-44ed-b675-7ae22c45fc81 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:45.756896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12450b-8ac2-44ed-b675-7ae22c45fc81 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:45.757394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12450b-8ac2-44ed-b675-7ae22c45fc81 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:45.758314 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12450b-8ac2-44ed-b675-7ae22c45fc81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:45.760009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12450b-8ac2-44ed-b675-7ae22c45fc81 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:45.762271 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dd711-6dd3-4684-a2da-b75a8e0fbb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:45.763053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dd711-6dd3-4684-a2da-b75a8e0fbb00 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:45.763328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dd711-6dd3-4684-a2da-b75a8e0fbb00 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:45.763595 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dd711-6dd3-4684-a2da-b75a8e0fbb00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:45.783121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3dd711-6dd3-4684-a2da-b75a8e0fbb00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:45.785295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3dd711-6dd3-4684-a2da-b75a8e0fbb00 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:45.800098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 376/731] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 08:58:45 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-0f3dd711-6dd3-4684-a2da-b75a8e0fbb00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:45.823069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:45.824034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:45.825231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:45.825231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:45.825231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:45.825231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:45.827559 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 356/732] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:45.832898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12450b-8ac2-44ed-b675-7ae22c45fc81 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:45.981391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12450b-8ac2-44ed-b675-7ae22c45fc81 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:46.023833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b54e2d-87ca-4594-84ab-1e43c1065344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:46.024886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b54e2d-87ca-4594-84ab-1e43c1065344 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:46.025372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b54e2d-87ca-4594-84ab-1e43c1065344 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:46.025862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b54e2d-87ca-4594-84ab-1e43c1065344 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:46.026808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b54e2d-87ca-4594-84ab-1e43c1065344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:46.027318 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b54e2d-87ca-4594-84ab-1e43c1065344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:46.028919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b54e2d-87ca-4594-84ab-1e43c1065344 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:46.046731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 377/733] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:46.052223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dd711-6dd3-4684-a2da-b75a8e0fbb00 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:46.183213 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dd711-6dd3-4684-a2da-b75a8e0fbb00 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:46.237077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd574d-fee9-4a66-a486-5621707ccb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:46.237801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd574d-fee9-4a66-a486-5621707ccb17 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:46.238087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd574d-fee9-4a66-a486-5621707ccb17 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:46.238364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd574d-fee9-4a66-a486-5621707ccb17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:46.250839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd574d-fee9-4a66-a486-5621707ccb17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:46.252354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd574d-fee9-4a66-a486-5621707ccb17 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-43bd574d-fee9-4a66-a486-5621707ccb17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:46.266425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:46.267316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:46.268371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:46.268371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:46.268371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:46.268371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:46.268371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:46.268371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:46.268371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:46.268371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:46.268371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 357/734] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:46.274557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b54e2d-87ca-4594-84ab-1e43c1065344 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:46.377686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b54e2d-87ca-4594-84ab-1e43c1065344 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:46.422112 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b1365-ce18-4d34-9d3b-e82d662e1461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:46.422791 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b1365-ce18-4d34-9d3b-e82d662e1461 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:46.423069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b1365-ce18-4d34-9d3b-e82d662e1461 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:46.423336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b1365-ce18-4d34-9d3b-e82d662e1461 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:46.424151 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b1365-ce18-4d34-9d3b-e82d662e1461 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:46.424460 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b1365-ce18-4d34-9d3b-e82d662e1461 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:46.425900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b1365-ce18-4d34-9d3b-e82d662e1461 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:46.439254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 378/735] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:46.449191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd574d-fee9-4a66-a486-5621707ccb17 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:46.569093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd574d-fee9-4a66-a486-5621707ccb17 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:46.613125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37826b0e-2128-4ff7-8d80-4e39ae5b7b03 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:46.614361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37826b0e-2128-4ff7-8d80-4e39ae5b7b03 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:46.615497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37826b0e-2128-4ff7-8d80-4e39ae5b7b03 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:46.617473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928a826-e997-439e-a3af-aa4923f57b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:46.617744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 379/736] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:46.621316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928a826-e997-439e-a3af-aa4923f57b8e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:46.621316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928a826-e997-439e-a3af-aa4923f57b8e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:46.621316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928a826-e997-439e-a3af-aa4923f57b8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:46.621316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928a826-e997-439e-a3af-aa4923f57b8e None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=2360e3a110b042a8839c45aa50a39724) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:46.621316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928a826-e997-439e-a3af-aa4923f57b8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:46.621316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928a826-e997-439e-a3af-aa4923f57b8e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:46.624072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ef2db-e503-4d00-97fa-da6de305d5c5 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:46.624386 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ef2db-e503-4d00-97fa-da6de305d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:46.624659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ef2db-e503-4d00-97fa-da6de305d5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:46.629680 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 358/737] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:46 2022] GET /identity/v3/role_assignments?user.id=2360e3a110b042a8839c45aa50a39724&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:46.654421 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-118ef2db-e503-4d00-97fa-da6de305d5c5 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:46.655964 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-118ef2db-e503-4d00-97fa-da6de305d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:46.763019 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 380/738] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:46.779553 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a8087-335e-4a3f-8300-040d78d9ad6b None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:46.780117 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a8087-335e-4a3f-8300-040d78d9ad6b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:46.780117 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a8087-335e-4a3f-8300-040d78d9ad6b None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:46.781580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 359/739] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:46.787950 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a8087-335e-4a3f-8300-040d78d9ad6b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:46.788162 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecb99c-c7eb-47b6-8317-90318ceef513 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:46.788282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecb99c-c7eb-47b6-8317-90318ceef513 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:46.788559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecb99c-c7eb-47b6-8317-90318ceef513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:46.911548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a8087-335e-4a3f-8300-040d78d9ad6b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:46.943901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b0ecb99c-c7eb-47b6-8317-90318ceef513 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:46.945453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b0ecb99c-c7eb-47b6-8317-90318ceef513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:46.948469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b981dd-2c65-4af0-9027-7e44bc12bf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:46.949725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b981dd-2c65-4af0-9027-7e44bc12bf2e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:46.950151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b981dd-2c65-4af0-9027-7e44bc12bf2e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:46.950563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b981dd-2c65-4af0-9027-7e44bc12bf2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:46.961811 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b981dd-2c65-4af0-9027-7e44bc12bf2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-32b981dd-2c65-4af0-9027-7e44bc12bf2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:46.969919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:46.971059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:46.972123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:46.972123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:46.972123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:46.972123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:46.972123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:46.972123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:46.972123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:46.972123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:46.972123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:46.972123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:46.972123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:46.972123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:46.980335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 360/740] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:46.982076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12bcb3-eaa5-4dd5-86c5-460da9fef200 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:46.982508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12bcb3-eaa5-4dd5-86c5-460da9fef200 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:46.982950 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12bcb3-eaa5-4dd5-86c5-460da9fef200 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:46.984442 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 361/741] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:46.985265 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12bcb3-eaa5-4dd5-86c5-460da9fef200 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:47.015627 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 381/742] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:47.017134 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96259259-2e78-40f6-ac56-12d40162f4d6 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:47.017518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96259259-2e78-40f6-ac56-12d40162f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:47.017890 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96259259-2e78-40f6-ac56-12d40162f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:47.044141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-96259259-2e78-40f6-ac56-12d40162f4d6 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:47.045299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-96259259-2e78-40f6-ac56-12d40162f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:47.091202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12bcb3-eaa5-4dd5-86c5-460da9fef200 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:47.120788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 382/743] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 08:58:47.122217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96259259-2e78-40f6-ac56-12d40162f4d6 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:47.124885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ecaeb-41a7-4050-8eae-3af3d9cfd2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:47.125496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ecaeb-41a7-4050-8eae-3af3d9cfd2e9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:47.125773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ecaeb-41a7-4050-8eae-3af3d9cfd2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:47.126048 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ecaeb-41a7-4050-8eae-3af3d9cfd2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:47.126906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ecaeb-41a7-4050-8eae-3af3d9cfd2e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:47.127071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ecaeb-41a7-4050-8eae-3af3d9cfd2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:47.128463 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ecaeb-41a7-4050-8eae-3af3d9cfd2e9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:47.137404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 362/744] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:47.145154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ecaeb-41a7-4050-8eae-3af3d9cfd2e9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:47.252474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96259259-2e78-40f6-ac56-12d40162f4d6 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:47.259756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ecaeb-41a7-4050-8eae-3af3d9cfd2e9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:47.292459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba70ac9-86c8-40ce-88e9-d107ed02a3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:47.293559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba70ac9-86c8-40ce-88e9-d107ed02a3ee None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:47.293855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba70ac9-86c8-40ce-88e9-d107ed02a3ee None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:47.294129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba70ac9-86c8-40ce-88e9-d107ed02a3ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:47.302601 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ae828-92a1-44d1-a7ae-64eab16ba692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:47.303586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ae828-92a1-44d1-a7ae-64eab16ba692 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:47.304037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ae828-92a1-44d1-a7ae-64eab16ba692 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:47.304723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ae828-92a1-44d1-a7ae-64eab16ba692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:47.305004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba70ac9-86c8-40ce-88e9-d107ed02a3ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-1ba70ac9-86c8-40ce-88e9-d107ed02a3ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:47.313569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:47.314755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:47.315781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:47.315781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:47.315781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:47.315781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:47.315781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:47.315781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:47.315781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:47.315781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:47.315781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:47.315781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:47.315781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:47.315781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:47.319396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 383/745] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:47.320353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba70ac9-86c8-40ce-88e9-d107ed02a3ee None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:47.322955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ae828-92a1-44d1-a7ae-64eab16ba692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:47.325849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ae828-92a1-44d1-a7ae-64eab16ba692 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-fa7ae828-92a1-44d1-a7ae-64eab16ba692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:47.347088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:47.348298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:47.349195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:47.349195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:47.349195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:47.349195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:47.354548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 363/746] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:47.354548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ae828-92a1-44d1-a7ae-64eab16ba692 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:47.427407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba70ac9-86c8-40ce-88e9-d107ed02a3ee None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:47.453364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ae828-92a1-44d1-a7ae-64eab16ba692 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:47.462717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e38707-6a0f-4181-bae2-17ad26186071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:47.463641 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e38707-6a0f-4181-bae2-17ad26186071 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:47.464146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e38707-6a0f-4181-bae2-17ad26186071 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:47.464623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e38707-6a0f-4181-bae2-17ad26186071 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:47.465577 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e38707-6a0f-4181-bae2-17ad26186071 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:47.467324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e38707-6a0f-4181-bae2-17ad26186071 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:47.488537 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 384/747] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 08:58:47 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:58:47.489822 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e38707-6a0f-4181-bae2-17ad26186071 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:47.508949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1ecc3-20cb-4a20-abf9-25b028b6dd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:47.509634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ecc3-20cb-4a20-abf9-25b028b6dd91 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:47.509918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ecc3-20cb-4a20-abf9-25b028b6dd91 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:47.510192 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ecc3-20cb-4a20-abf9-25b028b6dd91 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:47.510961 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1ecc3-20cb-4a20-abf9-25b028b6dd91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:47.511267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1ecc3-20cb-4a20-abf9-25b028b6dd91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:47.512717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1ecc3-20cb-4a20-abf9-25b028b6dd91 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:47.533726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 364/748] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:47.535120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1ecc3-20cb-4a20-abf9-25b028b6dd91 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:47.645938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1ecc3-20cb-4a20-abf9-25b028b6dd91 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:47.681529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510de132-9cff-43ba-ba78-c9aa47e66e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:47.682335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510de132-9cff-43ba-ba78-c9aa47e66e15 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:47.682615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510de132-9cff-43ba-ba78-c9aa47e66e15 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:47.682891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510de132-9cff-43ba-ba78-c9aa47e66e15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:47.694910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510de132-9cff-43ba-ba78-c9aa47e66e15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:47.696398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510de132-9cff-43ba-ba78-c9aa47e66e15 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-510de132-9cff-43ba-ba78-c9aa47e66e15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:47.714206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:47.715133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:47.716022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:47.716022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:47.716022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:47.716022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:47.719994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 365/749] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:47.721937 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510de132-9cff-43ba-ba78-c9aa47e66e15 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:47.726725 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e38707-6a0f-4181-bae2-17ad26186071 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:47.767323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cc18a-6dc6-4884-aa77-74fdf9d1560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:47.767323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cc18a-6dc6-4884-aa77-74fdf9d1560c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:47.767323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cc18a-6dc6-4884-aa77-74fdf9d1560c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:47.767671 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cc18a-6dc6-4884-aa77-74fdf9d1560c None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:47.768708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cc18a-6dc6-4884-aa77-74fdf9d1560c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:47.769019 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cc18a-6dc6-4884-aa77-74fdf9d1560c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:47.770903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cc18a-6dc6-4884-aa77-74fdf9d1560c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:47.788735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 385/750] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:47.792877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cc18a-6dc6-4884-aa77-74fdf9d1560c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:47.859968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510de132-9cff-43ba-ba78-c9aa47e66e15 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:47.894832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e777b-282f-4e38-9985-3e7e979d3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:47.895895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e777b-282f-4e38-9985-3e7e979d3dd5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:47.896438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e777b-282f-4e38-9985-3e7e979d3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:47.896914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e777b-282f-4e38-9985-3e7e979d3dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:47.897862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e777b-282f-4e38-9985-3e7e979d3dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:47.898386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e777b-282f-4e38-9985-3e7e979d3dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:47.899939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e777b-282f-4e38-9985-3e7e979d3dd5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:47.907582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cc18a-6dc6-4884-aa77-74fdf9d1560c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:47.913107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 366/751] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:47.919706 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e777b-282f-4e38-9985-3e7e979d3dd5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:47.967742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c35ae-92ea-4276-84b5-4f931baefd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:47.968581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c35ae-92ea-4276-84b5-4f931baefd92 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:47.968992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c35ae-92ea-4276-84b5-4f931baefd92 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:47.969265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c35ae-92ea-4276-84b5-4f931baefd92 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:47.987610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c35ae-92ea-4276-84b5-4f931baefd92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:47.989071 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c35ae-92ea-4276-84b5-4f931baefd92 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-4b9c35ae-92ea-4276-84b5-4f931baefd92 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:48.010855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:48.011882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:48.013554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:48.013554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:48.013554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:48.013554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:48.013554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:48.013554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:48.013554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:48.013554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:48.013554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:58:48.013554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:48.013554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 386/752] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 08:58:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:48.023513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c35ae-92ea-4276-84b5-4f931baefd92 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:48.091812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e777b-282f-4e38-9985-3e7e979d3dd5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:48.129923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fa37a-4eaf-4a18-8ed5-3ad9d8a1bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:48.130770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fa37a-4eaf-4a18-8ed5-3ad9d8a1bd87 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:48.131079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fa37a-4eaf-4a18-8ed5-3ad9d8a1bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:48.132072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fa37a-4eaf-4a18-8ed5-3ad9d8a1bd87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:48.145419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fa37a-4eaf-4a18-8ed5-3ad9d8a1bd87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:48.148435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fa37a-4eaf-4a18-8ed5-3ad9d8a1bd87 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-194fa37a-4eaf-4a18-8ed5-3ad9d8a1bd87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:48.175320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:48.176332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:48.177252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:48.177252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:48.177252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:48.177252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:48.177252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:48.177252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:48.177252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:48.177252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:48.177252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:58:48.177252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:48.185943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 367/753] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 08:58:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:48.191858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fa37a-4eaf-4a18-8ed5-3ad9d8a1bd87 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:48.212608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c35ae-92ea-4276-84b5-4f931baefd92 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:48.305121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fa37a-4eaf-4a18-8ed5-3ad9d8a1bd87 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:48.313320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ae701-c071-4ce6-9f64-2c70173bca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:48.314002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ae701-c071-4ce6-9f64-2c70173bca6e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:48.314284 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ae701-c071-4ce6-9f64-2c70173bca6e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:48.314558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ae701-c071-4ce6-9f64-2c70173bca6e None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:48.315398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ae701-c071-4ce6-9f64-2c70173bca6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:48.315704 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ae701-c071-4ce6-9f64-2c70173bca6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:48.317147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ae701-c071-4ce6-9f64-2c70173bca6e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:48.353637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6bdbe-13d3-43e3-b8a8-acbfae7cf065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:48.354659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6bdbe-13d3-43e3-b8a8-acbfae7cf065 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:48.356764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6bdbe-13d3-43e3-b8a8-acbfae7cf065 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:48.357444 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6bdbe-13d3-43e3-b8a8-acbfae7cf065 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:48.358488 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6bdbe-13d3-43e3-b8a8-acbfae7cf065 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:48.358970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 387/754] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 3 08:58:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:48.359491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6bdbe-13d3-43e3-b8a8-acbfae7cf065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:48.361367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6bdbe-13d3-43e3-b8a8-acbfae7cf065 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:48.362427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ae701-c071-4ce6-9f64-2c70173bca6e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:48.404254 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 368/755] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 08:58:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:48.409912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6bdbe-13d3-43e3-b8a8-acbfae7cf065 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:48.498198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ae701-c071-4ce6-9f64-2c70173bca6e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:48.535409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7601af5-678b-45cb-8f7c-51e0cc0afa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:48.537389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7601af5-678b-45cb-8f7c-51e0cc0afa0b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:48.537855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7601af5-678b-45cb-8f7c-51e0cc0afa0b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:48.538305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7601af5-678b-45cb-8f7c-51e0cc0afa0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:48.613275 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7601af5-678b-45cb-8f7c-51e0cc0afa0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:48.615097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7601af5-678b-45cb-8f7c-51e0cc0afa0b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:48.651643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6bdbe-13d3-43e3-b8a8-acbfae7cf065 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:48.729837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 388/756] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:58:48.737077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7601af5-678b-45cb-8f7c-51e0cc0afa0b None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:48.748900 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634efc2-6a0f-41ff-bc9b-6aa5e0d9a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:48.750838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634efc2-6a0f-41ff-bc9b-6aa5e0d9a0a5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:48.750838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634efc2-6a0f-41ff-bc9b-6aa5e0d9a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:48.750838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634efc2-6a0f-41ff-bc9b-6aa5e0d9a0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:48.770128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634efc2-6a0f-41ff-bc9b-6aa5e0d9a0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:48.772196 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634efc2-6a0f-41ff-bc9b-6aa5e0d9a0a5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-1634efc2-6a0f-41ff-bc9b-6aa5e0d9a0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:48.813403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:48.814470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:48.816067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:48.816067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:48.816067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:48.816067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:48.816067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 369/757] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:48.820904 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634efc2-6a0f-41ff-bc9b-6aa5e0d9a0a5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:48.856532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7601af5-678b-45cb-8f7c-51e0cc0afa0b None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:48.894297 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f105afa-3cb3-4ec1-9fe7-a093d45857ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:48.895489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f105afa-3cb3-4ec1-9fe7-a093d45857ed None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:48.895985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f105afa-3cb3-4ec1-9fe7-a093d45857ed None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:48.897253 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f105afa-3cb3-4ec1-9fe7-a093d45857ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:48.909742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f105afa-3cb3-4ec1-9fe7-a093d45857ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:48.911566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f105afa-3cb3-4ec1-9fe7-a093d45857ed None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-9f105afa-3cb3-4ec1-9fe7-a093d45857ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:48.934075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:48.935017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:48.935904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:48.935904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:48.935904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:48.935904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:48.938393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 389/758] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:48.943675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f105afa-3cb3-4ec1-9fe7-a093d45857ed None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:48.994896 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634efc2-6a0f-41ff-bc9b-6aa5e0d9a0a5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:49.033580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90281b88-105b-459b-b5f7-47cfef81c2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:49.034380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90281b88-105b-459b-b5f7-47cfef81c2a3 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.034767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90281b88-105b-459b-b5f7-47cfef81c2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.035143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90281b88-105b-459b-b5f7-47cfef81c2a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.036444 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90281b88-105b-459b-b5f7-47cfef81c2a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:49.037422 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90281b88-105b-459b-b5f7-47cfef81c2a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:49.039283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90281b88-105b-459b-b5f7-47cfef81c2a3 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:49.055830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 370/759] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:49.058196 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2b131-f0f1-46b5-9d91-10ba44a0025e None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.058628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2b131-f0f1-46b5-9d91-10ba44a0025e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.059011 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2b131-f0f1-46b5-9d91-10ba44a0025e None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.064966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 371/760] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:49.064966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2b131-f0f1-46b5-9d91-10ba44a0025e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:49.068445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f105afa-3cb3-4ec1-9fe7-a093d45857ed None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:49.104749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d596-6a2f-4dd7-9277-9e7097ddbb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:49.105693 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d596-6a2f-4dd7-9277-9e7097ddbb6e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.106181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d596-6a2f-4dd7-9277-9e7097ddbb6e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.106619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d596-6a2f-4dd7-9277-9e7097ddbb6e None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.107555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664d596-6a2f-4dd7-9277-9e7097ddbb6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:49.108007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664d596-6a2f-4dd7-9277-9e7097ddbb6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:49.109660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664d596-6a2f-4dd7-9277-9e7097ddbb6e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:49.123665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 390/761] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:49.125596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31ad2-0997-4a98-8460-f1051a0e7ad2 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.125984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31ad2-0997-4a98-8460-f1051a0e7ad2 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.126380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31ad2-0997-4a98-8460-f1051a0e7ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.148069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-1bb31ad2-0997-4a98-8460-f1051a0e7ad2 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:49.149349 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-1bb31ad2-0997-4a98-8460-f1051a0e7ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:49.177826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2b131-f0f1-46b5-9d91-10ba44a0025e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:49.225104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedceb85-362e-4480-91c6-57484ef67ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:49.226321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedceb85-362e-4480-91c6-57484ef67ffb None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.226490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedceb85-362e-4480-91c6-57484ef67ffb None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.226717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedceb85-362e-4480-91c6-57484ef67ffb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.233654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedceb85-362e-4480-91c6-57484ef67ffb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:49.235104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedceb85-362e-4480-91c6-57484ef67ffb None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:49.242800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 391/762] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:58:49.244018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb31ad2-0997-4a98-8460-f1051a0e7ad2 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-bedceb85-362e-4480-91c6-57484ef67ffb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:49.249329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:49.250234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:49.251710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:49.251710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:49.251710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:49.251710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:49.251710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:49.251710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:49.251710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:49.251710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:49.251710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 372/763] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:49.252419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9422-4c6c-4cfd-a1c5-2cf1c6d7b9e2 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.252419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9422-4c6c-4cfd-a1c5-2cf1c6d7b9e2 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.252552 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9422-4c6c-4cfd-a1c5-2cf1c6d7b9e2 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.254024 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 373/764] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:49.256339 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9422-4c6c-4cfd-a1c5-2cf1c6d7b9e2 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:49.355943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb31ad2-0997-4a98-8460-f1051a0e7ad2 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:49.356824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9422-4c6c-4cfd-a1c5-2cf1c6d7b9e2 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:49.391302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c1cca-6d0d-4830-85d0-488619effdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:49.391785 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ab3f1-3387-4518-91d7-da83084ee498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:49.391989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1cca-6d0d-4830-85d0-488619effdee None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.392257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1cca-6d0d-4830-85d0-488619effdee None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.392522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1cca-6d0d-4830-85d0-488619effdee None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.392621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ab3f1-3387-4518-91d7-da83084ee498 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.393024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ab3f1-3387-4518-91d7-da83084ee498 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.393301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ab3f1-3387-4518-91d7-da83084ee498 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.393479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c1cca-6d0d-4830-85d0-488619effdee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:49.393727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c1cca-6d0d-4830-85d0-488619effdee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:49.395138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c1cca-6d0d-4830-85d0-488619effdee None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:49.400732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ab3f1-3387-4518-91d7-da83084ee498 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:49.402320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ab3f1-3387-4518-91d7-da83084ee498 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:49.406955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 374/765] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:49.408399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bc76a-3e3c-4d02-8382-6bd358d8e02c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.408859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bc76a-3e3c-4d02-8382-6bd358d8e02c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.409318 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bc76a-3e3c-4d02-8382-6bd358d8e02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-cb0ab3f1-3387-4518-91d7-da83084ee498 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:49.420377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:49.421497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:49.422608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:49.422608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:49.422608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:49.422608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:49.422608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:49.422608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:49.422608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:49.422608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:49.426440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 392/766] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:49.427267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ab3f1-3387-4518-91d7-da83084ee498 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:49.428176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-203bc76a-3e3c-4d02-8382-6bd358d8e02c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:49.429354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-203bc76a-3e3c-4d02-8382-6bd358d8e02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:49.493923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 375/767] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:58:49.495094 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bc76a-3e3c-4d02-8382-6bd358d8e02c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:49.537521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ab3f1-3387-4518-91d7-da83084ee498 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:49.570765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e342-afd3-4b80-865e-efe46f68810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:49.571841 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e342-afd3-4b80-865e-efe46f68810b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.572137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e342-afd3-4b80-865e-efe46f68810b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.572404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e342-afd3-4b80-865e-efe46f68810b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.573045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e342-afd3-4b80-865e-efe46f68810b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:49.574639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e342-afd3-4b80-865e-efe46f68810b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-5829e342-afd3-4b80-865e-efe46f68810b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:49.587041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:49.588060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:49.589633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 393/768] 10.222.0.23 () {56 vars in 1129 bytes} [Tue May 3 08:58:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:49.590537 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e342-afd3-4b80-865e-efe46f68810b None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:49.608773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bc76a-3e3c-4d02-8382-6bd358d8e02c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:49.648830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2132d-9a76-47cb-9960-ef607965fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:49.649701 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2132d-9a76-47cb-9960-ef607965fea5 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.649983 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2132d-9a76-47cb-9960-ef607965fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.650251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2132d-9a76-47cb-9960-ef607965fea5 None admin] PATH_INFO: `/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/2b863628035e4767b08fb5efc5c80958/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.652288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2132d-9a76-47cb-9960-ef607965fea5 None admin] RBAC: Authorizing `identity:create_grant(project_id=250761bd5a9e48e0b26fedcf65d88a5d, user_id=2b863628035e4767b08fb5efc5c80958, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:49.653661 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2132d-9a76-47cb-9960-ef607965fea5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:49.666262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 376/769] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:58:49 2022] PUT /identity/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/2b863628035e4767b08fb5efc5c80958/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:58:49.667047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2132d-9a76-47cb-9960-ef607965fea5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:49.708138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e342-afd3-4b80-865e-efe46f68810b None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:49.745588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cce615-8b83-4053-a4a7-fbd6194b14ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:49.746267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cce615-8b83-4053-a4a7-fbd6194b14ba None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.746562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cce615-8b83-4053-a4a7-fbd6194b14ba None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.746798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cce615-8b83-4053-a4a7-fbd6194b14ba None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.747696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cce615-8b83-4053-a4a7-fbd6194b14ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:49.747900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cce615-8b83-4053-a4a7-fbd6194b14ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:49.749399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cce615-8b83-4053-a4a7-fbd6194b14ba None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:49.768922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 394/770] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:49.770110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cce615-8b83-4053-a4a7-fbd6194b14ba None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:49.814563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2132d-9a76-47cb-9960-ef607965fea5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:49.852287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d44932-2c6b-4d87-8d95-0029d238be04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:49.853447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d44932-2c6b-4d87-8d95-0029d238be04 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.853825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d44932-2c6b-4d87-8d95-0029d238be04 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.854201 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d44932-2c6b-4d87-8d95-0029d238be04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.870013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d44932-2c6b-4d87-8d95-0029d238be04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-16d44932-2c6b-4d87-8d95-0029d238be04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:49.879205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:49.881070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:49.881970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 377/771] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:49.882952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d44932-2c6b-4d87-8d95-0029d238be04 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:49.903084 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cce615-8b83-4053-a4a7-fbd6194b14ba None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:49.952418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82e468-c9fc-4b7b-b1ee-a437b501450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:49.953632 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82e468-c9fc-4b7b-b1ee-a437b501450b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:49.954089 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82e468-c9fc-4b7b-b1ee-a437b501450b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:49.954511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82e468-c9fc-4b7b-b1ee-a437b501450b None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:49.956280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82e468-c9fc-4b7b-b1ee-a437b501450b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:49.959310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82e468-c9fc-4b7b-b1ee-a437b501450b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:49.960883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82e468-c9fc-4b7b-b1ee-a437b501450b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:49.967925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 395/772] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 3 08:58:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:49.969256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82e468-c9fc-4b7b-b1ee-a437b501450b None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:49.985695 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d44932-2c6b-4d87-8d95-0029d238be04 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:50.020574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d861e15-53d9-4dc0-903f-e533515fb13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:50.021436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d861e15-53d9-4dc0-903f-e533515fb13e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:50.021837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d861e15-53d9-4dc0-903f-e533515fb13e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:50.022215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d861e15-53d9-4dc0-903f-e533515fb13e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:50.023155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d861e15-53d9-4dc0-903f-e533515fb13e None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=14cf4626439e4b689a036f47a0023ea0) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:50.023620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d861e15-53d9-4dc0-903f-e533515fb13e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:50.025218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d861e15-53d9-4dc0-903f-e533515fb13e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:50.031483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 378/773] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:49 2022] GET /identity/v3/role_assignments?user.id=14cf4626439e4b689a036f47a0023ea0&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:50.040694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d861e15-53d9-4dc0-903f-e533515fb13e None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:50.079807 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82e468-c9fc-4b7b-b1ee-a437b501450b None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:50.118865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87956ff-9857-4f05-9536-ddbe80057024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:50.119542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87956ff-9857-4f05-9536-ddbe80057024 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:50.119825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87956ff-9857-4f05-9536-ddbe80057024 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:50.120117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87956ff-9857-4f05-9536-ddbe80057024 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:50.120914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87956ff-9857-4f05-9536-ddbe80057024 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:50.121222 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87956ff-9857-4f05-9536-ddbe80057024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:50.122602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87956ff-9857-4f05-9536-ddbe80057024 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:50.138981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 396/774] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:50.140655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8642-9c76-4e44-856b-4026a687a494 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:50.141106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8642-9c76-4e44-856b-4026a687a494 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:50.141528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8642-9c76-4e44-856b-4026a687a494 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:50.143702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 397/775] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:50.144946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e8642-9c76-4e44-856b-4026a687a494 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:50.173885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d861e15-53d9-4dc0-903f-e533515fb13e None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:50.229593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda509ae-5438-4498-81f6-9b7b2a27cb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:50.231586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda509ae-5438-4498-81f6-9b7b2a27cb0e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:50.231586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda509ae-5438-4498-81f6-9b7b2a27cb0e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:50.231586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda509ae-5438-4498-81f6-9b7b2a27cb0e None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:50.232130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda509ae-5438-4498-81f6-9b7b2a27cb0e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:50.232452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda509ae-5438-4498-81f6-9b7b2a27cb0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:50.233867 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda509ae-5438-4498-81f6-9b7b2a27cb0e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:50.242028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 379/776] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 3 08:58:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:50.243502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce265f7-be6b-49a9-a9fe-8bba2ef2316d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:50.243724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce265f7-be6b-49a9-a9fe-8bba2ef2316d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:50.244883 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce265f7-be6b-49a9-a9fe-8bba2ef2316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:50.261968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5ce265f7-be6b-49a9-a9fe-8bba2ef2316d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:50.263227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5ce265f7-be6b-49a9-a9fe-8bba2ef2316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:50.283076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e8642-9c76-4e44-856b-4026a687a494 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:50.328397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052c609-56ba-4044-895f-36324f2bbb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:50.329431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052c609-56ba-4044-895f-36324f2bbb76 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:50.329888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052c609-56ba-4044-895f-36324f2bbb76 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:50.330336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052c609-56ba-4044-895f-36324f2bbb76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:50.332305 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 380/777] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:58:50.333387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce265f7-be6b-49a9-a9fe-8bba2ef2316d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:50.342366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052c609-56ba-4044-895f-36324f2bbb76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:50.344015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052c609-56ba-4044-895f-36324f2bbb76 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-1052c609-56ba-4044-895f-36324f2bbb76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:50.363714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:50.365446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:50.366348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:50.366348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:50.366348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:50.366348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:50.368407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 398/778] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:50.373499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052c609-56ba-4044-895f-36324f2bbb76 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:50.473797 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce265f7-be6b-49a9-a9fe-8bba2ef2316d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:50.474743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052c609-56ba-4044-895f-36324f2bbb76 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:50.509535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e3a45-3ed3-472c-aa40-7b75c448599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:50.510359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e3a45-3ed3-472c-aa40-7b75c448599c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:50.510639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e3a45-3ed3-472c-aa40-7b75c448599c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:50.510912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e3a45-3ed3-472c-aa40-7b75c448599c None admin] PATH_INFO: `/v3/services/network` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:50.511633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e3a45-3ed3-472c-aa40-7b75c448599c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:50.512944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e3a45-3ed3-472c-aa40-7b75c448599c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:50.517463 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a9b48-d22a-4276-8dff-e00b1123a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:50.518373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a9b48-d22a-4276-8dff-e00b1123a428 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:50.518864 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a9b48-d22a-4276-8dff-e00b1123a428 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:50.519342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a9b48-d22a-4276-8dff-e00b1123a428 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:50.520356 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a9b48-d22a-4276-8dff-e00b1123a428 None admin] RBAC: Adding query filter params (interface=public, service_id=0040b696c3cf4b96830489f293c4d260, region_id=RegionOne) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:50.520871 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a9b48-d22a-4276-8dff-e00b1123a428 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:50.523085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a9b48-d22a-4276-8dff-e00b1123a428 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-5c7e3a45-3ed3-472c-aa40-7b75c448599c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:50.525366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:50.526319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:58:50.527154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:50.531404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 399/779] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:50 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:50.532277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e3a45-3ed3-472c-aa40-7b75c448599c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:50.534876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 381/780] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 08:58:50 2022] GET /identity/v3/endpoints?service_id=0040b696c3cf4b96830489f293c4d260&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:50.537512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a9b48-d22a-4276-8dff-e00b1123a428 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:50.635538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e3a45-3ed3-472c-aa40-7b75c448599c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:50.650895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a9b48-d22a-4276-8dff-e00b1123a428 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:50.669776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d7e2-7b9a-4e54-84e3-14a5c8be4046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:50.670516 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d7e2-7b9a-4e54-84e3-14a5c8be4046 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:50.670899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d7e2-7b9a-4e54-84e3-14a5c8be4046 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:50.671239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d7e2-7b9a-4e54-84e3-14a5c8be4046 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:50.672381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d7e2-7b9a-4e54-84e3-14a5c8be4046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:50.672381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d7e2-7b9a-4e54-84e3-14a5c8be4046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:50.673865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d7e2-7b9a-4e54-84e3-14a5c8be4046 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:50.690427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 400/781] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:50.690427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d7e2-7b9a-4e54-84e3-14a5c8be4046 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:50.690669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f4b56-fe9a-4463-8686-701424bdfa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:50.690669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4b56-fe9a-4463-8686-701424bdfa5b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:50.690669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4b56-fe9a-4463-8686-701424bdfa5b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:50.690669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4b56-fe9a-4463-8686-701424bdfa5b None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:50.690939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f4b56-fe9a-4463-8686-701424bdfa5b None admin] RBAC: Adding query filter params (name=network) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:50.690939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f4b56-fe9a-4463-8686-701424bdfa5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:50.692210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f4b56-fe9a-4463-8686-701424bdfa5b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:50.697831 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 382/782] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:58:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:50.704174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f4b56-fe9a-4463-8686-701424bdfa5b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:50.801204 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d7e2-7b9a-4e54-84e3-14a5c8be4046 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:50.838648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823a25b-8d3b-4e6e-9b07-97d1b30d5ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:50.839322 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823a25b-8d3b-4e6e-9b07-97d1b30d5ca2 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:50.839601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823a25b-8d3b-4e6e-9b07-97d1b30d5ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:50.839876 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823a25b-8d3b-4e6e-9b07-97d1b30d5ca2 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:50.840592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823a25b-8d3b-4e6e-9b07-97d1b30d5ca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:50.841972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823a25b-8d3b-4e6e-9b07-97d1b30d5ca2 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:50.848154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 401/783] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 08:58:50 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:50.849971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823a25b-8d3b-4e6e-9b07-97d1b30d5ca2 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:50.960384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823a25b-8d3b-4e6e-9b07-97d1b30d5ca2 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:50.976204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f4b56-fe9a-4463-8686-701424bdfa5b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:50.995787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dddd0-d766-477f-ac9b-635de7c5fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:50.996517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dddd0-d766-477f-ac9b-635de7c5fb5e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:50.996801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dddd0-d766-477f-ac9b-635de7c5fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:50.997078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dddd0-d766-477f-ac9b-635de7c5fb5e None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:50.997858 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0dddd0-d766-477f-ac9b-635de7c5fb5e None admin] RBAC: Adding query filter params (type=network) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:50.998165 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0dddd0-d766-477f-ac9b-635de7c5fb5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:50.999688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0dddd0-d766-477f-ac9b-635de7c5fb5e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:51.004974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 402/784] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:58:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:51.011340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dddd0-d766-477f-ac9b-635de7c5fb5e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:51.015505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c038f-2882-464f-9c2d-a24fb7db48d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:51.016597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c038f-2882-464f-9c2d-a24fb7db48d3 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:51.017114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c038f-2882-464f-9c2d-a24fb7db48d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:51.017593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c038f-2882-464f-9c2d-a24fb7db48d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:51.026319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c038f-2882-464f-9c2d-a24fb7db48d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:51.028653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c038f-2882-464f-9c2d-a24fb7db48d3 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-f74c038f-2882-464f-9c2d-a24fb7db48d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:51.044436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:51.045470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:51.046430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:51.046430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:51.046430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:51.046430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:51.046430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:51.046430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:51.046430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:51.046430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:51.046430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 08:58:51.046430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:51.049180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 383/785] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:51.055212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c038f-2882-464f-9c2d-a24fb7db48d3 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:51.115349 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dddd0-d766-477f-ac9b-635de7c5fb5e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:51.150444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f25f0-a88c-41c6-a906-8c65fa1dc987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:51.151163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f25f0-a88c-41c6-a906-8c65fa1dc987 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:51.151452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f25f0-a88c-41c6-a906-8c65fa1dc987 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:51.151746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f25f0-a88c-41c6-a906-8c65fa1dc987 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:51.152589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f25f0-a88c-41c6-a906-8c65fa1dc987 None admin] RBAC: Adding query filter params (interface=public, service_id=5f8837d54e6644e19d7166b5d2e0b90a, region_id=RegionOne) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:51.152908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f25f0-a88c-41c6-a906-8c65fa1dc987 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:51.154251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f25f0-a88c-41c6-a906-8c65fa1dc987 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:51.158981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c038f-2882-464f-9c2d-a24fb7db48d3 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:51.166500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 403/786] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 08:58:51 2022] GET /identity/v3/endpoints?service_id=5f8837d54e6644e19d7166b5d2e0b90a&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:51.167548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f25f0-a88c-41c6-a906-8c65fa1dc987 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:51.193819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e414bf-5900-4730-840b-3cd21d795004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:51.194860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e414bf-5900-4730-840b-3cd21d795004 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:51.195347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e414bf-5900-4730-840b-3cd21d795004 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:51.195835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e414bf-5900-4730-840b-3cd21d795004 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:51.196905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e414bf-5900-4730-840b-3cd21d795004 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:51.197436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e414bf-5900-4730-840b-3cd21d795004 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:51.199047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e414bf-5900-4730-840b-3cd21d795004 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:51.218225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 384/787] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 3 08:58:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:51.224304 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e414bf-5900-4730-840b-3cd21d795004 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:51.282386 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f25f0-a88c-41c6-a906-8c65fa1dc987 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:51.316750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4eb13-3902-4a1d-96ba-a8066cb260e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:51.317077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4eb13-3902-4a1d-96ba-a8066cb260e4 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:51.317334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4eb13-3902-4a1d-96ba-a8066cb260e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:51.317608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4eb13-3902-4a1d-96ba-a8066cb260e4 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:51.318868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4eb13-3902-4a1d-96ba-a8066cb260e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:51.320252 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4eb13-3902-4a1d-96ba-a8066cb260e4 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:51.330806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e414bf-5900-4730-840b-3cd21d795004 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:51.332255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 404/788] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 08:58:51 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:51.369289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd4c92-0758-4fe8-be9b-76914e162e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:51.370490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd4c92-0758-4fe8-be9b-76914e162e9a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:51.370991 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd4c92-0758-4fe8-be9b-76914e162e9a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:51.371469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd4c92-0758-4fe8-be9b-76914e162e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:51.383586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd4c92-0758-4fe8-be9b-76914e162e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:51.385468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd4c92-0758-4fe8-be9b-76914e162e9a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-24bd4c92-0758-4fe8-be9b-76914e162e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:51.405529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:51.406499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:51.407389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:51.407389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:51.407389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:51.407389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:51.409802 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 385/789] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:51.415731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4eb13-3902-4a1d-96ba-a8066cb260e4 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:51.541460 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4eb13-3902-4a1d-96ba-a8066cb260e4 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:51.577637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cff85b-d736-423e-af2e-115844729013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:51.578625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cff85b-d736-423e-af2e-115844729013 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:51.579111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cff85b-d736-423e-af2e-115844729013 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:51.579589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cff85b-d736-423e-af2e-115844729013 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:51.580562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cff85b-d736-423e-af2e-115844729013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:51.581076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cff85b-d736-423e-af2e-115844729013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:51.582655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cff85b-d736-423e-af2e-115844729013 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:51.596163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 405/790] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:51.602783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd4c92-0758-4fe8-be9b-76914e162e9a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:51.711386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd4c92-0758-4fe8-be9b-76914e162e9a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:51.746670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1355e9e-8467-4a2f-8a79-d7e618d08f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:51.747830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1355e9e-8467-4a2f-8a79-d7e618d08f35 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:51.748342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1355e9e-8467-4a2f-8a79-d7e618d08f35 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:51.748837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1355e9e-8467-4a2f-8a79-d7e618d08f35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:51.756125 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1355e9e-8467-4a2f-8a79-d7e618d08f35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:51.757822 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1355e9e-8467-4a2f-8a79-d7e618d08f35 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-b1355e9e-8467-4a2f-8a79-d7e618d08f35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:51.773009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:51.773932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:51.774818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:51.774818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:51.774818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:51.774818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:51.774818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:51.774818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:51.774818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:51.774818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:51.777246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 386/791] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:51.783118 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cff85b-d736-423e-af2e-115844729013 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:51.905663 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cff85b-d736-423e-af2e-115844729013 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:51.952804 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb87ab-059b-4967-a0d0-5e3a94d84368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:51.953468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb87ab-059b-4967-a0d0-5e3a94d84368 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:51.953750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb87ab-059b-4967-a0d0-5e3a94d84368 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:51.954022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb87ab-059b-4967-a0d0-5e3a94d84368 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:51.954804 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb87ab-059b-4967-a0d0-5e3a94d84368 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:51.955107 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb87ab-059b-4967-a0d0-5e3a94d84368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:51.956546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb87ab-059b-4967-a0d0-5e3a94d84368 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:51.973248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 406/792] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:51.979527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1355e9e-8467-4a2f-8a79-d7e618d08f35 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:52.120774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1355e9e-8467-4a2f-8a79-d7e618d08f35 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:52.155996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fa7bf-412f-44c8-a17f-c8360baf2c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:52.157251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa7bf-412f-44c8-a17f-c8360baf2c83 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:52.157732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa7bf-412f-44c8-a17f-c8360baf2c83 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:52.158206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa7bf-412f-44c8-a17f-c8360baf2c83 None admin] PATH_INFO: `/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/2360e3a110b042a8839c45aa50a39724/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:52.160459 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fa7bf-412f-44c8-a17f-c8360baf2c83 None admin] RBAC: Authorizing `identity:create_grant(project_id=250761bd5a9e48e0b26fedcf65d88a5d, user_id=2360e3a110b042a8839c45aa50a39724, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:52.162741 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fa7bf-412f-44c8-a17f-c8360baf2c83 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:52.184317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 387/793] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:58:51 2022] PUT /identity/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/2360e3a110b042a8839c45aa50a39724/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:58:52.361398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7babcd6-9486-4faa-a44f-8ac5f2f74736 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:52.362100 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7babcd6-9486-4faa-a44f-8ac5f2f74736 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:52.362582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7babcd6-9486-4faa-a44f-8ac5f2f74736 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:52.364501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 407/794] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:52.369854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0bda6-51c5-4ef4-a1d6-42acdc796c9f None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:52.370422 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0bda6-51c5-4ef4-a1d6-42acdc796c9f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:52.370919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0bda6-51c5-4ef4-a1d6-42acdc796c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:52.393611 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8fe0bda6-51c5-4ef4-a1d6-42acdc796c9f None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:52.395421 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8fe0bda6-51c5-4ef4-a1d6-42acdc796c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:52.444074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71e105-a2ff-4e00-911e-be14ae38a90b None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:52.444287 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71e105-a2ff-4e00-911e-be14ae38a90b None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:52.444559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71e105-a2ff-4e00-911e-be14ae38a90b None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:52.446182 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 408/795] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:52.454685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3842bdc-3127-4abe-8c07-50ad93ccde25 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:52.454685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3842bdc-3127-4abe-8c07-50ad93ccde25 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:52.454685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3842bdc-3127-4abe-8c07-50ad93ccde25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:52.474528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b3842bdc-3127-4abe-8c07-50ad93ccde25 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:52.477210 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b3842bdc-3127-4abe-8c07-50ad93ccde25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:52.495100 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 388/796] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:58:52.522136 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0bda6-51c5-4ef4-a1d6-42acdc796c9f None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:52.594424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 409/797] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:58:52.616473 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3842bdc-3127-4abe-8c07-50ad93ccde25 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:52.620513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0bda6-51c5-4ef4-a1d6-42acdc796c9f None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:52.668803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3db965-181e-4cb9-90ee-ecb76dcb1a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:52.669609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3db965-181e-4cb9-90ee-ecb76dcb1a49 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:52.669883 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3db965-181e-4cb9-90ee-ecb76dcb1a49 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:52.670146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3db965-181e-4cb9-90ee-ecb76dcb1a49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:52.683766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3db965-181e-4cb9-90ee-ecb76dcb1a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-4f3db965-181e-4cb9-90ee-ecb76dcb1a49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:52.698326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:52.699533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:52.700405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 389/798] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:52.705591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3db965-181e-4cb9-90ee-ecb76dcb1a49 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:52.715258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3842bdc-3127-4abe-8c07-50ad93ccde25 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:52.748927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256f43d-8a12-49e1-9354-2ad5dfa43cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:52.749724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256f43d-8a12-49e1-9354-2ad5dfa43cec None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:52.750001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256f43d-8a12-49e1-9354-2ad5dfa43cec None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:52.750275 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256f43d-8a12-49e1-9354-2ad5dfa43cec None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:52.761057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256f43d-8a12-49e1-9354-2ad5dfa43cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-5256f43d-8a12-49e1-9354-2ad5dfa43cec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:52.768800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:52.770918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:52.773085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 410/799] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:52.780147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256f43d-8a12-49e1-9354-2ad5dfa43cec None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:52.863046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3db965-181e-4cb9-90ee-ecb76dcb1a49 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:52.900761 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256f43d-8a12-49e1-9354-2ad5dfa43cec None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:52.909792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f295b99-3509-4acc-adfa-983ae76e2420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:52.910467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f295b99-3509-4acc-adfa-983ae76e2420 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:52.910743 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f295b99-3509-4acc-adfa-983ae76e2420 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:52.911010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f295b99-3509-4acc-adfa-983ae76e2420 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:52.911782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f295b99-3509-4acc-adfa-983ae76e2420 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:52.912097 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f295b99-3509-4acc-adfa-983ae76e2420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:52.913462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f295b99-3509-4acc-adfa-983ae76e2420 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:52.932817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 390/800] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:52.936812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347ed11-99c1-46c9-990b-4495417c25f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:52.937608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347ed11-99c1-46c9-990b-4495417c25f7 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:52.937837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347ed11-99c1-46c9-990b-4495417c25f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:52.938111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347ed11-99c1-46c9-990b-4495417c25f7 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:52.938425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f295b99-3509-4acc-adfa-983ae76e2420 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:52.938860 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347ed11-99c1-46c9-990b-4495417c25f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:52.939164 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347ed11-99c1-46c9-990b-4495417c25f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:52.940564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347ed11-99c1-46c9-990b-4495417c25f7 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:52.949667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 411/801] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:52.955025 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347ed11-99c1-46c9-990b-4495417c25f7 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:53.054157 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347ed11-99c1-46c9-990b-4495417c25f7 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:53.094653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f7ac8-81c4-4ade-94f2-8a0b62333b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:53.095439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f7ac8-81c4-4ade-94f2-8a0b62333b1f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:53.095718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f7ac8-81c4-4ade-94f2-8a0b62333b1f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:53.095989 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f7ac8-81c4-4ade-94f2-8a0b62333b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:53.098585 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f295b99-3509-4acc-adfa-983ae76e2420 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:53.114079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f7ac8-81c4-4ade-94f2-8a0b62333b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:53.114079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f7ac8-81c4-4ade-94f2-8a0b62333b1f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-608f7ac8-81c4-4ade-94f2-8a0b62333b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:53.128459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:53.129391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:53.130830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:53.130830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:53.130830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:53.130830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:53.130830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 412/802] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:53.136064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f7ac8-81c4-4ade-94f2-8a0b62333b1f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:53.169525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b786df-1e5d-41ee-8c81-9ebd92898f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:53.170321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b786df-1e5d-41ee-8c81-9ebd92898f17 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:53.170600 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b786df-1e5d-41ee-8c81-9ebd92898f17 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:53.170868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b786df-1e5d-41ee-8c81-9ebd92898f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:53.190048 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b786df-1e5d-41ee-8c81-9ebd92898f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:53.191505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b786df-1e5d-41ee-8c81-9ebd92898f17 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:53.234420 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f7ac8-81c4-4ade-94f2-8a0b62333b1f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-16b786df-1e5d-41ee-8c81-9ebd92898f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:53.236381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:53.237268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:53.238161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:53.238161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:53.238161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:53.238161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:53.244554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 391/803] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:53.249990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b786df-1e5d-41ee-8c81-9ebd92898f17 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:53.274779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257fca6-8e7f-402a-9d6d-dbbe30fa3a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:53.275443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257fca6-8e7f-402a-9d6d-dbbe30fa3a5c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:53.275719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257fca6-8e7f-402a-9d6d-dbbe30fa3a5c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:53.275991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257fca6-8e7f-402a-9d6d-dbbe30fa3a5c None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:53.276737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257fca6-8e7f-402a-9d6d-dbbe30fa3a5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:53.277050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257fca6-8e7f-402a-9d6d-dbbe30fa3a5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:53.278401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257fca6-8e7f-402a-9d6d-dbbe30fa3a5c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:53.298842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 413/804] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:53.305023 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257fca6-8e7f-402a-9d6d-dbbe30fa3a5c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:53.426651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b786df-1e5d-41ee-8c81-9ebd92898f17 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:53.491349 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257fca6-8e7f-402a-9d6d-dbbe30fa3a5c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:53.497396 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8d0d4-4db1-4770-a040-bb21b9581846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:53.498071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8d0d4-4db1-4770-a040-bb21b9581846 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:53.498344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8d0d4-4db1-4770-a040-bb21b9581846 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:53.498712 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8d0d4-4db1-4770-a040-bb21b9581846 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:53.499445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8d0d4-4db1-4770-a040-bb21b9581846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:53.499750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8d0d4-4db1-4770-a040-bb21b9581846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:53.506778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8d0d4-4db1-4770-a040-bb21b9581846 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:53.527659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 392/805] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:53.533087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8d0d4-4db1-4770-a040-bb21b9581846 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:53.554830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8258c-1b93-4ac9-b7ea-90d003df8d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:53.555653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8258c-1b93-4ac9-b7ea-90d003df8d66 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:53.555929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8258c-1b93-4ac9-b7ea-90d003df8d66 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:53.556224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8258c-1b93-4ac9-b7ea-90d003df8d66 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:53.563565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8258c-1b93-4ac9-b7ea-90d003df8d66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:53.565097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8258c-1b93-4ac9-b7ea-90d003df8d66 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-adb8258c-1b93-4ac9-b7ea-90d003df8d66 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:53.588948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:53.589953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:53.590873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:53.590873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:53.590873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:53.590873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:53.590873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:53.590873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:53.590873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:53.590873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:53.590873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:58:53.590873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:53.590873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 414/806] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 08:58:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:53.601056 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8258c-1b93-4ac9-b7ea-90d003df8d66 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:53.672541 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8d0d4-4db1-4770-a040-bb21b9581846 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:53.736503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5b8bd-a2bf-4bec-9755-35fa39202725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:53.737296 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5b8bd-a2bf-4bec-9755-35fa39202725 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:53.737576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5b8bd-a2bf-4bec-9755-35fa39202725 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:53.737847 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5b8bd-a2bf-4bec-9755-35fa39202725 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:53.751982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5b8bd-a2bf-4bec-9755-35fa39202725 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:53.753398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5b8bd-a2bf-4bec-9755-35fa39202725 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:53.782772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8258c-1b93-4ac9-b7ea-90d003df8d66 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-e4a5b8bd-a2bf-4bec-9755-35fa39202725 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:53.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:53.794758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:53.795781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:53.795781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:53.795781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:53.795781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:53.795781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:53.795781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:53.795781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:53.795781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:53.795781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:58:53.795781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:53.799426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 393/807] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 08:58:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:53.800622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5b8bd-a2bf-4bec-9755-35fa39202725 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:53.855111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666ad7f-ea8d-4ca9-9594-fdb901543084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:53.855783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666ad7f-ea8d-4ca9-9594-fdb901543084 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:53.856064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666ad7f-ea8d-4ca9-9594-fdb901543084 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:53.856368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666ad7f-ea8d-4ca9-9594-fdb901543084 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:53.861811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666ad7f-ea8d-4ca9-9594-fdb901543084 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:53.862129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666ad7f-ea8d-4ca9-9594-fdb901543084 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:53.863558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666ad7f-ea8d-4ca9-9594-fdb901543084 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:53.885435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 415/808] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 3 08:58:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:53.890624 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666ad7f-ea8d-4ca9-9594-fdb901543084 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:54.001777 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5b8bd-a2bf-4bec-9755-35fa39202725 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:54.065541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666ad7f-ea8d-4ca9-9594-fdb901543084 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:54.083711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daae33b-bf5d-4e92-8ac4-579df9d11ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:54.085191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daae33b-bf5d-4e92-8ac4-579df9d11ad5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.085887 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daae33b-bf5d-4e92-8ac4-579df9d11ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.086406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daae33b-bf5d-4e92-8ac4-579df9d11ad5 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.087471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daae33b-bf5d-4e92-8ac4-579df9d11ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:54.088001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daae33b-bf5d-4e92-8ac4-579df9d11ad5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:54.089660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daae33b-bf5d-4e92-8ac4-579df9d11ad5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:54.113178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8ed3c-d64a-45a5-8e6f-652e74c62b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:54.114415 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8ed3c-d64a-45a5-8e6f-652e74c62b60 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.115489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8ed3c-d64a-45a5-8e6f-652e74c62b60 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.115981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8ed3c-d64a-45a5-8e6f-652e74c62b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.136039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 394/809] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 08:58:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:54.137021 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8ed3c-d64a-45a5-8e6f-652e74c62b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:54.139288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8ed3c-d64a-45a5-8e6f-652e74c62b60 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:54.141558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daae33b-bf5d-4e92-8ac4-579df9d11ad5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-f2c8ed3c-d64a-45a5-8e6f-652e74c62b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:54.176268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:54.177808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:54.178696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:54.178696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:54.178696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:54.178696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:54.178696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 416/810] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:54.185120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8ed3c-d64a-45a5-8e6f-652e74c62b60 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:54.261655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daae33b-bf5d-4e92-8ac4-579df9d11ad5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:54.295784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06185f4-ea01-4869-a0d7-d392c87f7068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:54.296453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06185f4-ea01-4869-a0d7-d392c87f7068 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.296730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06185f4-ea01-4869-a0d7-d392c87f7068 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.296996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06185f4-ea01-4869-a0d7-d392c87f7068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.301558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8ed3c-d64a-45a5-8e6f-652e74c62b60 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:54.335877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1044dc1-2f39-49a3-ab4c-2374ad88fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:54.336490 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1044dc1-2f39-49a3-ab4c-2374ad88fa3f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.336771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1044dc1-2f39-49a3-ab4c-2374ad88fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.337048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1044dc1-2f39-49a3-ab4c-2374ad88fa3f None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.337814 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1044dc1-2f39-49a3-ab4c-2374ad88fa3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:54.338116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1044dc1-2f39-49a3-ab4c-2374ad88fa3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:54.339563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1044dc1-2f39-49a3-ab4c-2374ad88fa3f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:54.352037 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 417/811] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:54.353521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426512e-8469-433b-989b-c11b70681811 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.353811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426512e-8469-433b-989b-c11b70681811 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.354085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426512e-8469-433b-989b-c11b70681811 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.355649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 418/812] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:54.360437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426512e-8469-433b-989b-c11b70681811 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:54.363567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06185f4-ea01-4869-a0d7-d392c87f7068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:54.365107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06185f4-ea01-4869-a0d7-d392c87f7068 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:54.462731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426512e-8469-433b-989b-c11b70681811 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:54.472272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 395/813] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:58:54.472272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00254c94-0bd4-47bd-9e25-a172a67e6283 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.472272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00254c94-0bd4-47bd-9e25-a172a67e6283 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.472272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00254c94-0bd4-47bd-9e25-a172a67e6283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.487707 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-00254c94-0bd4-47bd-9e25-a172a67e6283 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:54.488902 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-00254c94-0bd4-47bd-9e25-a172a67e6283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:54.495534 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353aadd-59d4-4645-b021-49043e4b9fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:54.496357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353aadd-59d4-4645-b021-49043e4b9fbe None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.496633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353aadd-59d4-4645-b021-49043e4b9fbe None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.496901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353aadd-59d4-4645-b021-49043e4b9fbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.504165 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353aadd-59d4-4645-b021-49043e4b9fbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:54.505617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353aadd-59d4-4645-b021-49043e4b9fbe None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-b353aadd-59d4-4645-b021-49043e4b9fbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:54.519142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:54.520265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:54.521932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:54.521932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:54.521932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:54.521932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:54.521932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:54.521932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:54.521932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:54.521932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:54.525440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 419/814] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:54.526736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2f905-e41e-4335-9b7f-9e7c6ce98213 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.527014 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2f905-e41e-4335-9b7f-9e7c6ce98213 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.527282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2f905-e41e-4335-9b7f-9e7c6ce98213 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.528696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 420/815] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:54.529231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2f905-e41e-4335-9b7f-9e7c6ce98213 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:54.572119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 396/816] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:58:54.572119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00254c94-0bd4-47bd-9e25-a172a67e6283 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:54.640022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2f905-e41e-4335-9b7f-9e7c6ce98213 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:54.666948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00254c94-0bd4-47bd-9e25-a172a67e6283 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:54.676614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89304987-ab72-4b60-9478-07c181bee289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:54.677444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89304987-ab72-4b60-9478-07c181bee289 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.677727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89304987-ab72-4b60-9478-07c181bee289 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.678005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89304987-ab72-4b60-9478-07c181bee289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.687876 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89304987-ab72-4b60-9478-07c181bee289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:54.689366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89304987-ab72-4b60-9478-07c181bee289 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:54.703007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df08897-6367-41db-960b-68fa8d2743b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:54.703662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df08897-6367-41db-960b-68fa8d2743b5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.704063 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df08897-6367-41db-960b-68fa8d2743b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.704370 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df08897-6367-41db-960b-68fa8d2743b5 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.705156 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df08897-6367-41db-960b-68fa8d2743b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:54.705460 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df08897-6367-41db-960b-68fa8d2743b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:54.706866 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df08897-6367-41db-960b-68fa8d2743b5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-89304987-ab72-4b60-9478-07c181bee289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:54.707029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:54.707911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:54.709847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:54.709847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:54.709847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:54.709847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:54.709847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 421/817] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:54.710396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6175079-0e99-4566-887c-8f80e892fe29 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.710682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6175079-0e99-4566-887c-8f80e892fe29 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.710955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6175079-0e99-4566-887c-8f80e892fe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.724402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 397/818] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:54.725508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df08897-6367-41db-960b-68fa8d2743b5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:54.726979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-d6175079-0e99-4566-887c-8f80e892fe29 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:54.728174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d6175079-0e99-4566-887c-8f80e892fe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:54.792040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 422/819] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:58:54.792893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6175079-0e99-4566-887c-8f80e892fe29 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:54.831877 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df08897-6367-41db-960b-68fa8d2743b5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:54.863443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d099285-f896-4cdf-a0ec-351aadfcf065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:54.864247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d099285-f896-4cdf-a0ec-351aadfcf065 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.864546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d099285-f896-4cdf-a0ec-351aadfcf065 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.864819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d099285-f896-4cdf-a0ec-351aadfcf065 None admin] PATH_INFO: `/v3/services/network` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.865457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d099285-f896-4cdf-a0ec-351aadfcf065 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:54.866798 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d099285-f896-4cdf-a0ec-351aadfcf065 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-9d099285-f896-4cdf-a0ec-351aadfcf065 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:54.879662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:54.881247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:54.882085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 398/820] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:54 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:54.882886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d099285-f896-4cdf-a0ec-351aadfcf065 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:54.898146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6175079-0e99-4566-887c-8f80e892fe29 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:54.928905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5f252-1f71-4274-9558-ffd0bc6e3a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:54.929559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5f252-1f71-4274-9558-ffd0bc6e3a85 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:54.929842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5f252-1f71-4274-9558-ffd0bc6e3a85 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:54.930113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5f252-1f71-4274-9558-ffd0bc6e3a85 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:54.930820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5f252-1f71-4274-9558-ffd0bc6e3a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:54.931120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5f252-1f71-4274-9558-ffd0bc6e3a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:54.932506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5f252-1f71-4274-9558-ffd0bc6e3a85 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:54.943566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 423/821] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:54.944366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5f252-1f71-4274-9558-ffd0bc6e3a85 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:54.974861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d099285-f896-4cdf-a0ec-351aadfcf065 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:55.006222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d61142-9bdf-45a1-a5a0-a82ad524923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:55.007089 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d61142-9bdf-45a1-a5a0-a82ad524923b None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.007366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d61142-9bdf-45a1-a5a0-a82ad524923b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.007636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d61142-9bdf-45a1-a5a0-a82ad524923b None admin] PATH_INFO: `/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/14cf4626439e4b689a036f47a0023ea0/roles/4bf5d4bd3a884670a5898236973cff13` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.021253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d61142-9bdf-45a1-a5a0-a82ad524923b None admin] RBAC: Authorizing `identity:create_grant(project_id=250761bd5a9e48e0b26fedcf65d88a5d, user_id=14cf4626439e4b689a036f47a0023ea0, role_id=4bf5d4bd3a884670a5898236973cff13)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:55.022855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d61142-9bdf-45a1-a5a0-a82ad524923b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:55.035040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 399/822] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:58:54 2022] PUT /identity/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/14cf4626439e4b689a036f47a0023ea0/roles/4bf5d4bd3a884670a5898236973cff13 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:58:55.044298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889132c-3fdb-4b03-88ca-ff1fefa0c365 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.044298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889132c-3fdb-4b03-88ca-ff1fefa0c365 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.044298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889132c-3fdb-4b03-88ca-ff1fefa0c365 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.044298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 400/823] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:55.044298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889132c-3fdb-4b03-88ca-ff1fefa0c365 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:55.055965 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5f252-1f71-4274-9558-ffd0bc6e3a85 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:55.091346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea542a-da13-449b-a00e-d1703994cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:55.092312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea542a-da13-449b-a00e-d1703994cf50 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.092838 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea542a-da13-449b-a00e-d1703994cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.093064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea542a-da13-449b-a00e-d1703994cf50 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.093841 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea542a-da13-449b-a00e-d1703994cf50 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:55.095349 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea542a-da13-449b-a00e-d1703994cf50 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-90ea542a-da13-449b-a00e-d1703994cf50 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:55.108163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:55.109407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 08:58:55.110480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:55.112575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 424/824] 10.222.0.23 () {56 vars in 1129 bytes} [Tue May 3 08:58:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:55.113480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea542a-da13-449b-a00e-d1703994cf50 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:55.146688 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889132c-3fdb-4b03-88ca-ff1fefa0c365 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:55.182455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d314206-4db2-4279-bc70-6fde4817e756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:55.183180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d314206-4db2-4279-bc70-6fde4817e756 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.183568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d314206-4db2-4279-bc70-6fde4817e756 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.183943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d314206-4db2-4279-bc70-6fde4817e756 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.184783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d314206-4db2-4279-bc70-6fde4817e756 None admin] RBAC: Adding query filter params (name=network) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:55.185182 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d314206-4db2-4279-bc70-6fde4817e756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:55.186638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d314206-4db2-4279-bc70-6fde4817e756 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:55.191819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 401/825] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:58:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:55.193826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f9757-c842-4d41-a524-7a8d552bb434 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.194209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f9757-c842-4d41-a524-7a8d552bb434 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.194576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f9757-c842-4d41-a524-7a8d552bb434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.211954 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-997f9757-c842-4d41-a524-7a8d552bb434 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:55.213429 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-997f9757-c842-4d41-a524-7a8d552bb434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:55.219924 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea542a-da13-449b-a00e-d1703994cf50 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:55.254868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bde8d1-34c0-484c-b0fa-670a313b161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:55.256307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bde8d1-34c0-484c-b0fa-670a313b161c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.256584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bde8d1-34c0-484c-b0fa-670a313b161c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.256853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bde8d1-34c0-484c-b0fa-670a313b161c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.263593 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bde8d1-34c0-484c-b0fa-670a313b161c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:55.265097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bde8d1-34c0-484c-b0fa-670a313b161c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-a6bde8d1-34c0-484c-b0fa-670a313b161c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:55.279445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:55.280574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:55.284608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:55.284608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:55.284608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:55.284608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:55.284608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:55.284608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:55.284608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:55.284608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:55.288523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 402/826] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:58:55.288523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f9757-c842-4d41-a524-7a8d552bb434 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:55.289008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 425/827] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:55.289008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bde8d1-34c0-484c-b0fa-670a313b161c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:55.376784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f9757-c842-4d41-a524-7a8d552bb434 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:55.381660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bde8d1-34c0-484c-b0fa-670a313b161c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:55.408981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce666791-3656-4567-bbea-a8163bac1fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:55.409644 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666791-3656-4567-bbea-a8163bac1fdd None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.409916 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666791-3656-4567-bbea-a8163bac1fdd None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.410185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666791-3656-4567-bbea-a8163bac1fdd None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.410878 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce666791-3656-4567-bbea-a8163bac1fdd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:55.411227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce666791-3656-4567-bbea-a8163bac1fdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:55.413085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce666791-3656-4567-bbea-a8163bac1fdd None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:55.414177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc314b6d-25b3-4c18-8b60-2e72c9982395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:55.414831 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc314b6d-25b3-4c18-8b60-2e72c9982395 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.415111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc314b6d-25b3-4c18-8b60-2e72c9982395 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.415384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc314b6d-25b3-4c18-8b60-2e72c9982395 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.416100 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc314b6d-25b3-4c18-8b60-2e72c9982395 None admin] RBAC: Adding query filter params (type=network) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:55.416420 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc314b6d-25b3-4c18-8b60-2e72c9982395 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:55.422149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 403/828] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 3 08:58:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:55.422289 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc314b6d-25b3-4c18-8b60-2e72c9982395 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:55.422382 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce666791-3656-4567-bbea-a8163bac1fdd None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:55.423608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 426/829] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:58:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:55.428221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc314b6d-25b3-4c18-8b60-2e72c9982395 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:55.516420 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce666791-3656-4567-bbea-a8163bac1fdd None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:55.521659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc314b6d-25b3-4c18-8b60-2e72c9982395 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:55.549487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1f7b1-c585-4155-9334-45b40efedfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:55.550139 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f7b1-c585-4155-9334-45b40efedfe3 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.550416 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f7b1-c585-4155-9334-45b40efedfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.550686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f7b1-c585-4155-9334-45b40efedfe3 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.551471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1f7b1-c585-4155-9334-45b40efedfe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:55.551750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1f7b1-c585-4155-9334-45b40efedfe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:55.553799 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1f7b1-c585-4155-9334-45b40efedfe3 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:55.554894 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417badb9-c573-48e7-847c-28021ad7ab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:55.555704 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417badb9-c573-48e7-847c-28021ad7ab4e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.555986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417badb9-c573-48e7-847c-28021ad7ab4e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.556288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417badb9-c573-48e7-847c-28021ad7ab4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.565255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 404/830] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:55.566041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1f7b1-c585-4155-9334-45b40efedfe3 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:55.570662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417badb9-c573-48e7-847c-28021ad7ab4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-417badb9-c573-48e7-847c-28021ad7ab4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:55.578600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:55.579757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 427/831] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:55.580623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417badb9-c573-48e7-847c-28021ad7ab4e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:55.663797 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1f7b1-c585-4155-9334-45b40efedfe3 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:55.675207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417badb9-c573-48e7-847c-28021ad7ab4e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:55.697997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad87481-ef44-4344-b207-2bb270fff443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:55.698650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87481-ef44-4344-b207-2bb270fff443 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.698931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87481-ef44-4344-b207-2bb270fff443 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.699466 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87481-ef44-4344-b207-2bb270fff443 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.700198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad87481-ef44-4344-b207-2bb270fff443 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:55.700511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad87481-ef44-4344-b207-2bb270fff443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:55.701864 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad87481-ef44-4344-b207-2bb270fff443 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:55.706899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 405/832] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 3 08:58:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:55.707745 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad87481-ef44-4344-b207-2bb270fff443 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:55.713068 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f668abc-128c-4e3c-b257-1253e09b3b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:55.713731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f668abc-128c-4e3c-b257-1253e09b3b12 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.714013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f668abc-128c-4e3c-b257-1253e09b3b12 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.714282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f668abc-128c-4e3c-b257-1253e09b3b12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.715016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f668abc-128c-4e3c-b257-1253e09b3b12 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:55.716398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f668abc-128c-4e3c-b257-1253e09b3b12 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:55.744113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 428/833] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 08:58:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:58:55.744113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f668abc-128c-4e3c-b257-1253e09b3b12 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:55.812947 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad87481-ef44-4344-b207-2bb270fff443 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:55.858166 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f668abc-128c-4e3c-b257-1253e09b3b12 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:55.858367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135108e-0e9f-4046-89cb-ab3e9a94bea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:55.858823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135108e-0e9f-4046-89cb-ab3e9a94bea4 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.859102 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135108e-0e9f-4046-89cb-ab3e9a94bea4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.859373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135108e-0e9f-4046-89cb-ab3e9a94bea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.860305 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135108e-0e9f-4046-89cb-ab3e9a94bea4 None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=2b863628035e4767b08fb5efc5c80958) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:55.860616 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135108e-0e9f-4046-89cb-ab3e9a94bea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:55.862080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135108e-0e9f-4046-89cb-ab3e9a94bea4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:55.869054 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 406/834] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:55 2022] GET /identity/v3/role_assignments?user.id=2b863628035e4767b08fb5efc5c80958&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:55.869889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135108e-0e9f-4046-89cb-ab3e9a94bea4 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:55.894096 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6be0c-f623-4802-a005-0ade37dc2f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:55.894782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6be0c-f623-4802-a005-0ade37dc2f1f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:55.895060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6be0c-f623-4802-a005-0ade37dc2f1f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:55.895396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6be0c-f623-4802-a005-0ade37dc2f1f None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:55.896745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6be0c-f623-4802-a005-0ade37dc2f1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:55.897051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6be0c-f623-4802-a005-0ade37dc2f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:55.898453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6be0c-f623-4802-a005-0ade37dc2f1f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:55.907810 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 429/835] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:55.922401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6be0c-f623-4802-a005-0ade37dc2f1f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:55.986076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135108e-0e9f-4046-89cb-ab3e9a94bea4 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:56.031354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c015-82c6-4ea2-b2cb-412fb7791706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:56.032027 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c015-82c6-4ea2-b2cb-412fb7791706 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:56.032336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c015-82c6-4ea2-b2cb-412fb7791706 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:56.032613 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c015-82c6-4ea2-b2cb-412fb7791706 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:56.033364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4c015-82c6-4ea2-b2cb-412fb7791706 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:56.034765 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4c015-82c6-4ea2-b2cb-412fb7791706 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:56.060241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 407/836] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 08:58:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:58:56.079581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6be0c-f623-4802-a005-0ade37dc2f1f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:56.125291 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4152c-288b-4b4e-af26-86957f6df205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:56.126094 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4152c-288b-4b4e-af26-86957f6df205 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:56.126374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4152c-288b-4b4e-af26-86957f6df205 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:56.126644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4152c-288b-4b4e-af26-86957f6df205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:56.139549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4152c-288b-4b4e-af26-86957f6df205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:56.141100 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4152c-288b-4b4e-af26-86957f6df205 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-80e4152c-288b-4b4e-af26-86957f6df205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:56.160644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:56.161666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:56.162556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:56.162556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:56.162556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:56.162556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:56.162556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 430/837] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:56.167959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c015-82c6-4ea2-b2cb-412fb7791706 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:56.291829 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c015-82c6-4ea2-b2cb-412fb7791706 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:56.328431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed267a24-30e6-4e6d-8eff-cd1fbcb8088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:56.329094 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed267a24-30e6-4e6d-8eff-cd1fbcb8088c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:56.329377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed267a24-30e6-4e6d-8eff-cd1fbcb8088c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:56.329708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed267a24-30e6-4e6d-8eff-cd1fbcb8088c None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:56.330394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed267a24-30e6-4e6d-8eff-cd1fbcb8088c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:56.330694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed267a24-30e6-4e6d-8eff-cd1fbcb8088c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:56.332058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed267a24-30e6-4e6d-8eff-cd1fbcb8088c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:56.344599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 408/838] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:56.349772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4152c-288b-4b4e-af26-86957f6df205 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:56.455610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4152c-288b-4b4e-af26-86957f6df205 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:56.490113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d24d8-ef33-4383-9542-441184fb0f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:56.491319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d24d8-ef33-4383-9542-441184fb0f23 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:56.491868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d24d8-ef33-4383-9542-441184fb0f23 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:56.492486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d24d8-ef33-4383-9542-441184fb0f23 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:56.500914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d24d8-ef33-4383-9542-441184fb0f23 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:56.502826 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d24d8-ef33-4383-9542-441184fb0f23 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-a05d24d8-ef33-4383-9542-441184fb0f23 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:56.518398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:56.519380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:56.520378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:56.520378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:56.520378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:56.520378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:56.520378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:56.520378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:56.520378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:56.520378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:56.520378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 08:58:56.520378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:56.523061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 431/839] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:58:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:56.528366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed267a24-30e6-4e6d-8eff-cd1fbcb8088c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:56.624175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed267a24-30e6-4e6d-8eff-cd1fbcb8088c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:56.656598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf65eb-ddd5-48b6-8e8f-201d902ccdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:56.657251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf65eb-ddd5-48b6-8e8f-201d902ccdcc None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:56.657530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf65eb-ddd5-48b6-8e8f-201d902ccdcc None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:56.657894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf65eb-ddd5-48b6-8e8f-201d902ccdcc None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:56.658720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf65eb-ddd5-48b6-8e8f-201d902ccdcc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:56.659031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf65eb-ddd5-48b6-8e8f-201d902ccdcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:56.660528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf65eb-ddd5-48b6-8e8f-201d902ccdcc None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:56.678399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 409/840] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 3 08:58:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:56.683787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d24d8-ef33-4383-9542-441184fb0f23 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:56.779607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d24d8-ef33-4383-9542-441184fb0f23 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:56.818022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f6483-03d5-4079-abfc-4ce5852cd1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:56.818725 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f6483-03d5-4079-abfc-4ce5852cd1bb None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:56.819033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f6483-03d5-4079-abfc-4ce5852cd1bb None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:56.819308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f6483-03d5-4079-abfc-4ce5852cd1bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:56.887651 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f6483-03d5-4079-abfc-4ce5852cd1bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:56.889033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f6483-03d5-4079-abfc-4ce5852cd1bb None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:56.988491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 432/841] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:58:56.994110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf65eb-ddd5-48b6-8e8f-201d902ccdcc None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:57.093737 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf65eb-ddd5-48b6-8e8f-201d902ccdcc None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:57.127363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9aed-7458-466c-a1c4-447d9c81e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:57.128175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9aed-7458-466c-a1c4-447d9c81e0cf None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:57.128455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9aed-7458-466c-a1c4-447d9c81e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:57.128725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9aed-7458-466c-a1c4-447d9c81e0cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:57.139588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e9aed-7458-466c-a1c4-447d9c81e0cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:57.140988 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e9aed-7458-466c-a1c4-447d9c81e0cf None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-f69e9aed-7458-466c-a1c4-447d9c81e0cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:57.158833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:57.159728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:57.160655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:57.160655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:57.160655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:57.160655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:57.160655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 410/842] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:57.166998 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f6483-03d5-4079-abfc-4ce5852cd1bb None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:57.285833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f6483-03d5-4079-abfc-4ce5852cd1bb None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:57.320135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c09f1-7725-40d5-bf5b-29ce0a6b6f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:57.320857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c09f1-7725-40d5-bf5b-29ce0a6b6f7e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:57.321144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c09f1-7725-40d5-bf5b-29ce0a6b6f7e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:57.321625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c09f1-7725-40d5-bf5b-29ce0a6b6f7e None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:57.322470 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c09f1-7725-40d5-bf5b-29ce0a6b6f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:57.322776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c09f1-7725-40d5-bf5b-29ce0a6b6f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:57.324407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c09f1-7725-40d5-bf5b-29ce0a6b6f7e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:57.336059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 433/843] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:57.341456 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9aed-7458-466c-a1c4-447d9c81e0cf None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:57.420524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac330df5-d855-44df-b7c1-86f5e5d53553 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:57.420700 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac330df5-d855-44df-b7c1-86f5e5d53553 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:57.420910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac330df5-d855-44df-b7c1-86f5e5d53553 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:57.422628 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 434/844] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:57.427944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180d2b8-592e-40f2-a3b2-86eb722104a6 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:57.428261 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180d2b8-592e-40f2-a3b2-86eb722104a6 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:57.428535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180d2b8-592e-40f2-a3b2-86eb722104a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:57.445613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f180d2b8-592e-40f2-a3b2-86eb722104a6 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:57.446027 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9aed-7458-466c-a1c4-447d9c81e0cf None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:57.446785 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f180d2b8-592e-40f2-a3b2-86eb722104a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:57.479898 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe5eb5-a4b1-41ed-8593-53a050940b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:57.481012 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe5eb5-a4b1-41ed-8593-53a050940b1c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:57.481510 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe5eb5-a4b1-41ed-8593-53a050940b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:57.481998 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe5eb5-a4b1-41ed-8593-53a050940b1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:57.488906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe5eb5-a4b1-41ed-8593-53a050940b1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:57.491109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe5eb5-a4b1-41ed-8593-53a050940b1c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-f2fe5eb5-a4b1-41ed-8593-53a050940b1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:57.505705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:57.506892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:57.507783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:57.507783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:57.507783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:57.507783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:57.507783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:57.507783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:57.507783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:57.507783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:57.512359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 411/845] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:57.520107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe5eb5-a4b1-41ed-8593-53a050940b1c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:57.520337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 435/846] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:58:57.538717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180d2b8-592e-40f2-a3b2-86eb722104a6 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:57.638414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe5eb5-a4b1-41ed-8593-53a050940b1c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:57.651650 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180d2b8-592e-40f2-a3b2-86eb722104a6 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:57.683179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950b697-c626-4fbc-9318-bcb6c4284847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:57.684747 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950b697-c626-4fbc-9318-bcb6c4284847 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:57.685260 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950b697-c626-4fbc-9318-bcb6c4284847 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:57.685899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950b697-c626-4fbc-9318-bcb6c4284847 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:57.687469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950b697-c626-4fbc-9318-bcb6c4284847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:57.687986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950b697-c626-4fbc-9318-bcb6c4284847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:57.689635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950b697-c626-4fbc-9318-bcb6c4284847 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:57.690896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870ef28-204f-4d2a-bac2-5b1e71e92777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:57.691843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870ef28-204f-4d2a-bac2-5b1e71e92777 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:57.692152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870ef28-204f-4d2a-bac2-5b1e71e92777 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:57.692428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870ef28-204f-4d2a-bac2-5b1e71e92777 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:57.704379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870ef28-204f-4d2a-bac2-5b1e71e92777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:58:57.705031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 412/847] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-e870ef28-204f-4d2a-bac2-5b1e71e92777 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:58:57.712035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:57.713022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:57.713882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 436/848] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 08:58:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:57.717063 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950b697-c626-4fbc-9318-bcb6c4284847 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:57.728110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870ef28-204f-4d2a-bac2-5b1e71e92777 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:57.821211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870ef28-204f-4d2a-bac2-5b1e71e92777 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:57.827080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950b697-c626-4fbc-9318-bcb6c4284847 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:57.856402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629d2ec-60db-41b3-a145-7b8f4c507f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:57.857515 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629d2ec-60db-41b3-a145-7b8f4c507f7f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:57.857984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629d2ec-60db-41b3-a145-7b8f4c507f7f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:57.858444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629d2ec-60db-41b3-a145-7b8f4c507f7f None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:57.860022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629d2ec-60db-41b3-a145-7b8f4c507f7f None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:57.860412 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629d2ec-60db-41b3-a145-7b8f4c507f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:57.861826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc29b5-7faf-4b83-96b5-d7f7959d03a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:57.861969 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629d2ec-60db-41b3-a145-7b8f4c507f7f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:57.862474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc29b5-7faf-4b83-96b5-d7f7959d03a6 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:57.862756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc29b5-7faf-4b83-96b5-d7f7959d03a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:57.863032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc29b5-7faf-4b83-96b5-d7f7959d03a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:57.863871 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc29b5-7faf-4b83-96b5-d7f7959d03a6 None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=2360e3a110b042a8839c45aa50a39724) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:57.864215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc29b5-7faf-4b83-96b5-d7f7959d03a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:57.866255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc29b5-7faf-4b83-96b5-d7f7959d03a6 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:57.870907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 437/849] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 08:58:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:57.876486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 413/850] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:57 2022] GET /identity/v3/role_assignments?user.id=2360e3a110b042a8839c45aa50a39724&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:57.881326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629d2ec-60db-41b3-a145-7b8f4c507f7f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:57.991277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629d2ec-60db-41b3-a145-7b8f4c507f7f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:58.027352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e82093-13b2-4d40-80fc-384c634eb845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:58.028194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e82093-13b2-4d40-80fc-384c634eb845 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:58.028474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e82093-13b2-4d40-80fc-384c634eb845 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:58.028745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e82093-13b2-4d40-80fc-384c634eb845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:58.041178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e82093-13b2-4d40-80fc-384c634eb845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:58.042648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e82093-13b2-4d40-80fc-384c634eb845 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-89e82093-13b2-4d40-80fc-384c634eb845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:58.061154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:58.062196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:58.063074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:58.063074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:58.063074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:58.063074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:58.063074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 438/851] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:58.069569 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc29b5-7faf-4b83-96b5-d7f7959d03a6 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:58.179669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc29b5-7faf-4b83-96b5-d7f7959d03a6 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:58.217594 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155605fe-d9b1-49aa-9df2-9b75298f953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:58.218653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155605fe-d9b1-49aa-9df2-9b75298f953a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:58.219168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155605fe-d9b1-49aa-9df2-9b75298f953a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:58.219665 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155605fe-d9b1-49aa-9df2-9b75298f953a None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:58.220775 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155605fe-d9b1-49aa-9df2-9b75298f953a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:58.221322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155605fe-d9b1-49aa-9df2-9b75298f953a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:58.223001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155605fe-d9b1-49aa-9df2-9b75298f953a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:58.238163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 414/852] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:58.247959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e82093-13b2-4d40-80fc-384c634eb845 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:58.354223 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e82093-13b2-4d40-80fc-384c634eb845 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:58.390835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4212af-bdbb-4a5e-bef2-8df64c17f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:58.391644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4212af-bdbb-4a5e-bef2-8df64c17f71a None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:58.391924 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4212af-bdbb-4a5e-bef2-8df64c17f71a None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:58.392224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4212af-bdbb-4a5e-bef2-8df64c17f71a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:58.400621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4212af-bdbb-4a5e-bef2-8df64c17f71a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:58.402046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4212af-bdbb-4a5e-bef2-8df64c17f71a None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:58.406113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97bfe-2163-4f6c-8d2c-616c85ea79aa None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:58.406578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97bfe-2163-4f6c-8d2c-616c85ea79aa None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:58.406655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97bfe-2163-4f6c-8d2c-616c85ea79aa None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:58.408150 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 415/853] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:58.413173 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281fd5e-7aa4-42b8-8604-399de6f422b2 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:58.413461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281fd5e-7aa4-42b8-8604-399de6f422b2 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:58.413737 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281fd5e-7aa4-42b8-8604-399de6f422b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-4f4212af-bdbb-4a5e-bef2-8df64c17f71a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:58:58.420150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:58.421082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:58.422008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:58.422008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:58.422008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:58:58.422008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:58:58.422008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:58:58.422008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:58:58.422008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:58:58.422008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:58:58.422008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:58:58.422008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:58.422008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 439/854] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 08:58:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:58.428318 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4212af-bdbb-4a5e-bef2-8df64c17f71a None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:58.431022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-4281fd5e-7aa4-42b8-8604-399de6f422b2 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:58.432242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4281fd5e-7aa4-42b8-8604-399de6f422b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:58.505868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 416/855] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:58:58.523095 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281fd5e-7aa4-42b8-8604-399de6f422b2 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:58.531090 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4212af-bdbb-4a5e-bef2-8df64c17f71a None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:58.566037 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42400eb2-bfab-4b62-a311-6c1e41520d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:58.566702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400eb2-bfab-4b62-a311-6c1e41520d77 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:58.566984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400eb2-bfab-4b62-a311-6c1e41520d77 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:58.567257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400eb2-bfab-4b62-a311-6c1e41520d77 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:58.568652 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42400eb2-bfab-4b62-a311-6c1e41520d77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:58.568960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42400eb2-bfab-4b62-a311-6c1e41520d77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:58.570361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42400eb2-bfab-4b62-a311-6c1e41520d77 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:58.587691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 440/856] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 3 08:58:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:58.588840 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb9f1-c099-4c73-80ae-0b29e935a85f None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:58.589127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb9f1-c099-4c73-80ae-0b29e935a85f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:58.589405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb9f1-c099-4c73-80ae-0b29e935a85f None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:58.590732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 441/857] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:58:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:58:58.592912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffb9f1-c099-4c73-80ae-0b29e935a85f None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:58.631291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281fd5e-7aa4-42b8-8604-399de6f422b2 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:58.664449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983a75f-fe92-4061-a87e-2acd031bb90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:58.665247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983a75f-fe92-4061-a87e-2acd031bb90c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:58.665523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983a75f-fe92-4061-a87e-2acd031bb90c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:58.665787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983a75f-fe92-4061-a87e-2acd031bb90c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:58.666437 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983a75f-fe92-4061-a87e-2acd031bb90c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:58.667783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983a75f-fe92-4061-a87e-2acd031bb90c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-f983a75f-fe92-4061-a87e-2acd031bb90c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:58.680205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:58.681155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:58.681995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 417/858] 10.222.0.23 () {56 vars in 1132 bytes} [Tue May 3 08:58:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:58.682836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab6cb1-ff5d-4462-bd1c-defe29b26875 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:58.682836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab6cb1-ff5d-4462-bd1c-defe29b26875 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:58.683519 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab6cb1-ff5d-4462-bd1c-defe29b26875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:58.693992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffb9f1-c099-4c73-80ae-0b29e935a85f None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:58.700651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-4bab6cb1-ff5d-4462-bd1c-defe29b26875 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:58:58.701811 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4bab6cb1-ff5d-4462-bd1c-defe29b26875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:58:58.727526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccae9db-7dc7-4405-a9db-0cb119b89d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:58.728318 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae9db-7dc7-4405-a9db-0cb119b89d16 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:58.728604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae9db-7dc7-4405-a9db-0cb119b89d16 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:58.728877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae9db-7dc7-4405-a9db-0cb119b89d16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:58.767412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 418/859] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:58:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:58:58.768209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab6cb1-ff5d-4462-bd1c-defe29b26875 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:58.804672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccae9db-7dc7-4405-a9db-0cb119b89d16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:58.806215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccae9db-7dc7-4405-a9db-0cb119b89d16 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:58.871238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab6cb1-ff5d-4462-bd1c-defe29b26875 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:58.909524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 442/860] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:58:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:58:58.909524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccae9db-7dc7-4405-a9db-0cb119b89d16 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:58.915171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453af0-8673-40e0-8bbf-174ecf73aca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:58.916227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453af0-8673-40e0-8bbf-174ecf73aca9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:58.916511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453af0-8673-40e0-8bbf-174ecf73aca9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:58.916782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453af0-8673-40e0-8bbf-174ecf73aca9 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:58.918070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad453af0-8673-40e0-8bbf-174ecf73aca9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:58.918385 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad453af0-8673-40e0-8bbf-174ecf73aca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:58.920321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad453af0-8673-40e0-8bbf-174ecf73aca9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:58.931023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 419/861] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 08:58:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:58.931023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453af0-8673-40e0-8bbf-174ecf73aca9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:59.000869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccae9db-7dc7-4405-a9db-0cb119b89d16 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:59.026029 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453af0-8673-40e0-8bbf-174ecf73aca9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:59.033842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4151e-3d93-4110-a877-eb2063a6c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:59.034634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4151e-3d93-4110-a877-eb2063a6c128 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:59.034917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4151e-3d93-4110-a877-eb2063a6c128 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:59.035211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4151e-3d93-4110-a877-eb2063a6c128 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:59.035836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4151e-3d93-4110-a877-eb2063a6c128 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:59.037264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4151e-3d93-4110-a877-eb2063a6c128 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-97f4151e-3d93-4110-a877-eb2063a6c128 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:59.049029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:59.050006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:59.050948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 443/862] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:58:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:59.051754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4151e-3d93-4110-a877-eb2063a6c128 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:59.068147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea05cb-874e-48d2-941a-0af42141614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:59.068935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea05cb-874e-48d2-941a-0af42141614a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:59.069216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea05cb-874e-48d2-941a-0af42141614a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:59.069516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea05cb-874e-48d2-941a-0af42141614a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:59.079534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea05cb-874e-48d2-941a-0af42141614a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:59.080988 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea05cb-874e-48d2-941a-0af42141614a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-eaea05cb-874e-48d2-941a-0af42141614a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:58:59.098273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:59.099694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:59.100627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:58:59.100627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:58:59.100627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:58:59.100627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:58:59.100627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 420/863] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:58:59.100911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea05cb-874e-48d2-941a-0af42141614a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:59.159387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4151e-3d93-4110-a877-eb2063a6c128 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:59.192973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5e32b-d8b7-4688-9273-1d17f8765d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:59.193635 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5e32b-d8b7-4688-9273-1d17f8765d6a None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:59.193918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5e32b-d8b7-4688-9273-1d17f8765d6a None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:59.194191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5e32b-d8b7-4688-9273-1d17f8765d6a None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:59.194890 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5e32b-d8b7-4688-9273-1d17f8765d6a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:59.195196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5e32b-d8b7-4688-9273-1d17f8765d6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:59.196607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5e32b-d8b7-4688-9273-1d17f8765d6a None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:59.201448 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 444/864] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 08:58:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:59.202226 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5e32b-d8b7-4688-9273-1d17f8765d6a None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:59.226471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea05cb-874e-48d2-941a-0af42141614a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:59.272264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c64895-e8a3-4a1b-8b50-fdab5143409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:59.273461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64895-e8a3-4a1b-8b50-fdab5143409c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:59.273819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64895-e8a3-4a1b-8b50-fdab5143409c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:59.274355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64895-e8a3-4a1b-8b50-fdab5143409c None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:59.275088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c64895-e8a3-4a1b-8b50-fdab5143409c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:59.275393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c64895-e8a3-4a1b-8b50-fdab5143409c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:59.277403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c64895-e8a3-4a1b-8b50-fdab5143409c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:59.283941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 421/865] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:58:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:59.289889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c64895-e8a3-4a1b-8b50-fdab5143409c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:59.326685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5e32b-d8b7-4688-9273-1d17f8765d6a None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:59.372512 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf581c53-68c5-4cc4-b9e7-763e876f4579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:59.373547 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf581c53-68c5-4cc4-b9e7-763e876f4579 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:59.374167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf581c53-68c5-4cc4-b9e7-763e876f4579 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:59.375001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf581c53-68c5-4cc4-b9e7-763e876f4579 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:59.376249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf581c53-68c5-4cc4-b9e7-763e876f4579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:59.376748 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf581c53-68c5-4cc4-b9e7-763e876f4579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:59.378829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf581c53-68c5-4cc4-b9e7-763e876f4579 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:59.394743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 445/866] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:59.396284 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c64895-e8a3-4a1b-8b50-fdab5143409c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:59.400999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf581c53-68c5-4cc4-b9e7-763e876f4579 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:59.433274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c57115-0f06-44df-a337-0fe808d718fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:59.434076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57115-0f06-44df-a337-0fe808d718fe None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:59.434482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57115-0f06-44df-a337-0fe808d718fe None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:59.434860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57115-0f06-44df-a337-0fe808d718fe None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:59.435673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c57115-0f06-44df-a337-0fe808d718fe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:59.436073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c57115-0f06-44df-a337-0fe808d718fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:59.437569 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c57115-0f06-44df-a337-0fe808d718fe None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:59.442692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 422/867] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:58:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:58:59.519645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf581c53-68c5-4cc4-b9e7-763e876f4579 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:59.558700 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fef61d-e504-47ef-9c68-760cc96f741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:59.559803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fef61d-e504-47ef-9c68-760cc96f741f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:59.560273 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fef61d-e504-47ef-9c68-760cc96f741f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:59.560744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fef61d-e504-47ef-9c68-760cc96f741f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:59.569205 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fef61d-e504-47ef-9c68-760cc96f741f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:59.570903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fef61d-e504-47ef-9c68-760cc96f741f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-17fef61d-e504-47ef-9c68-760cc96f741f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:58:59.586361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:58:59.587538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:58:59.588687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:58:59.588687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:58:59.588687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:58:59.588687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:58:59.588687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:58:59.588687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:58:59.588687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:58:59.588687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:58:59.590960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 446/868] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:58:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:58:59.596574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c57115-0f06-44df-a337-0fe808d718fe None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:59.703701 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c57115-0f06-44df-a337-0fe808d718fe None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:59.737713 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995637c-430a-4f6a-9f69-4beb38e29d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:59.738372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995637c-430a-4f6a-9f69-4beb38e29d73 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:59.738654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995637c-430a-4f6a-9f69-4beb38e29d73 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:59.738931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995637c-430a-4f6a-9f69-4beb38e29d73 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:59.740282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995637c-430a-4f6a-9f69-4beb38e29d73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:59.740592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995637c-430a-4f6a-9f69-4beb38e29d73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:59.742113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995637c-430a-4f6a-9f69-4beb38e29d73 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:59.754084 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 423/869] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:58:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:58:59.760292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fef61d-e504-47ef-9c68-760cc96f741f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:58:59.860356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fef61d-e504-47ef-9c68-760cc96f741f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:58:59.893831 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cb6f4-b837-48c7-a379-461535cd572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:58:59.894823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cb6f4-b837-48c7-a379-461535cd572f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:58:59.895330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cb6f4-b837-48c7-a379-461535cd572f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:58:59.895849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cb6f4-b837-48c7-a379-461535cd572f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:58:59.896948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cb6f4-b837-48c7-a379-461535cd572f None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=14cf4626439e4b689a036f47a0023ea0) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:58:59.897459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cb6f4-b837-48c7-a379-461535cd572f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:58:59.899066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cb6f4-b837-48c7-a379-461535cd572f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:58:59.905124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 447/870] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:58:59 2022] GET /identity/v3/role_assignments?user.id=14cf4626439e4b689a036f47a0023ea0&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:00.300363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312010c8-0b53-4421-b3a3-3ebd329eee0e None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:00.300694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312010c8-0b53-4421-b3a3-3ebd329eee0e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:00.300922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312010c8-0b53-4421-b3a3-3ebd329eee0e None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:00.302558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 424/871] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:00.307884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96dba7-3eb6-4201-a2b7-c3f6572e8a3d None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:00.308202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96dba7-3eb6-4201-a2b7-c3f6572e8a3d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:00.308482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96dba7-3eb6-4201-a2b7-c3f6572e8a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:00.325364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-da96dba7-3eb6-4201-a2b7-c3f6572e8a3d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:00.326530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-da96dba7-3eb6-4201-a2b7-c3f6572e8a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:00.395195 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 448/872] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:00.417919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312010c8-0b53-4421-b3a3-3ebd329eee0e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:00.526483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312010c8-0b53-4421-b3a3-3ebd329eee0e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:00.560764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526a06-8b33-4209-a095-37d10d292cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:00.561559 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526a06-8b33-4209-a095-37d10d292cad None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:00.561839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526a06-8b33-4209-a095-37d10d292cad None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:00.562120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526a06-8b33-4209-a095-37d10d292cad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:00.562769 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526a06-8b33-4209-a095-37d10d292cad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:00.564209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526a06-8b33-4209-a095-37d10d292cad None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-49526a06-8b33-4209-a095-37d10d292cad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:00.576566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:00.577527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:00.578445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:00.582604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 425/873] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 08:59:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:00.584493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96dba7-3eb6-4201-a2b7-c3f6572e8a3d None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:00.680190 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96dba7-3eb6-4201-a2b7-c3f6572e8a3d None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:00.716667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fbdca-8e54-43db-8547-5e22144c3918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:00.717318 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fbdca-8e54-43db-8547-5e22144c3918 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:00.717597 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fbdca-8e54-43db-8547-5e22144c3918 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:00.717870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fbdca-8e54-43db-8547-5e22144c3918 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:00.718568 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fbdca-8e54-43db-8547-5e22144c3918 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:00.718871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fbdca-8e54-43db-8547-5e22144c3918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:00.720247 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fbdca-8e54-43db-8547-5e22144c3918 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:00.729209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 449/874] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 08:59:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:00.730533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526a06-8b33-4209-a095-37d10d292cad None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:00.830061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526a06-8b33-4209-a095-37d10d292cad None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:00.863676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9258fbe-5cce-43bd-b216-03da9c860a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:00.864405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9258fbe-5cce-43bd-b216-03da9c860a80 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:00.864686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9258fbe-5cce-43bd-b216-03da9c860a80 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:00.864960 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9258fbe-5cce-43bd-b216-03da9c860a80 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:00.865667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9258fbe-5cce-43bd-b216-03da9c860a80 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:00.865972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9258fbe-5cce-43bd-b216-03da9c860a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:00.867330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9258fbe-5cce-43bd-b216-03da9c860a80 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:00.876225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 426/875] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 08:59:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:01.603049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decfd89-3bee-4402-915b-c1361de093dc None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:01.603780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decfd89-3bee-4402-915b-c1361de093dc None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:01.603780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decfd89-3bee-4402-915b-c1361de093dc None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:01.605239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 450/876] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:01.610370 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae559f70-077b-4885-9c39-ce0e54b07dad None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:01.611215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae559f70-077b-4885-9c39-ce0e54b07dad None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:01.611711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae559f70-077b-4885-9c39-ce0e54b07dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:01.628455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-ae559f70-077b-4885-9c39-ce0e54b07dad None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:01.630490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ae559f70-077b-4885-9c39-ce0e54b07dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:01.696175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 427/877] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:01.719536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decfd89-3bee-4402-915b-c1361de093dc None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:01.741751 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c48122-b8de-4dd0-9faa-398a4d9610b1 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:01.742354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c48122-b8de-4dd0-9faa-398a4d9610b1 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:01.742830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c48122-b8de-4dd0-9faa-398a4d9610b1 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:01.744659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 428/878] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:01.752825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9f576-53e1-42b6-8126-4145881b5a13 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:01.753390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9f576-53e1-42b6-8126-4145881b5a13 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:01.753891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9f576-53e1-42b6-8126-4145881b5a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:01.771361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-cce9f576-53e1-42b6-8126-4145881b5a13 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:01.772806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-cce9f576-53e1-42b6-8126-4145881b5a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:01.831673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decfd89-3bee-4402-915b-c1361de093dc None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:01.840836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 429/879] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:59:01.863321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9f576-53e1-42b6-8126-4145881b5a13 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:01.876316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf678f-b552-4fb1-a4d0-c33eb13e7a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:01.876991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf678f-b552-4fb1-a4d0-c33eb13e7a2b None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:01.877270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf678f-b552-4fb1-a4d0-c33eb13e7a2b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:01.877672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf678f-b552-4fb1-a4d0-c33eb13e7a2b None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:01.878552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf678f-b552-4fb1-a4d0-c33eb13e7a2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:01.880786 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf678f-b552-4fb1-a4d0-c33eb13e7a2b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:01.904125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 451/880] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 08:59:01 2022] POST /identity/v3/services => generated 269 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:01.977392 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9f576-53e1-42b6-8126-4145881b5a13 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:02.023724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5927bdb-f93c-49c7-ad74-6369f8bc54e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:02.024435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5927bdb-f93c-49c7-ad74-6369f8bc54e9 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:02.024717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5927bdb-f93c-49c7-ad74-6369f8bc54e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:02.025043 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5927bdb-f93c-49c7-ad74-6369f8bc54e9 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:02.025775 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5927bdb-f93c-49c7-ad74-6369f8bc54e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:02.027167 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5927bdb-f93c-49c7-ad74-6369f8bc54e9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:02.045801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 430/881] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 08:59:01 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:59:02.293902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2f49-6888-4a4a-b774-668f56da5783 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:02.294358 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2f49-6888-4a4a-b774-668f56da5783 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:02.294729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2f49-6888-4a4a-b774-668f56da5783 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:02.296493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 452/882] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:02.302525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce6f04-b979-414f-a29c-6f11e0a2c08d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:02.302926 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce6f04-b979-414f-a29c-6f11e0a2c08d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:02.303295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce6f04-b979-414f-a29c-6f11e0a2c08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:02.319991 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f9ce6f04-b979-414f-a29c-6f11e0a2c08d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:02.321218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f9ce6f04-b979-414f-a29c-6f11e0a2c08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:02.398058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 431/883] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:02.421618 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb2f49-6888-4a4a-b774-668f56da5783 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:02.522278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb2f49-6888-4a4a-b774-668f56da5783 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:02.555895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7974fa-f154-4e7c-abc2-66f2b41ef2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:02.556745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7974fa-f154-4e7c-abc2-66f2b41ef2e6 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:02.557027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7974fa-f154-4e7c-abc2-66f2b41ef2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:02.557299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7974fa-f154-4e7c-abc2-66f2b41ef2e6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:02.567669 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7974fa-f154-4e7c-abc2-66f2b41ef2e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-ef7974fa-f154-4e7c-abc2-66f2b41ef2e6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:59:02.576301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:02.577217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:02.578039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:02.578039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:02.578039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:02.578039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:02.578039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:59:02.578039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:59:02.578039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:59:02.578039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:59:02.578039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:59:02.578039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:59:02.578039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:59:02.578039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:02.582378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 453/884] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 3 08:59:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:02.584851 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce6f04-b979-414f-a29c-6f11e0a2c08d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:02.698537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce6f04-b979-414f-a29c-6f11e0a2c08d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:02.733322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab52a1-91f6-485b-ab06-22fb39f0f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:02.733977 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab52a1-91f6-485b-ab06-22fb39f0f769 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:02.734254 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab52a1-91f6-485b-ab06-22fb39f0f769 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:02.734526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab52a1-91f6-485b-ab06-22fb39f0f769 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:02.735267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab52a1-91f6-485b-ab06-22fb39f0f769 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:02.735563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab52a1-91f6-485b-ab06-22fb39f0f769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:02.736947 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab52a1-91f6-485b-ab06-22fb39f0f769 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:02.745367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 432/885] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 08:59:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:02.750795 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7974fa-f154-4e7c-abc2-66f2b41ef2e6 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:02.856917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7974fa-f154-4e7c-abc2-66f2b41ef2e6 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:02.889843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db18d42-0474-4da9-8d66-b83b58b3dd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:02.890631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db18d42-0474-4da9-8d66-b83b58b3dd8a None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:02.890906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db18d42-0474-4da9-8d66-b83b58b3dd8a None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:02.891175 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db18d42-0474-4da9-8d66-b83b58b3dd8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:02.902280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db18d42-0474-4da9-8d66-b83b58b3dd8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:02.903719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db18d42-0474-4da9-8d66-b83b58b3dd8a None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-2db18d42-0474-4da9-8d66-b83b58b3dd8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:02.924282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:02.926299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:02.928487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:02.928487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:02.928487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:02.928487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:02.928487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 454/886] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:02.931737 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab52a1-91f6-485b-ab06-22fb39f0f769 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:03.043699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab52a1-91f6-485b-ab06-22fb39f0f769 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:03.077524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc98b0d-d207-407d-ace8-6e5d07112a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:03.078187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc98b0d-d207-407d-ace8-6e5d07112a52 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:03.078470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc98b0d-d207-407d-ace8-6e5d07112a52 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:03.078745 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc98b0d-d207-407d-ace8-6e5d07112a52 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:03.079475 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc98b0d-d207-407d-ace8-6e5d07112a52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:03.079780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc98b0d-d207-407d-ace8-6e5d07112a52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:03.081172 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc98b0d-d207-407d-ace8-6e5d07112a52 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:03.094083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 433/887] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:03.101377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db18d42-0474-4da9-8d66-b83b58b3dd8a None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:03.151271 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea2ae9-aab8-4436-b268-f28f54016bf1 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:03.151574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea2ae9-aab8-4436-b268-f28f54016bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:03.151738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea2ae9-aab8-4436-b268-f28f54016bf1 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:03.158015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 434/888] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:59:03.159541 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e472998-374d-4833-981a-0f8af1ca07fd None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:03.159895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e472998-374d-4833-981a-0f8af1ca07fd None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:03.160202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e472998-374d-4833-981a-0f8af1ca07fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:03.176650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0e472998-374d-4833-981a-0f8af1ca07fd None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:03.177850 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0e472998-374d-4833-981a-0f8af1ca07fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:03.206017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db18d42-0474-4da9-8d66-b83b58b3dd8a None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:03.244549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac424435-0b4a-4896-948d-862859cd5e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:03.246013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac424435-0b4a-4896-948d-862859cd5e16 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:03.246470 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac424435-0b4a-4896-948d-862859cd5e16 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:03.246887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac424435-0b4a-4896-948d-862859cd5e16 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:03.252427 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 435/889] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:59:03.256336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac424435-0b4a-4896-948d-862859cd5e16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:03.257915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac424435-0b4a-4896-948d-862859cd5e16 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:03.271301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e472998-374d-4833-981a-0f8af1ca07fd None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-ac424435-0b4a-4896-948d-862859cd5e16 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:59:03.273006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:03.274098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:03.275241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:03.275241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:03.275241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:59:03.275241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:59:03.275241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:59:03.275241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:59:03.275241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:59:03.275241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:59:03.275241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:59:03.275241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:03.278479 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 455/890] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 08:59:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:03.288139 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac424435-0b4a-4896-948d-862859cd5e16 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:03.384387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac424435-0b4a-4896-948d-862859cd5e16 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:03.401216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e472998-374d-4833-981a-0f8af1ca07fd None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:03.421074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229cadf-7738-47a2-9e89-d9ccac2c92d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:03.421685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229cadf-7738-47a2-9e89-d9ccac2c92d3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:03.422227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229cadf-7738-47a2-9e89-d9ccac2c92d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:03.422502 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229cadf-7738-47a2-9e89-d9ccac2c92d3 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:03.423338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229cadf-7738-47a2-9e89-d9ccac2c92d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:03.423642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229cadf-7738-47a2-9e89-d9ccac2c92d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:03.425077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229cadf-7738-47a2-9e89-d9ccac2c92d3 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:03.441570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27f023-009d-497b-ac56-9e5dffafdc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:03.443446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27f023-009d-497b-ac56-9e5dffafdc38 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:03.444235 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27f023-009d-497b-ac56-9e5dffafdc38 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:03.444693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27f023-009d-497b-ac56-9e5dffafdc38 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:03.445599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27f023-009d-497b-ac56-9e5dffafdc38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:03.446403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 456/891] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 3 08:59:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:03.447303 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27f023-009d-497b-ac56-9e5dffafdc38 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:03.452137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229cadf-7738-47a2-9e89-d9ccac2c92d3 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:03.476483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 436/892] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 08:59:03 2022] POST /identity/v3/services => generated 241 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 08:59:03.564894 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229cadf-7738-47a2-9e89-d9ccac2c92d3 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:03.613008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f26c-f0a9-40c2-a7a1-cb7f5abce4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:03.614033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f26c-f0a9-40c2-a7a1-cb7f5abce4d1 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:03.615147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f26c-f0a9-40c2-a7a1-cb7f5abce4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:03.615678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f26c-f0a9-40c2-a7a1-cb7f5abce4d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:03.688003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980f26c-f0a9-40c2-a7a1-cb7f5abce4d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:03.689912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980f26c-f0a9-40c2-a7a1-cb7f5abce4d1 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:03.789413 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 457/893] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:59:03 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 08:59:03.794817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27f023-009d-497b-ac56-9e5dffafdc38 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:03.897275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27f023-009d-497b-ac56-9e5dffafdc38 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:03.932316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717d8c7-a52c-4843-a23f-4c9219882bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:03.933483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717d8c7-a52c-4843-a23f-4c9219882bc9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:03.934050 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717d8c7-a52c-4843-a23f-4c9219882bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:03.934542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717d8c7-a52c-4843-a23f-4c9219882bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:03.946748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717d8c7-a52c-4843-a23f-4c9219882bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:03.948513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717d8c7-a52c-4843-a23f-4c9219882bc9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-4717d8c7-a52c-4843-a23f-4c9219882bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:03.966872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:03.967790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:03.968718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:03.968718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:03.968718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:03.968718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:03.970892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 437/894] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:03.976837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f26c-f0a9-40c2-a7a1-cb7f5abce4d1 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:04.075683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f26c-f0a9-40c2-a7a1-cb7f5abce4d1 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:04.117772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62194846-4597-4163-a7c8-2feae413cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:04.118447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62194846-4597-4163-a7c8-2feae413cf8e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:04.118723 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62194846-4597-4163-a7c8-2feae413cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:04.118990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62194846-4597-4163-a7c8-2feae413cf8e None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:04.119712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62194846-4597-4163-a7c8-2feae413cf8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:04.120011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62194846-4597-4163-a7c8-2feae413cf8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:04.121418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62194846-4597-4163-a7c8-2feae413cf8e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:04.133805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 458/895] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:04.139041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717d8c7-a52c-4843-a23f-4c9219882bc9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:04.245289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717d8c7-a52c-4843-a23f-4c9219882bc9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:04.280701 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30366943-6c63-4d47-9bb6-777697e3088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:04.281491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30366943-6c63-4d47-9bb6-777697e3088e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:04.281770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30366943-6c63-4d47-9bb6-777697e3088e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:04.282042 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30366943-6c63-4d47-9bb6-777697e3088e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:04.289730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30366943-6c63-4d47-9bb6-777697e3088e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:04.291177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30366943-6c63-4d47-9bb6-777697e3088e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-30366943-6c63-4d47-9bb6-777697e3088e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:59:04.305774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:04.308724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:04.309621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:59:04.309621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:59:04.309621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:59:04.309621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:59:04.309621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:59:04.309621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:59:04.309621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:04.309621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:04.312116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 438/896] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:04.313091 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62194846-4597-4163-a7c8-2feae413cf8e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:04.342255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041cc24-2142-475e-9a4d-44ffa77590b1 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:04.342255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041cc24-2142-475e-9a4d-44ffa77590b1 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:04.342255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041cc24-2142-475e-9a4d-44ffa77590b1 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:04.342255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 439/897] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:59:04.347807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adae8cc-66b6-4fe2-bb44-5f011295787a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:04.348419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adae8cc-66b6-4fe2-bb44-5f011295787a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:04.349484 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adae8cc-66b6-4fe2-bb44-5f011295787a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:04.367489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0adae8cc-66b6-4fe2-bb44-5f011295787a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:04.369039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0adae8cc-66b6-4fe2-bb44-5f011295787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:04.415413 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62194846-4597-4163-a7c8-2feae413cf8e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:04.435694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 440/898] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:59:04.437343 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a211a17-2a75-46ed-add9-801789ff888d None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:04.437842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a211a17-2a75-46ed-add9-801789ff888d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:04.438343 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a211a17-2a75-46ed-add9-801789ff888d None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:04.444512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 441/899] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:04.445846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14afa4-e88f-43c4-b258-6b3f793b6ee7 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:04.446330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14afa4-e88f-43c4-b258-6b3f793b6ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:04.446803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14afa4-e88f-43c4-b258-6b3f793b6ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:04.449262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01c644-62f5-43ec-b010-c74e31e21ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:04.450007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01c644-62f5-43ec-b010-c74e31e21ff2 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:04.450286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01c644-62f5-43ec-b010-c74e31e21ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:04.450557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01c644-62f5-43ec-b010-c74e31e21ff2 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:04.451338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01c644-62f5-43ec-b010-c74e31e21ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:04.451642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01c644-62f5-43ec-b010-c74e31e21ff2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:04.453188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01c644-62f5-43ec-b010-c74e31e21ff2 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:04.465731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-1e14afa4-e88f-43c4-b258-6b3f793b6ee7 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:04.467223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1e14afa4-e88f-43c4-b258-6b3f793b6ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:04.467459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 459/900] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:59:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:04.468305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01c644-62f5-43ec-b010-c74e31e21ff2 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:04.532138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 442/901] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:04.532997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14afa4-e88f-43c4-b258-6b3f793b6ee7 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:04.571137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01c644-62f5-43ec-b010-c74e31e21ff2 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:04.603881 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a6407-a3da-4f29-9805-d6eadbb49945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:04.604719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6407-a3da-4f29-9805-d6eadbb49945 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:04.605000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6407-a3da-4f29-9805-d6eadbb49945 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:04.605277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6407-a3da-4f29-9805-d6eadbb49945 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:04.605930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a6407-a3da-4f29-9805-d6eadbb49945 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:04.607286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a6407-a3da-4f29-9805-d6eadbb49945 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-611a6407-a3da-4f29-9805-d6eadbb49945 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:04.619961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:04.620941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:04.621790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 460/902] 10.222.0.23 () {56 vars in 1132 bytes} [Tue May 3 08:59:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:04.623154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a6407-a3da-4f29-9805-d6eadbb49945 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:04.635672 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14afa4-e88f-43c4-b258-6b3f793b6ee7 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:04.668405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8f5c8-9c7a-48be-891b-c55ae359951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:04.669058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8f5c8-9c7a-48be-891b-c55ae359951c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:04.669338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8f5c8-9c7a-48be-891b-c55ae359951c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:04.669612 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8f5c8-9c7a-48be-891b-c55ae359951c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:04.670443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8f5c8-9c7a-48be-891b-c55ae359951c None admin] RBAC: Adding query filter params (role.id=2daf97ca638c49178dcb0c571a2b991b, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=14cf4626439e4b689a036f47a0023ea0) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:04.670749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8f5c8-9c7a-48be-891b-c55ae359951c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:04.672229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8f5c8-9c7a-48be-891b-c55ae359951c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:04.688385 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 443/903] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:59:04 2022] GET /identity/v3/role_assignments?user.id=14cf4626439e4b689a036f47a0023ea0&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=2daf97ca638c49178dcb0c571a2b991b => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:04.688385 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8f5c8-9c7a-48be-891b-c55ae359951c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:04.745015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a6407-a3da-4f29-9805-d6eadbb49945 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:04.781532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfc2e1-e457-4e7a-8c95-da8a35e4b1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:04.782561 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfc2e1-e457-4e7a-8c95-da8a35e4b1f3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:04.782885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfc2e1-e457-4e7a-8c95-da8a35e4b1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:04.783256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfc2e1-e457-4e7a-8c95-da8a35e4b1f3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:04.784018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfc2e1-e457-4e7a-8c95-da8a35e4b1f3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:04.785514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfc2e1-e457-4e7a-8c95-da8a35e4b1f3 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-61dfc2e1-e457-4e7a-8c95-da8a35e4b1f3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:04.798977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:04.800549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:59:04.801390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:04.802196 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8f5c8-9c7a-48be-891b-c55ae359951c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:04.807299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 461/904] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:59:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:04.807299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfc2e1-e457-4e7a-8c95-da8a35e4b1f3 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:04.837795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cedd5b-2665-43e0-b194-40dfbec9168b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:04.838531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cedd5b-2665-43e0-b194-40dfbec9168b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:04.838807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cedd5b-2665-43e0-b194-40dfbec9168b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:04.839070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cedd5b-2665-43e0-b194-40dfbec9168b None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:04.839787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cedd5b-2665-43e0-b194-40dfbec9168b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:04.840109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cedd5b-2665-43e0-b194-40dfbec9168b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:04.841515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cedd5b-2665-43e0-b194-40dfbec9168b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:04.847176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 444/905] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 08:59:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:04.853691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cedd5b-2665-43e0-b194-40dfbec9168b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:04.912535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfc2e1-e457-4e7a-8c95-da8a35e4b1f3 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:04.946276 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c9a96-f13b-4318-b02b-56fd01a1b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:04.947343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c9a96-f13b-4318-b02b-56fd01a1b312 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:04.947690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c9a96-f13b-4318-b02b-56fd01a1b312 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:04.948041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c9a96-f13b-4318-b02b-56fd01a1b312 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:04.949138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c9a96-f13b-4318-b02b-56fd01a1b312 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:04.949517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c9a96-f13b-4318-b02b-56fd01a1b312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:04.950961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c9a96-f13b-4318-b02b-56fd01a1b312 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:04.956125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 462/906] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:59:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:04.962258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c9a96-f13b-4318-b02b-56fd01a1b312 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:04.966643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cedd5b-2665-43e0-b194-40dfbec9168b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:05.006294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c96f73-de1b-4b51-ac11-01fab5fe9b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:05.006960 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c96f73-de1b-4b51-ac11-01fab5fe9b20 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:05.007244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c96f73-de1b-4b51-ac11-01fab5fe9b20 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:05.007687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c96f73-de1b-4b51-ac11-01fab5fe9b20 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:05.008453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c96f73-de1b-4b51-ac11-01fab5fe9b20 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:05.009127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c96f73-de1b-4b51-ac11-01fab5fe9b20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:05.010826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c96f73-de1b-4b51-ac11-01fab5fe9b20 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:05.020154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 445/907] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 08:59:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:05.023918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c96f73-de1b-4b51-ac11-01fab5fe9b20 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:05.080787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c9a96-f13b-4318-b02b-56fd01a1b312 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:05.124949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bff814-663d-4320-9d62-1257bedb423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:05.126585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff814-663d-4320-9d62-1257bedb423b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:05.127121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff814-663d-4320-9d62-1257bedb423b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:05.127631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff814-663d-4320-9d62-1257bedb423b None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:05.128143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c96f73-de1b-4b51-ac11-01fab5fe9b20 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:05.128812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bff814-663d-4320-9d62-1257bedb423b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:05.129322 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bff814-663d-4320-9d62-1257bedb423b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:05.132328 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bff814-663d-4320-9d62-1257bedb423b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:05.138616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 463/908] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:59:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:05.144621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bff814-663d-4320-9d62-1257bedb423b None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:05.167472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b81bc-9112-4b01-b10d-86092285304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:05.168155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b81bc-9112-4b01-b10d-86092285304b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:05.168440 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b81bc-9112-4b01-b10d-86092285304b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:05.168717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b81bc-9112-4b01-b10d-86092285304b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:05.169810 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b81bc-9112-4b01-b10d-86092285304b None admin] RBAC: Adding query filter params (interface=public, service_id=ea2eaf76843f406e95ac3e048b67b7e1, region_id=RegionOne) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:05.170120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b81bc-9112-4b01-b10d-86092285304b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:05.171483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b81bc-9112-4b01-b10d-86092285304b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:05.182524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 446/909] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 08:59:05 2022] GET /identity/v3/endpoints?service_id=ea2eaf76843f406e95ac3e048b67b7e1&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:05.183861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b81bc-9112-4b01-b10d-86092285304b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:05.256675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bff814-663d-4320-9d62-1257bedb423b None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:05.285289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b81bc-9112-4b01-b10d-86092285304b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:05.290660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e9ff-78e7-4ed9-a623-6992d7f58f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:05.291320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e9ff-78e7-4ed9-a623-6992d7f58f3f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:05.291598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e9ff-78e7-4ed9-a623-6992d7f58f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:05.291870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e9ff-78e7-4ed9-a623-6992d7f58f3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:05.292691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79e9ff-78e7-4ed9-a623-6992d7f58f3f None admin] RBAC: Adding query filter params (interface=public, service_id=581266d32ad7427f958e6ee87d4c35bb, region_id=RegionOne) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:05.292998 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79e9ff-78e7-4ed9-a623-6992d7f58f3f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:05.294419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79e9ff-78e7-4ed9-a623-6992d7f58f3f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:05.304364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 464/910] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 08:59:05 2022] GET /identity/v3/endpoints?service_id=581266d32ad7427f958e6ee87d4c35bb&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:05.305219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e9ff-78e7-4ed9-a623-6992d7f58f3f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:05.322967 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673c094-d8a3-4db9-9775-6abe5e77c46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:05.324372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673c094-d8a3-4db9-9775-6abe5e77c46e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:05.325117 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673c094-d8a3-4db9-9775-6abe5e77c46e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:05.325579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673c094-d8a3-4db9-9775-6abe5e77c46e None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:05.326457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673c094-d8a3-4db9-9775-6abe5e77c46e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:05.328443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673c094-d8a3-4db9-9775-6abe5e77c46e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:05.343984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 447/911] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 08:59:05 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:59:05.415976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e9ff-78e7-4ed9-a623-6992d7f58f3f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:05.451923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62688139-d634-4ea3-a2ad-96d14af58dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:05.452631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62688139-d634-4ea3-a2ad-96d14af58dd5 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:05.452914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62688139-d634-4ea3-a2ad-96d14af58dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:05.453189 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62688139-d634-4ea3-a2ad-96d14af58dd5 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:05.453876 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62688139-d634-4ea3-a2ad-96d14af58dd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:05.455322 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62688139-d634-4ea3-a2ad-96d14af58dd5 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:05.462820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 465/912] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 08:59:05 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:59:05.813604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b78c4c-bc73-4a94-9ffa-dae3991ba807 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:05.814121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b78c4c-bc73-4a94-9ffa-dae3991ba807 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:05.814121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b78c4c-bc73-4a94-9ffa-dae3991ba807 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:05.815736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 448/913] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:05.821586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d577-cc7d-4058-bf35-3fc643a4aa69 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:05.822003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d577-cc7d-4058-bf35-3fc643a4aa69 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:05.822174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d577-cc7d-4058-bf35-3fc643a4aa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:05.839378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-adf7d577-cc7d-4058-bf35-3fc643a4aa69 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:05.840583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-adf7d577-cc7d-4058-bf35-3fc643a4aa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:05.912506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 466/914] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:05.935519 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b78c4c-bc73-4a94-9ffa-dae3991ba807 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:06.031250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b78c4c-bc73-4a94-9ffa-dae3991ba807 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:06.068759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adcefc-f750-496d-b36f-e3a5a207fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:06.069815 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adcefc-f750-496d-b36f-e3a5a207fdfa None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:06.070319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adcefc-f750-496d-b36f-e3a5a207fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:06.070794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adcefc-f750-496d-b36f-e3a5a207fdfa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:06.071643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adcefc-f750-496d-b36f-e3a5a207fdfa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:06.073236 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adcefc-f750-496d-b36f-e3a5a207fdfa None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-b1adcefc-f750-496d-b36f-e3a5a207fdfa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:06.085733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:06.086719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:06.087558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:06.090340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 449/915] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 08:59:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:06.099763 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d577-cc7d-4058-bf35-3fc643a4aa69 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:06.193428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d577-cc7d-4058-bf35-3fc643a4aa69 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:06.231106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7bd9-c89d-4077-ac6e-3e6753cb1a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:06.231774 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7bd9-c89d-4077-ac6e-3e6753cb1a8d None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:06.232049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7bd9-c89d-4077-ac6e-3e6753cb1a8d None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:06.232350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7bd9-c89d-4077-ac6e-3e6753cb1a8d None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:06.233052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7bd9-c89d-4077-ac6e-3e6753cb1a8d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:06.233352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7bd9-c89d-4077-ac6e-3e6753cb1a8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:06.234699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7bd9-c89d-4077-ac6e-3e6753cb1a8d None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:06.239899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 467/916] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 08:59:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:06.245469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adcefc-f750-496d-b36f-e3a5a207fdfa None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:06.349875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adcefc-f750-496d-b36f-e3a5a207fdfa None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:06.382718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bd731-196c-4c15-8520-18da9eb4f63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:06.383381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bd731-196c-4c15-8520-18da9eb4f63f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:06.383658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bd731-196c-4c15-8520-18da9eb4f63f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:06.383932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bd731-196c-4c15-8520-18da9eb4f63f None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:06.384668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bd731-196c-4c15-8520-18da9eb4f63f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:06.384969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bd731-196c-4c15-8520-18da9eb4f63f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:06.386337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bd731-196c-4c15-8520-18da9eb4f63f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:06.391532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 450/917] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 08:59:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:06.397660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7bd9-c89d-4077-ac6e-3e6753cb1a8d None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:06.496871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7bd9-c89d-4077-ac6e-3e6753cb1a8d None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:06.534779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf3b4c-b7c8-41fe-aaeb-89a0c79dcba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:06.535438 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf3b4c-b7c8-41fe-aaeb-89a0c79dcba3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:06.535713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf3b4c-b7c8-41fe-aaeb-89a0c79dcba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:06.536690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf3b4c-b7c8-41fe-aaeb-89a0c79dcba3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:06.537477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf3b4c-b7c8-41fe-aaeb-89a0c79dcba3 None admin] RBAC: Adding query filter params (interface=public, service_id=903cdd5fd39b427a87a51415c1ce7dc9, region_id=RegionOne) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:06.537782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf3b4c-b7c8-41fe-aaeb-89a0c79dcba3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:06.539141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf3b4c-b7c8-41fe-aaeb-89a0c79dcba3 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:06.544844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 468/918] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 08:59:06 2022] GET /identity/v3/endpoints?service_id=903cdd5fd39b427a87a51415c1ce7dc9&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:06.550291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bd731-196c-4c15-8520-18da9eb4f63f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:06.650726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bd731-196c-4c15-8520-18da9eb4f63f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:06.685126 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6e161-8cf5-4a8f-a275-4ad57ba53d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:06.685784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6e161-8cf5-4a8f-a275-4ad57ba53d3a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:06.686063 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6e161-8cf5-4a8f-a275-4ad57ba53d3a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:06.686338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6e161-8cf5-4a8f-a275-4ad57ba53d3a None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:06.687015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6e161-8cf5-4a8f-a275-4ad57ba53d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:06.688470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6e161-8cf5-4a8f-a275-4ad57ba53d3a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:06.695188 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 451/919] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 08:59:06 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:59:07.007258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2701ba-3a1b-459b-9477-24430c18638b None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:07.007752 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2701ba-3a1b-459b-9477-24430c18638b None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:07.007848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2701ba-3a1b-459b-9477-24430c18638b None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:07.009478 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 469/920] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:07.014874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8723f1-c871-4962-9aff-765736df2754 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:07.015722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8723f1-c871-4962-9aff-765736df2754 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:07.016246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8723f1-c871-4962-9aff-765736df2754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:07.033736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-6b8723f1-c871-4962-9aff-765736df2754 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:07.035223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6b8723f1-c871-4962-9aff-765736df2754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:07.106400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 452/921] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:07.130386 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2701ba-3a1b-459b-9477-24430c18638b None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:07.231897 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2701ba-3a1b-459b-9477-24430c18638b None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:07.264324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9f0e8-f729-459a-a46d-60225cb09acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:07.265059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9f0e8-f729-459a-a46d-60225cb09acb None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:07.265337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9f0e8-f729-459a-a46d-60225cb09acb None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:07.265611 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9f0e8-f729-459a-a46d-60225cb09acb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:07.276062 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9f0e8-f729-459a-a46d-60225cb09acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-d7d9f0e8-f729-459a-a46d-60225cb09acb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:59:07.284199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:07.285114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:07.286530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:07.286530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:07.286530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:07.286530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:07.286530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:59:07.286530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:59:07.286530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:59:07.286530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:59:07.286530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:59:07.286530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:59:07.286530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:59:07.286530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:07.291061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 470/922] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 3 08:59:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:07.293208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8723f1-c871-4962-9aff-765736df2754 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:07.389374 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8723f1-c871-4962-9aff-765736df2754 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:07.422895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250aefe3-dc3a-4ecb-b948-394f6f330172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:07.423565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aefe3-dc3a-4ecb-b948-394f6f330172 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:07.423842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aefe3-dc3a-4ecb-b948-394f6f330172 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:07.424129 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aefe3-dc3a-4ecb-b948-394f6f330172 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:07.424881 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250aefe3-dc3a-4ecb-b948-394f6f330172 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:07.425180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250aefe3-dc3a-4ecb-b948-394f6f330172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:07.426571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250aefe3-dc3a-4ecb-b948-394f6f330172 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:07.439411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 453/923] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 08:59:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:07.440829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9f0e8-f729-459a-a46d-60225cb09acb None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:07.541960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9f0e8-f729-459a-a46d-60225cb09acb None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:07.576406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1555e-8036-4fb9-8fa8-fddb863fe82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:07.577192 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1555e-8036-4fb9-8fa8-fddb863fe82c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:07.577467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1555e-8036-4fb9-8fa8-fddb863fe82c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:07.577734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1555e-8036-4fb9-8fa8-fddb863fe82c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:07.588525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1555e-8036-4fb9-8fa8-fddb863fe82c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:07.589942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1555e-8036-4fb9-8fa8-fddb863fe82c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-ebb1555e-8036-4fb9-8fa8-fddb863fe82c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:07.606673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:07.608788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:07.610806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:07.610806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:07.610806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:07.610806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:07.610806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 471/924] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:07.613957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250aefe3-dc3a-4ecb-b948-394f6f330172 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:07.724781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250aefe3-dc3a-4ecb-b948-394f6f330172 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:07.759001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24f03a-679f-4945-8bf6-ae4443a3de0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:07.759672 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24f03a-679f-4945-8bf6-ae4443a3de0e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:07.759952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24f03a-679f-4945-8bf6-ae4443a3de0e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:07.760256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24f03a-679f-4945-8bf6-ae4443a3de0e None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:07.760976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24f03a-679f-4945-8bf6-ae4443a3de0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:07.761282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24f03a-679f-4945-8bf6-ae4443a3de0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:07.762649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24f03a-679f-4945-8bf6-ae4443a3de0e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:07.774894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 454/925] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:07.780775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1555e-8036-4fb9-8fa8-fddb863fe82c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:07.835694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25f3c-3ac2-450a-bb39-44cb50fbeac0 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:07.835694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25f3c-3ac2-450a-bb39-44cb50fbeac0 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:07.835694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25f3c-3ac2-450a-bb39-44cb50fbeac0 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:07.836294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 455/926] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:59:07.841313 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608525-a667-4f27-9c34-d5266962d1e2 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:07.841753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608525-a667-4f27-9c34-d5266962d1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:07.842194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608525-a667-4f27-9c34-d5266962d1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:07.861148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8a608525-a667-4f27-9c34-d5266962d1e2 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:07.863224 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8a608525-a667-4f27-9c34-d5266962d1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:07.883465 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1555e-8036-4fb9-8fa8-fddb863fe82c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:07.918229 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b7387-739c-4ebd-9b36-f3ab43f9a1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:07.919326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b7387-739c-4ebd-9b36-f3ab43f9a1b9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:07.919608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b7387-739c-4ebd-9b36-f3ab43f9a1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:07.919881 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b7387-739c-4ebd-9b36-f3ab43f9a1b9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:07.927982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b7387-739c-4ebd-9b36-f3ab43f9a1b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:07.929509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b7387-739c-4ebd-9b36-f3ab43f9a1b9 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:07.931002 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 456/927] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:59:07.936345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b490a23-d719-4ace-b894-cccb0c6005b9 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:07.936345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b490a23-d719-4ace-b894-cccb0c6005b9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:07.936345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b490a23-d719-4ace-b894-cccb0c6005b9 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:07.938216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 457/928] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:07.939560 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b539fc-2e89-4294-8aee-5328472b192a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:07.939843 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b539fc-2e89-4294-8aee-5328472b192a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:07.940136 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b539fc-2e89-4294-8aee-5328472b192a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-c75b7387-739c-4ebd-9b36-f3ab43f9a1b9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:59:07.946046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:07.946958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:07.947919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:07.947919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:07.947919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:59:07.947919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:59:07.947919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:59:07.947919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:59:07.947919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:59:07.947919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:59:07.947919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:59:07.947919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:07.952273 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 472/929] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 08:59:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:07.953431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b7387-739c-4ebd-9b36-f3ab43f9a1b9 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:07.960486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-57b539fc-2e89-4294-8aee-5328472b192a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:07.961668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-57b539fc-2e89-4294-8aee-5328472b192a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:08.027657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 458/930] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:08.028546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b539fc-2e89-4294-8aee-5328472b192a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:08.054124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b7387-739c-4ebd-9b36-f3ab43f9a1b9 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:08.087890 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187dc24-df97-4a8f-b8f4-b459b9a3966b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:08.088516 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187dc24-df97-4a8f-b8f4-b459b9a3966b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:08.088798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187dc24-df97-4a8f-b8f4-b459b9a3966b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:08.089071 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187dc24-df97-4a8f-b8f4-b459b9a3966b None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:08.089900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187dc24-df97-4a8f-b8f4-b459b9a3966b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:08.090206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187dc24-df97-4a8f-b8f4-b459b9a3966b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:08.091619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187dc24-df97-4a8f-b8f4-b459b9a3966b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:08.113209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 473/931] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 3 08:59:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:08.113209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187dc24-df97-4a8f-b8f4-b459b9a3966b None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:08.129338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b539fc-2e89-4294-8aee-5328472b192a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:08.163015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadcc73-96a5-410d-98bb-d443732fbe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:08.163823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadcc73-96a5-410d-98bb-d443732fbe3a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:08.164124 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadcc73-96a5-410d-98bb-d443732fbe3a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:08.164405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadcc73-96a5-410d-98bb-d443732fbe3a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:08.165061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadcc73-96a5-410d-98bb-d443732fbe3a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:08.166420 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadcc73-96a5-410d-98bb-d443732fbe3a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-7dadcc73-96a5-410d-98bb-d443732fbe3a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:08.179165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:08.180361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:08.181684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 459/932] 10.222.0.23 () {56 vars in 1132 bytes} [Tue May 3 08:59:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:08.185853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadcc73-96a5-410d-98bb-d443732fbe3a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:08.209507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187dc24-df97-4a8f-b8f4-b459b9a3966b None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:08.243152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc46290-a5ee-43fa-a0ed-5065215fefb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:08.243944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc46290-a5ee-43fa-a0ed-5065215fefb1 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:08.244256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc46290-a5ee-43fa-a0ed-5065215fefb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:08.244529 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc46290-a5ee-43fa-a0ed-5065215fefb1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:08.245180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc46290-a5ee-43fa-a0ed-5065215fefb1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:08.246542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc46290-a5ee-43fa-a0ed-5065215fefb1 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-1dc46290-a5ee-43fa-a0ed-5065215fefb1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:08.258334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:08.259925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:08.261141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 474/933] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:59:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:08.261949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc46290-a5ee-43fa-a0ed-5065215fefb1 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:08.287885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadcc73-96a5-410d-98bb-d443732fbe3a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:08.326732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e76d74-6d3f-4604-a812-9bc7ec6905c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:08.327999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e76d74-6d3f-4604-a812-9bc7ec6905c8 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:08.328315 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e76d74-6d3f-4604-a812-9bc7ec6905c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:08.328742 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e76d74-6d3f-4604-a812-9bc7ec6905c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:08.345870 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e76d74-6d3f-4604-a812-9bc7ec6905c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:08.347899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e76d74-6d3f-4604-a812-9bc7ec6905c8 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:08.363462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc46290-a5ee-43fa-a0ed-5065215fefb1 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-16e76d74-6d3f-4604-a812-9bc7ec6905c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:08.369682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:08.370534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:08.371507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:08.371507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:08.371507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:08.371507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:08.372203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 460/934] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:08.372501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e76d74-6d3f-4604-a812-9bc7ec6905c8 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:08.397660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d75cb-66ed-4f00-a1b8-ee705939a406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:08.398613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d75cb-66ed-4f00-a1b8-ee705939a406 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:08.398894 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d75cb-66ed-4f00-a1b8-ee705939a406 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:08.399152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d75cb-66ed-4f00-a1b8-ee705939a406 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:08.399853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d75cb-66ed-4f00-a1b8-ee705939a406 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:08.400175 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d75cb-66ed-4f00-a1b8-ee705939a406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:08.401525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d75cb-66ed-4f00-a1b8-ee705939a406 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:08.411312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 475/935] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 08:59:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:08.411312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d75cb-66ed-4f00-a1b8-ee705939a406 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:08.476318 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e76d74-6d3f-4604-a812-9bc7ec6905c8 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:08.504027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d75cb-66ed-4f00-a1b8-ee705939a406 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:08.512271 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc9bf-defc-427b-8fb8-fae5bd0d967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:08.513292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc9bf-defc-427b-8fb8-fae5bd0d967e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:08.513574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc9bf-defc-427b-8fb8-fae5bd0d967e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:08.513847 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc9bf-defc-427b-8fb8-fae5bd0d967e None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:08.515157 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc9bf-defc-427b-8fb8-fae5bd0d967e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:08.515480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc9bf-defc-427b-8fb8-fae5bd0d967e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:08.517042 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc9bf-defc-427b-8fb8-fae5bd0d967e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:08.524245 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 461/936] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:59:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:08.525264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc9bf-defc-427b-8fb8-fae5bd0d967e None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:08.538287 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486faee-4276-44d4-9f6c-0cf98be08279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:08.538948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486faee-4276-44d4-9f6c-0cf98be08279 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:08.539231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486faee-4276-44d4-9f6c-0cf98be08279 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:08.539507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486faee-4276-44d4-9f6c-0cf98be08279 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:08.540267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486faee-4276-44d4-9f6c-0cf98be08279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:08.540577 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486faee-4276-44d4-9f6c-0cf98be08279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:08.541933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486faee-4276-44d4-9f6c-0cf98be08279 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:08.553381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 476/937] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:08.554413 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486faee-4276-44d4-9f6c-0cf98be08279 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:08.638909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc9bf-defc-427b-8fb8-fae5bd0d967e None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:08.651257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486faee-4276-44d4-9f6c-0cf98be08279 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:08.675078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963fc69-11c1-4f31-a124-5891d61b9593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:08.675738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963fc69-11c1-4f31-a124-5891d61b9593 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:08.676020 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963fc69-11c1-4f31-a124-5891d61b9593 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:08.676325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963fc69-11c1-4f31-a124-5891d61b9593 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:08.677061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963fc69-11c1-4f31-a124-5891d61b9593 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:08.677368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963fc69-11c1-4f31-a124-5891d61b9593 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:08.678733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963fc69-11c1-4f31-a124-5891d61b9593 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:08.688174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 462/938] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 08:59:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:08.688349 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d877bc-79c4-465f-ac1a-31e6f9674f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:08.688446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963fc69-11c1-4f31-a124-5891d61b9593 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:08.688519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d877bc-79c4-465f-ac1a-31e6f9674f3e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:08.688519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d877bc-79c4-465f-ac1a-31e6f9674f3e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:08.688519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d877bc-79c4-465f-ac1a-31e6f9674f3e None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:08.688519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d877bc-79c4-465f-ac1a-31e6f9674f3e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:08.688519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d877bc-79c4-465f-ac1a-31e6f9674f3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:08.688519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d877bc-79c4-465f-ac1a-31e6f9674f3e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:08.693793 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 477/939] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 08:59:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:08.698553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d877bc-79c4-465f-ac1a-31e6f9674f3e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:08.784500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963fc69-11c1-4f31-a124-5891d61b9593 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:08.793619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d877bc-79c4-465f-ac1a-31e6f9674f3e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:08.817932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a72c5-05cb-4d7d-91cc-a4cf1781b0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:08.818945 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a72c5-05cb-4d7d-91cc-a4cf1781b0d2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:08.819227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a72c5-05cb-4d7d-91cc-a4cf1781b0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:08.819499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a72c5-05cb-4d7d-91cc-a4cf1781b0d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:08.825206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ca06f-5e71-4a81-b4d4-f27ad88ad9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:08.825852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ca06f-5e71-4a81-b4d4-f27ad88ad9ae None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:08.826131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ca06f-5e71-4a81-b4d4-f27ad88ad9ae None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:08.826381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a72c5-05cb-4d7d-91cc-a4cf1781b0d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:08.826479 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ca06f-5e71-4a81-b4d4-f27ad88ad9ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:08.827123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ca06f-5e71-4a81-b4d4-f27ad88ad9ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:08.827810 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a72c5-05cb-4d7d-91cc-a4cf1781b0d2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:08.828474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ca06f-5e71-4a81-b4d4-f27ad88ad9ae None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-ce7a72c5-05cb-4d7d-91cc-a4cf1781b0d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:59:08.842651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:08.843677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:08.844603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:59:08.844603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:59:08.844603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:59:08.844603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:59:08.844603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:59:08.844603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:59:08.844603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:08.844603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:08.844603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 463/940] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:08.845083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a72c5-05cb-4d7d-91cc-a4cf1781b0d2 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:08.864476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 478/941] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 08:59:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:08.864476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ca06f-5e71-4a81-b4d4-f27ad88ad9ae None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:08.989555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ca06f-5e71-4a81-b4d4-f27ad88ad9ae None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:08.990119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a72c5-05cb-4d7d-91cc-a4cf1781b0d2 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:09.034186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa26a29-3899-47ec-bfca-864645bd58d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:09.035548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa26a29-3899-47ec-bfca-864645bd58d2 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:09.036563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa26a29-3899-47ec-bfca-864645bd58d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:09.037033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa26a29-3899-47ec-bfca-864645bd58d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:09.038185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa26a29-3899-47ec-bfca-864645bd58d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:09.039185 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547aff8d-910c-4418-9b58-03eff601928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:09.039867 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aff8d-910c-4418-9b58-03eff601928c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:09.040155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa26a29-3899-47ec-bfca-864645bd58d2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:09.040261 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aff8d-910c-4418-9b58-03eff601928c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:09.040453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aff8d-910c-4418-9b58-03eff601928c None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:09.041252 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547aff8d-910c-4418-9b58-03eff601928c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:09.041588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547aff8d-910c-4418-9b58-03eff601928c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:09.042988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547aff8d-910c-4418-9b58-03eff601928c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:09.067347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 479/942] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:09.067347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4095be-f844-404b-8bc5-4201d549950a None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:09.067347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4095be-f844-404b-8bc5-4201d549950a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:09.067347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4095be-f844-404b-8bc5-4201d549950a None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:09.067347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 480/943] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:09.072620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 464/944] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 08:59:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:09.077197 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4095be-f844-404b-8bc5-4201d549950a None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:09.080318 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077c140-aa44-42f2-91d1-4fdf8e4eb858 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:09.081269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077c140-aa44-42f2-91d1-4fdf8e4eb858 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:09.081738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077c140-aa44-42f2-91d1-4fdf8e4eb858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:09.104415 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a077c140-aa44-42f2-91d1-4fdf8e4eb858 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:09.105959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a077c140-aa44-42f2-91d1-4fdf8e4eb858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:09.213522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 465/945] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:09.239436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077c140-aa44-42f2-91d1-4fdf8e4eb858 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:09.300278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4095be-f844-404b-8bc5-4201d549950a None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:09.344041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c853d5-3d0e-47af-a8f5-64d7967f9140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:09.344307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077c140-aa44-42f2-91d1-4fdf8e4eb858 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:09.344395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c853d5-3d0e-47af-a8f5-64d7967f9140 None admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:09.344395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c853d5-3d0e-47af-a8f5-64d7967f9140 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:09.344395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c853d5-3d0e-47af-a8f5-64d7967f9140 None admin] PATH_INFO: `/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/14cf4626439e4b689a036f47a0023ea0/roles/2daf97ca638c49178dcb0c571a2b991b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:09.345814 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c853d5-3d0e-47af-a8f5-64d7967f9140 None admin] RBAC: Authorizing `identity:create_grant(project_id=250761bd5a9e48e0b26fedcf65d88a5d, user_id=14cf4626439e4b689a036f47a0023ea0, role_id=2daf97ca638c49178dcb0c571a2b991b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:09.348129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c853d5-3d0e-47af-a8f5-64d7967f9140 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:09.367784 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 481/946] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:59:09 2022] PUT /identity/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/14cf4626439e4b689a036f47a0023ea0/roles/2daf97ca638c49178dcb0c571a2b991b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:59:09.408109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdfbc3-ca6d-4e8a-bb9d-89da64c10d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:09.408326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdfbc3-ca6d-4e8a-bb9d-89da64c10d22 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:09.408588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdfbc3-ca6d-4e8a-bb9d-89da64c10d22 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:09.408750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdfbc3-ca6d-4e8a-bb9d-89da64c10d22 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:09.410615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdfbc3-ca6d-4e8a-bb9d-89da64c10d22 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:09.410821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdfbc3-ca6d-4e8a-bb9d-89da64c10d22 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-c6cdfbc3-ca6d-4e8a-bb9d-89da64c10d22 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:09.423981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:09.425040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:09.426944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 466/947] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 08:59:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:09.432327 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c853d5-3d0e-47af-a8f5-64d7967f9140 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:09.616005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c853d5-3d0e-47af-a8f5-64d7967f9140 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:09.648513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0831c-3792-434e-b834-2de11d3b2eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:09.649171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0831c-3792-434e-b834-2de11d3b2eb8 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:09.649443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0831c-3792-434e-b834-2de11d3b2eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:09.649713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0831c-3792-434e-b834-2de11d3b2eb8 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:09.650413 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0831c-3792-434e-b834-2de11d3b2eb8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:09.650712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0831c-3792-434e-b834-2de11d3b2eb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:09.652080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0831c-3792-434e-b834-2de11d3b2eb8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:09.657111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 482/948] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 08:59:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:09.664276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdfbc3-ca6d-4e8a-bb9d-89da64c10d22 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:09.770261 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdfbc3-ca6d-4e8a-bb9d-89da64c10d22 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:09.804028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335c18e-c211-40a0-ae2c-4e66c87a46ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:09.804716 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335c18e-c211-40a0-ae2c-4e66c87a46ea None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:09.804994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335c18e-c211-40a0-ae2c-4e66c87a46ea None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:09.805262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335c18e-c211-40a0-ae2c-4e66c87a46ea None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:09.805966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335c18e-c211-40a0-ae2c-4e66c87a46ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:09.806266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335c18e-c211-40a0-ae2c-4e66c87a46ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:09.807616 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335c18e-c211-40a0-ae2c-4e66c87a46ea None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:09.812723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 467/949] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 08:59:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:09.818421 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0831c-3792-434e-b834-2de11d3b2eb8 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:09.915432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0831c-3792-434e-b834-2de11d3b2eb8 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:09.952452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ec1ff-4309-40b0-88ae-e10689e9dbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:09.953110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec1ff-4309-40b0-88ae-e10689e9dbb4 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:09.953389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec1ff-4309-40b0-88ae-e10689e9dbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:09.953660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec1ff-4309-40b0-88ae-e10689e9dbb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:09.954402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ec1ff-4309-40b0-88ae-e10689e9dbb4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:09.955751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ec1ff-4309-40b0-88ae-e10689e9dbb4 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:09.977135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 483/950] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 08:59:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:11.273595 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999920d-3e8c-46d8-9f55-0c3355d28df6 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:11.274614 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999920d-3e8c-46d8-9f55-0c3355d28df6 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:11.275113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999920d-3e8c-46d8-9f55-0c3355d28df6 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:11.276975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 468/951] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:11.282275 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67b888-40dc-4b91-8665-5adc51277088 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:11.283086 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67b888-40dc-4b91-8665-5adc51277088 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:11.283567 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67b888-40dc-4b91-8665-5adc51277088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:11.300785 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-4d67b888-40dc-4b91-8665-5adc51277088 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:11.302935 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4d67b888-40dc-4b91-8665-5adc51277088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:11.383153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 484/952] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:11.405369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999920d-3e8c-46d8-9f55-0c3355d28df6 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:11.510249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999920d-3e8c-46d8-9f55-0c3355d28df6 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:11.528830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e370-42d8-42ce-bdaf-fef815fae884 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:11.529465 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e370-42d8-42ce-bdaf-fef815fae884 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:11.529947 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e370-42d8-42ce-bdaf-fef815fae884 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:11.531760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 485/953] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:59:11.537546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716bd5c-ed7f-4ae8-96ae-c21ab209f187 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:11.538087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716bd5c-ed7f-4ae8-96ae-c21ab209f187 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:11.538583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716bd5c-ed7f-4ae8-96ae-c21ab209f187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:11.545767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e41cf6-b500-4ccb-9b2e-3c822fc92339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:11.546393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41cf6-b500-4ccb-9b2e-3c822fc92339 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:11.546675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41cf6-b500-4ccb-9b2e-3c822fc92339 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:11.546945 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41cf6-b500-4ccb-9b2e-3c822fc92339 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:11.547601 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e41cf6-b500-4ccb-9b2e-3c822fc92339 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:11.549016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e41cf6-b500-4ccb-9b2e-3c822fc92339 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:11.558914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-1716bd5c-ed7f-4ae8-96ae-c21ab209f187 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:11.560564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-1716bd5c-ed7f-4ae8-96ae-c21ab209f187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-60e41cf6-b500-4ccb-9b2e-3c822fc92339 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:11.561489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:11.562555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:11.563468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 469/954] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:59:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:11.571040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e41cf6-b500-4ccb-9b2e-3c822fc92339 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:11.664139 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 486/955] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:59:11.679780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716bd5c-ed7f-4ae8-96ae-c21ab209f187 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:11.685518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e41cf6-b500-4ccb-9b2e-3c822fc92339 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:11.726644 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73a69f-61ef-4d8f-838d-d87b50cdceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:11.728173 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73a69f-61ef-4d8f-838d-d87b50cdceea None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:11.728689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73a69f-61ef-4d8f-838d-d87b50cdceea None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:11.729174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73a69f-61ef-4d8f-838d-d87b50cdceea None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:11.730410 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73a69f-61ef-4d8f-838d-d87b50cdceea None admin] RBAC: Adding query filter params (name=compute) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:11.731216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73a69f-61ef-4d8f-838d-d87b50cdceea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:11.734319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73a69f-61ef-4d8f-838d-d87b50cdceea None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:11.748491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 470/956] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:59:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:11.748491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdfab4-6c32-48e6-bfd3-05e95b318b03 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:11.748762 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdfab4-6c32-48e6-bfd3-05e95b318b03 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:11.749047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdfab4-6c32-48e6-bfd3-05e95b318b03 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:11.750320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 471/957] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:59:11.754631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdfab4-6c32-48e6-bfd3-05e95b318b03 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:11.791548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716bd5c-ed7f-4ae8-96ae-c21ab209f187 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:11.823816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a7b14-e0e2-4d3c-a207-158c53a13afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:11.824670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a7b14-e0e2-4d3c-a207-158c53a13afb None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:11.824944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a7b14-e0e2-4d3c-a207-158c53a13afb None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:11.825219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a7b14-e0e2-4d3c-a207-158c53a13afb None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:11.825919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a7b14-e0e2-4d3c-a207-158c53a13afb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:11.827351 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a7b14-e0e2-4d3c-a207-158c53a13afb None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:11.828716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: WARNING keystone.server.flask.common [None req-716a7b14-e0e2-4d3c-a207-158c53a13afb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 03 08:59:11.846344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.sql.core [None req-716a7b14-e0e2-4d3c-a207-158c53a13afb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 08:59:11.846344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 08:59:11.846344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [parameters: {'id': '55d941f747ca4b2a8d617678eeef8597', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 08:59:11.846344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79902) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 08:59:11.860858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdfab4-6c32-48e6-bfd3-05e95b318b03 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-716a7b14-e0e2-4d3c-a207-158c53a13afb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55d941f747ca4b2a8d617678eeef8597.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55d941f747ca4b2a8d617678eeef8597. May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application result = self._query(query) May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application conn.query(q) May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 08:59:11.863518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application result.read() May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 03 08:59:11.864548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return project_ref.to_dict() May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application next(self.gen) May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application yield resource May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application next(self.gen) May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self.session.rollback() May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self.force_reraise() May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise self.value May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application session.commit() May 03 08:59:11.865500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._prepare_impl() May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self.session.flush() May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._flush(objects) May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application compat.raise_( May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application flush_context.execute() May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 08:59:11.866782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rec.execute(self) May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 08:59:11.867712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application result = self._query(query) May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application conn.query(q) May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application result.read() May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 08:59:11.868612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [parameters: {'id': '55d941f747ca4b2a8d617678eeef8597', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:11.870801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:11.872737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:11.875265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:11.875265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 03 08:59:11.875265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 03 08:59:11.875265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:11.875265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:11.875265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 03 08:59:11.875265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.Conflict( May 03 08:59:11.875265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55d941f747ca4b2a8d617678eeef8597. May 03 08:59:11.875265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:11.875265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 487/958] 10.222.0.23 () {60 vars in 1140 bytes} [Tue May 3 08:59:11 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:11.875265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228776a-6ecc-4466-a630-59609bcedf86 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:11.875265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228776a-6ecc-4466-a630-59609bcedf86 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:11.876908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228776a-6ecc-4466-a630-59609bcedf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:11.889982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-3228776a-6ecc-4466-a630-59609bcedf86 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:11.891444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3228776a-6ecc-4466-a630-59609bcedf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:11.896591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299747-71a2-494b-9fec-3c9dd69d985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:11.897246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299747-71a2-494b-9fec-3c9dd69d985c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:11.897522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299747-71a2-494b-9fec-3c9dd69d985c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:11.897788 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299747-71a2-494b-9fec-3c9dd69d985c None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:11.898485 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41299747-71a2-494b-9fec-3c9dd69d985c None admin] RBAC: Adding query filter params (type=compute) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:11.898785 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41299747-71a2-494b-9fec-3c9dd69d985c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:11.900169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41299747-71a2-494b-9fec-3c9dd69d985c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:11.904985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 472/959] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:59:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:11.912810 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299747-71a2-494b-9fec-3c9dd69d985c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:11.988271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 488/960] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:12.013908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228776a-6ecc-4466-a630-59609bcedf86 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:12.044234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299747-71a2-494b-9fec-3c9dd69d985c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:12.080582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c824-f933-4918-af19-5c9f7a6f0786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:12.081821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c824-f933-4918-af19-5c9f7a6f0786 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:12.082324 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c824-f933-4918-af19-5c9f7a6f0786 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:12.083452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c824-f933-4918-af19-5c9f7a6f0786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:12.092648 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2c824-f933-4918-af19-5c9f7a6f0786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:12.094305 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2c824-f933-4918-af19-5c9f7a6f0786 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-aad2c824-f933-4918-af19-5c9f7a6f0786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:59:12.111691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:12.112946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:12.113899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:59:12.113899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:59:12.113899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:59:12.113899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:59:12.113899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:59:12.113899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:59:12.113899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:12.113899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:12.114672 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 473/961] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:59:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:12.120513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c824-f933-4918-af19-5c9f7a6f0786 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:12.138238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228776a-6ecc-4466-a630-59609bcedf86 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:12.171314 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173b828-352e-458d-a763-570446752821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:12.172149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173b828-352e-458d-a763-570446752821 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:12.172432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173b828-352e-458d-a763-570446752821 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:12.172698 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173b828-352e-458d-a763-570446752821 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:12.182728 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173b828-352e-458d-a763-570446752821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-b173b828-352e-458d-a763-570446752821 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:59:12.190830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:12.193207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:12.194320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 489/962] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 3 08:59:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:12.198818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173b828-352e-458d-a763-570446752821 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:12.235819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c824-f933-4918-af19-5c9f7a6f0786 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:12.269460 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b1dc6-f75d-4f2c-b8cf-55a78385a264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:12.270144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1dc6-f75d-4f2c-b8cf-55a78385a264 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:12.270419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1dc6-f75d-4f2c-b8cf-55a78385a264 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:12.270745 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1dc6-f75d-4f2c-b8cf-55a78385a264 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:12.271494 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b1dc6-f75d-4f2c-b8cf-55a78385a264 None admin] RBAC: Adding query filter params (name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:12.271878 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b1dc6-f75d-4f2c-b8cf-55a78385a264 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:12.273347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b1dc6-f75d-4f2c-b8cf-55a78385a264 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:12.296208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 474/963] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:59:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:12.300761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4ab40-c479-4abd-819e-3509a749061a None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:12.301072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4ab40-c479-4abd-819e-3509a749061a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:12.301907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4ab40-c479-4abd-819e-3509a749061a None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:12.303632 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 475/964] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:59:12.310141 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851b24-0823-4bc4-acb2-4be3e9cd8ed9 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:12.310461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851b24-0823-4bc4-acb2-4be3e9cd8ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:12.310700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851b24-0823-4bc4-acb2-4be3e9cd8ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:12.322316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173b828-352e-458d-a763-570446752821 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:12.329430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-cc851b24-0823-4bc4-acb2-4be3e9cd8ed9 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:12.330654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-cc851b24-0823-4bc4-acb2-4be3e9cd8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:12.358150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60248842-33ae-4415-8212-5f9e6d83cd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:12.358828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60248842-33ae-4415-8212-5f9e6d83cd06 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:12.359110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60248842-33ae-4415-8212-5f9e6d83cd06 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:12.359379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60248842-33ae-4415-8212-5f9e6d83cd06 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:12.360165 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60248842-33ae-4415-8212-5f9e6d83cd06 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:12.360470 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60248842-33ae-4415-8212-5f9e6d83cd06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:12.362079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60248842-33ae-4415-8212-5f9e6d83cd06 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:12.375020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 490/965] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 08:59:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:12.385788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60248842-33ae-4415-8212-5f9e6d83cd06 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:12.412222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 476/966] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:59:12.429340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc851b24-0823-4bc4-acb2-4be3e9cd8ed9 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:12.510744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60248842-33ae-4415-8212-5f9e6d83cd06 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:12.532889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc851b24-0823-4bc4-acb2-4be3e9cd8ed9 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:12.546548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e5f16-8dd4-4d12-bfb6-683ffed2a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:12.547281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e5f16-8dd4-4d12-bfb6-683ffed2a276 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:12.547561 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e5f16-8dd4-4d12-bfb6-683ffed2a276 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:12.547834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e5f16-8dd4-4d12-bfb6-683ffed2a276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:12.558408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e5f16-8dd4-4d12-bfb6-683ffed2a276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:12.559930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e5f16-8dd4-4d12-bfb6-683ffed2a276 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:12.569572 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3c4d2-6c9a-4d8f-8cf9-1f6dab641ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:12.570195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3c4d2-6c9a-4d8f-8cf9-1f6dab641ad1 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:12.570475 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3c4d2-6c9a-4d8f-8cf9-1f6dab641ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:12.570745 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3c4d2-6c9a-4d8f-8cf9-1f6dab641ad1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:12.571389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3c4d2-6c9a-4d8f-8cf9-1f6dab641ad1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:12.572764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3c4d2-6c9a-4d8f-8cf9-1f6dab641ad1 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-161e5f16-8dd4-4d12-bfb6-683ffed2a276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:12.576818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:12.577684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:12.578962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:12.578962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:12.578962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:12.578962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:12.578962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 491/967] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:12.584670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e5f16-8dd4-4d12-bfb6-683ffed2a276 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-d1e3c4d2-6c9a-4d8f-8cf9-1f6dab641ad1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:12.585724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:12.586687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:12.593030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 477/968] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 08:59:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:12.595214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3c4d2-6c9a-4d8f-8cf9-1f6dab641ad1 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:12.695452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3c4d2-6c9a-4d8f-8cf9-1f6dab641ad1 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:12.699646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e5f16-8dd4-4d12-bfb6-683ffed2a276 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:12.730113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdced1a-6578-4a83-98c2-92241c606303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:12.731209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdced1a-6578-4a83-98c2-92241c606303 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:12.731694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdced1a-6578-4a83-98c2-92241c606303 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:12.732189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdced1a-6578-4a83-98c2-92241c606303 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:12.733346 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdced1a-6578-4a83-98c2-92241c606303 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:12.733899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdced1a-6578-4a83-98c2-92241c606303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:12.736551 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdced1a-6578-4a83-98c2-92241c606303 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:12.738545 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf7b16-0745-4c56-8950-940a72f996ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:12.739232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7b16-0745-4c56-8950-940a72f996ca None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:12.739801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7b16-0745-4c56-8950-940a72f996ca None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:12.740070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7b16-0745-4c56-8950-940a72f996ca None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:12.740819 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf7b16-0745-4c56-8950-940a72f996ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:12.741119 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf7b16-0745-4c56-8950-940a72f996ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:12.742736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf7b16-0745-4c56-8950-940a72f996ca None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:12.744835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 478/969] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 08:59:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:12.752965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdced1a-6578-4a83-98c2-92241c606303 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:12.762446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 492/970] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:12.764567 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf7b16-0745-4c56-8950-940a72f996ca None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:12.857140 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdced1a-6578-4a83-98c2-92241c606303 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:12.872306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf7b16-0745-4c56-8950-940a72f996ca None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:12.890747 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfcc9b-3b50-49b8-b2c4-f212c6cd597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:12.891682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfcc9b-3b50-49b8-b2c4-f212c6cd597f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:12.892172 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfcc9b-3b50-49b8-b2c4-f212c6cd597f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:12.892618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfcc9b-3b50-49b8-b2c4-f212c6cd597f None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:12.893506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfcc9b-3b50-49b8-b2c4-f212c6cd597f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:12.893992 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfcc9b-3b50-49b8-b2c4-f212c6cd597f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:12.896185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfcc9b-3b50-49b8-b2c4-f212c6cd597f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:12.901435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 479/971] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 08:59:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:12.907772 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfcc9b-3b50-49b8-b2c4-f212c6cd597f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:12.912222 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cf3ba-e0c0-4e58-ab74-f4005e47f934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:12.913256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cf3ba-e0c0-4e58-ab74-f4005e47f934 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:12.913892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cf3ba-e0c0-4e58-ab74-f4005e47f934 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:12.914427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cf3ba-e0c0-4e58-ab74-f4005e47f934 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:12.923459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141cf3ba-e0c0-4e58-ab74-f4005e47f934 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:12.925693 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141cf3ba-e0c0-4e58-ab74-f4005e47f934 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-141cf3ba-e0c0-4e58-ab74-f4005e47f934 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:59:12.945688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:12.946734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:12.947743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:12.947743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:12.947743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:59:12.947743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:59:12.947743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:59:12.947743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:59:12.947743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:59:12.947743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:59:12.947743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 08:59:12.947743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:12.951521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 493/972] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 08:59:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:12.958060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cf3ba-e0c0-4e58-ab74-f4005e47f934 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:13.024908 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfcc9b-3b50-49b8-b2c4-f212c6cd597f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:13.067527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cf3ba-e0c0-4e58-ab74-f4005e47f934 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:13.068049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e5211-0cfa-4274-8c85-3723b1d0141c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:13.069100 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e5211-0cfa-4274-8c85-3723b1d0141c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:13.070332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e5211-0cfa-4274-8c85-3723b1d0141c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:13.070816 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e5211-0cfa-4274-8c85-3723b1d0141c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:13.071832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e5211-0cfa-4274-8c85-3723b1d0141c None admin] RBAC: Adding query filter params (interface=admin, service_id=903cdd5fd39b427a87a51415c1ce7dc9, region_id=RegionOne) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:13.072389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e5211-0cfa-4274-8c85-3723b1d0141c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:13.074333 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e5211-0cfa-4274-8c85-3723b1d0141c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:13.081924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 480/973] 10.222.0.23 () {56 vars in 1249 bytes} [Tue May 3 08:59:12 2022] GET /identity/v3/endpoints?service_id=903cdd5fd39b427a87a51415c1ce7dc9&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:13.087385 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e5211-0cfa-4274-8c85-3723b1d0141c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:13.111665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57338774-900b-4102-8afb-6e718239f0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:13.112970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57338774-900b-4102-8afb-6e718239f0df None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:13.113604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57338774-900b-4102-8afb-6e718239f0df None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:13.114615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57338774-900b-4102-8afb-6e718239f0df None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:13.116206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57338774-900b-4102-8afb-6e718239f0df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:13.116716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57338774-900b-4102-8afb-6e718239f0df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:13.119049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57338774-900b-4102-8afb-6e718239f0df None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:13.145556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 494/974] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 3 08:59:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:13.146629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57338774-900b-4102-8afb-6e718239f0df None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:13.201244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e5211-0cfa-4274-8c85-3723b1d0141c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:13.235364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f39966-221a-4311-8cd1-06b1228eb28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:13.236542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f39966-221a-4311-8cd1-06b1228eb28b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:13.237021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f39966-221a-4311-8cd1-06b1228eb28b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:13.237467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f39966-221a-4311-8cd1-06b1228eb28b None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:13.238335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f39966-221a-4311-8cd1-06b1228eb28b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:13.240564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f39966-221a-4311-8cd1-06b1228eb28b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:13.247075 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 481/975] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 08:59:13 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 08:59:13.263426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57338774-900b-4102-8afb-6e718239f0df None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:13.298943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0ebd9-4c71-4789-aa9c-5c81e1dc65ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:13.299987 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0ebd9-4c71-4789-aa9c-5c81e1dc65ce None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:13.300494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0ebd9-4c71-4789-aa9c-5c81e1dc65ce None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:13.300961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0ebd9-4c71-4789-aa9c-5c81e1dc65ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:13.372861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0ebd9-4c71-4789-aa9c-5c81e1dc65ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:13.375120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0ebd9-4c71-4789-aa9c-5c81e1dc65ce None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:13.479378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 495/976] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:59:13 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:59:13.485422 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f39966-221a-4311-8cd1-06b1228eb28b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:13.586057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f39966-221a-4311-8cd1-06b1228eb28b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:13.623898 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9654307-e9ac-4abc-9f5c-cb1b01adcab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:13.625203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9654307-e9ac-4abc-9f5c-cb1b01adcab0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:13.625710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9654307-e9ac-4abc-9f5c-cb1b01adcab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:13.626211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9654307-e9ac-4abc-9f5c-cb1b01adcab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:13.637325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9654307-e9ac-4abc-9f5c-cb1b01adcab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:13.639029 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9654307-e9ac-4abc-9f5c-cb1b01adcab0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-d9654307-e9ac-4abc-9f5c-cb1b01adcab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:13.656369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:13.657383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:13.658288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:13.658288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:13.658288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:13.658288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:13.665286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 482/977] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:13.666929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0ebd9-4c71-4789-aa9c-5c81e1dc65ce None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:13.765202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0ebd9-4c71-4789-aa9c-5c81e1dc65ce None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:13.799390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43de3f-9009-4b33-8188-8d5dc9d611a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:13.800406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43de3f-9009-4b33-8188-8d5dc9d611a9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:13.800915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43de3f-9009-4b33-8188-8d5dc9d611a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:13.801420 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43de3f-9009-4b33-8188-8d5dc9d611a9 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:13.802342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43de3f-9009-4b33-8188-8d5dc9d611a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:13.802859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43de3f-9009-4b33-8188-8d5dc9d611a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:13.804445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43de3f-9009-4b33-8188-8d5dc9d611a9 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:13.820449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 496/978] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:13.822407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9654307-e9ac-4abc-9f5c-cb1b01adcab0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:13.922261 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9654307-e9ac-4abc-9f5c-cb1b01adcab0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:13.955752 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd86d7-9ca2-4f64-9841-56e1bf00bf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:13.956923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd86d7-9ca2-4f64-9841-56e1bf00bf24 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:13.957942 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd86d7-9ca2-4f64-9841-56e1bf00bf24 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:13.958436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd86d7-9ca2-4f64-9841-56e1bf00bf24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:13.965483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd86d7-9ca2-4f64-9841-56e1bf00bf24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:13.967207 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd86d7-9ca2-4f64-9841-56e1bf00bf24 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-febd86d7-9ca2-4f64-9841-56e1bf00bf24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:59:13.983018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:13.983935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:13.984889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:59:13.984889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:59:13.984889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:59:13.984889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:59:13.984889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:59:13.984889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:59:13.984889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:13.984889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:13.991737 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 483/979] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:13.993387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43de3f-9009-4b33-8188-8d5dc9d611a9 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:14.097910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43de3f-9009-4b33-8188-8d5dc9d611a9 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:14.132653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e3b23-4cec-4f30-92cd-e8ccee9487b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:14.133717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e3b23-4cec-4f30-92cd-e8ccee9487b8 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:14.134200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e3b23-4cec-4f30-92cd-e8ccee9487b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:14.134675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e3b23-4cec-4f30-92cd-e8ccee9487b8 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:14.135670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e3b23-4cec-4f30-92cd-e8ccee9487b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:14.136204 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e3b23-4cec-4f30-92cd-e8ccee9487b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:14.137976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e3b23-4cec-4f30-92cd-e8ccee9487b8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:14.156187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 497/980] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:14.159018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd86d7-9ca2-4f64-9841-56e1bf00bf24 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:14.246136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c729d-0b26-4534-8e12-32056fadadc3 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:14.246492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c729d-0b26-4534-8e12-32056fadadc3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:14.246688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c729d-0b26-4534-8e12-32056fadadc3 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:14.248208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 498/981] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:14.252880 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7286d26-596f-48c9-9517-5c246539ae37 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:14.253393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7286d26-596f-48c9-9517-5c246539ae37 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:14.253878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7286d26-596f-48c9-9517-5c246539ae37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:14.269153 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd86d7-9ca2-4f64-9841-56e1bf00bf24 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:14.271629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-c7286d26-596f-48c9-9517-5c246539ae37 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:14.273077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c7286d26-596f-48c9-9517-5c246539ae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:14.304222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea1a67-7091-4152-a705-bd4a0597b8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:14.304876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea1a67-7091-4152-a705-bd4a0597b8eb None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:14.305154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea1a67-7091-4152-a705-bd4a0597b8eb None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:14.305426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea1a67-7091-4152-a705-bd4a0597b8eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:14.306246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea1a67-7091-4152-a705-bd4a0597b8eb None admin] RBAC: Adding query filter params (role.id=2daf97ca638c49178dcb0c571a2b991b, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=14cf4626439e4b689a036f47a0023ea0) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:14.306559 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea1a67-7091-4152-a705-bd4a0597b8eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:14.307973 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea1a67-7091-4152-a705-bd4a0597b8eb None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:14.320233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 484/982] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:59:14 2022] GET /identity/v3/role_assignments?user.id=14cf4626439e4b689a036f47a0023ea0&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=2daf97ca638c49178dcb0c571a2b991b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:14.347344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 499/983] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:14.373890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea1a67-7091-4152-a705-bd4a0597b8eb None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:14.484218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea1a67-7091-4152-a705-bd4a0597b8eb None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:14.521147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb620f-100d-4ea1-bea2-4a32619a573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:14.521888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb620f-100d-4ea1-bea2-4a32619a573b None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:14.522169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb620f-100d-4ea1-bea2-4a32619a573b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:14.522483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb620f-100d-4ea1-bea2-4a32619a573b None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:14.523168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb620f-100d-4ea1-bea2-4a32619a573b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:14.524653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb620f-100d-4ea1-bea2-4a32619a573b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:14.543825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 485/984] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 08:59:14 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:14.733129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bc762-5280-4d55-8681-82b7d33f93b1 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:14.733634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bc762-5280-4d55-8681-82b7d33f93b1 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:14.733710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bc762-5280-4d55-8681-82b7d33f93b1 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:14.735328 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 500/985] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:14.741277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3601965-7df5-4c16-a81d-1ed7bcb8c51b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:14.741561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3601965-7df5-4c16-a81d-1ed7bcb8c51b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:14.741835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3601965-7df5-4c16-a81d-1ed7bcb8c51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:14.760050 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-c3601965-7df5-4c16-a81d-1ed7bcb8c51b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:14.761263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c3601965-7df5-4c16-a81d-1ed7bcb8c51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:14.836894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 486/986] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:14.861951 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bc762-5280-4d55-8681-82b7d33f93b1 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:14.962863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bc762-5280-4d55-8681-82b7d33f93b1 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:14.996801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9087c3-625c-484e-b836-7792e41cf57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:14.997393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9087c3-625c-484e-b836-7792e41cf57e None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:14.997670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9087c3-625c-484e-b836-7792e41cf57e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:14.997940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9087c3-625c-484e-b836-7792e41cf57e None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:14.998645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9087c3-625c-484e-b836-7792e41cf57e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:15.000063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9087c3-625c-484e-b836-7792e41cf57e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:15.015109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.sql.core [None req-dd9087c3-625c-484e-b836-7792e41cf57e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 08:59:15.015109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 08:59:15.015109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [parameters: {'user_id': '772fd4e7e878477a8acb345dfe7852a1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 08:59:15.015109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79902) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-dd9087c3-625c-484e-b836-7792e41cf57e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application result = self._query(query) May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application conn.query(q) May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application result.read() May 03 08:59:15.022888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 08:59:15.024914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application next(self.gen) May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application yield resource May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application next(self.gen) May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self.session.rollback() May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self.force_reraise() May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise self.value May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application session.commit() May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 08:59:15.027137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._prepare_impl() May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self.session.flush() May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._flush(objects) May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application compat.raise_( May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application flush_context.execute() May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rec.execute(self) May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 08:59:15.029225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application result = connection._execute_20( May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 08:59:15.030543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application result = self._query(query) May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application conn.query(q) May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application result.read() May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 08:59:15.031576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [parameters: {'user_id': '772fd4e7e878477a8acb345dfe7852a1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:15.033264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 03 08:59:15.035184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 03 08:59:15.037900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 03 08:59:15.037900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 03 08:59:15.037900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 08:59:15.037900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 08:59:15.037900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 08:59:15.037900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:15.037900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 501/987] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 3 08:59:14 2022] POST /identity/v3/users => generated 160 bytes in 163 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:15.038780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3601965-7df5-4c16-a81d-1ed7bcb8c51b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:15.133498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3601965-7df5-4c16-a81d-1ed7bcb8c51b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:15.168266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5aeb33-3144-4026-889d-0c8bd2390468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:15.169062 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aeb33-3144-4026-889d-0c8bd2390468 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:15.169349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aeb33-3144-4026-889d-0c8bd2390468 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:15.169622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aeb33-3144-4026-889d-0c8bd2390468 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:15.177590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5aeb33-3144-4026-889d-0c8bd2390468 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:15.179112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5aeb33-3144-4026-889d-0c8bd2390468 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-ce5aeb33-3144-4026-889d-0c8bd2390468 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:59:15.193803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:15.194756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:15.195699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:15.195699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:15.195699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:59:15.195699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:59:15.195699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:59:15.195699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:59:15.195699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:59:15.195699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:59:15.195699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 08:59:15.195699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:15.195699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 487/988] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:59:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:15.201284 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9087c3-625c-484e-b836-7792e41cf57e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:15.303221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9087c3-625c-484e-b836-7792e41cf57e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:15.336771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fb701-006f-4017-9851-1f08d53b5614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:15.337442 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fb701-006f-4017-9851-1f08d53b5614 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:15.337718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fb701-006f-4017-9851-1f08d53b5614 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:15.337988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fb701-006f-4017-9851-1f08d53b5614 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:15.338782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fb701-006f-4017-9851-1f08d53b5614 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:15.339083 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fb701-006f-4017-9851-1f08d53b5614 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:15.340725 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fb701-006f-4017-9851-1f08d53b5614 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:15.381328 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 502/989] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 08:59:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:15.622821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435bd05-2903-4539-b342-c521149c94c4 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:15.623298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435bd05-2903-4539-b342-c521149c94c4 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:15.623298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435bd05-2903-4539-b342-c521149c94c4 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:15.624911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 488/990] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:15.630676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6303-6d83-4975-ac2d-36fffd05ab65 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:15.630962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6303-6d83-4975-ac2d-36fffd05ab65 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:15.631234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6303-6d83-4975-ac2d-36fffd05ab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:15.649517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-934f6303-6d83-4975-ac2d-36fffd05ab65 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:15.650988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-934f6303-6d83-4975-ac2d-36fffd05ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:15.718667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 503/991] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:15.748739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435bd05-2903-4539-b342-c521149c94c4 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:15.851175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435bd05-2903-4539-b342-c521149c94c4 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:15.883195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74d91d-0646-43db-b2b1-f842eb8d1b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:15.883977 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74d91d-0646-43db-b2b1-f842eb8d1b1b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:15.884368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74d91d-0646-43db-b2b1-f842eb8d1b1b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:15.884686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74d91d-0646-43db-b2b1-f842eb8d1b1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:15.885395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74d91d-0646-43db-b2b1-f842eb8d1b1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:15.886865 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74d91d-0646-43db-b2b1-f842eb8d1b1b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-1a74d91d-0646-43db-b2b1-f842eb8d1b1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:15.898756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:15.899812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:15.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 489/992] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 08:59:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:15.907797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f6303-6d83-4975-ac2d-36fffd05ab65 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:16.000388 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f6303-6d83-4975-ac2d-36fffd05ab65 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:16.031664 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba8318-166e-4b76-abd6-6c5d27b3aca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:16.032397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba8318-166e-4b76-abd6-6c5d27b3aca6 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:16.032679 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba8318-166e-4b76-abd6-6c5d27b3aca6 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:16.033009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba8318-166e-4b76-abd6-6c5d27b3aca6 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:16.033712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba8318-166e-4b76-abd6-6c5d27b3aca6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:16.034011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba8318-166e-4b76-abd6-6c5d27b3aca6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:16.035421 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba8318-166e-4b76-abd6-6c5d27b3aca6 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:16.044253 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 504/993] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 08:59:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:16.046397 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74d91d-0646-43db-b2b1-f842eb8d1b1b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:16.143749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74d91d-0646-43db-b2b1-f842eb8d1b1b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:16.176425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d417d8-4b60-48b6-affd-d7e5d9757dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:16.177408 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d417d8-4b60-48b6-affd-d7e5d9757dfb None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:16.177872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d417d8-4b60-48b6-affd-d7e5d9757dfb None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:16.178318 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d417d8-4b60-48b6-affd-d7e5d9757dfb None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:16.179201 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d417d8-4b60-48b6-affd-d7e5d9757dfb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:16.179676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d417d8-4b60-48b6-affd-d7e5d9757dfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:16.181372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d417d8-4b60-48b6-affd-d7e5d9757dfb None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:16.191051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 490/994] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 08:59:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:16.192108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba8318-166e-4b76-abd6-6c5d27b3aca6 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:16.293750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba8318-166e-4b76-abd6-6c5d27b3aca6 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:16.326635 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c619fa2-fc6d-4f3f-ae5d-32323842a86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:16.327288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c619fa2-fc6d-4f3f-ae5d-32323842a86c None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:16.327569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c619fa2-fc6d-4f3f-ae5d-32323842a86c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:16.327839 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c619fa2-fc6d-4f3f-ae5d-32323842a86c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:16.328602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c619fa2-fc6d-4f3f-ae5d-32323842a86c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:16.330047 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c619fa2-fc6d-4f3f-ae5d-32323842a86c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:16.355856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 505/995] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 08:59:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:16.703533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741edd47-a04e-4e41-95b9-b53f7c098bfb None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:16.704079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741edd47-a04e-4e41-95b9-b53f7c098bfb None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:16.704079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741edd47-a04e-4e41-95b9-b53f7c098bfb None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:16.705502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 491/996] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:16.711322 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7ab9-ac4e-49ca-8a84-870068b2298e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:16.711614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7ab9-ac4e-49ca-8a84-870068b2298e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:16.711895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7ab9-ac4e-49ca-8a84-870068b2298e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:16.729949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-19fa7ab9-ac4e-49ca-8a84-870068b2298e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:16.731168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-19fa7ab9-ac4e-49ca-8a84-870068b2298e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:16.802612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 506/997] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:16.825725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741edd47-a04e-4e41-95b9-b53f7c098bfb None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:16.910199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd94eb6-77d7-4012-a999-587686d2ebfc None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:16.911331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd94eb6-77d7-4012-a999-587686d2ebfc None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:16.911331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd94eb6-77d7-4012-a999-587686d2ebfc None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:16.912838 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 507/998] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:59:16.919254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2e1fe-157c-40f0-a35c-13115482f493 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:16.919254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2e1fe-157c-40f0-a35c-13115482f493 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:16.919254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2e1fe-157c-40f0-a35c-13115482f493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:16.922931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741edd47-a04e-4e41-95b9-b53f7c098bfb None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:16.934488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-70f2e1fe-157c-40f0-a35c-13115482f493 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:16.935777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-70f2e1fe-157c-40f0-a35c-13115482f493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:16.955205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da72556-d7fb-4b09-8832-7db045da181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:16.955915 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da72556-d7fb-4b09-8832-7db045da181a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:16.956222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da72556-d7fb-4b09-8832-7db045da181a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:16.956492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da72556-d7fb-4b09-8832-7db045da181a None admin] PATH_INFO: `/v3/services/image` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:16.957161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da72556-d7fb-4b09-8832-7db045da181a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:16.958998 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da72556-d7fb-4b09-8832-7db045da181a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-2da72556-d7fb-4b09-8832-7db045da181a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:16.970247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:16.971230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:16.972336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 492/999] 10.222.0.23 () {56 vars in 1105 bytes} [Tue May 3 08:59:16 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:16.977721 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da72556-d7fb-4b09-8832-7db045da181a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:17.005140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 508/1000] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:17.027900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2e1fe-157c-40f0-a35c-13115482f493 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:17.071832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da72556-d7fb-4b09-8832-7db045da181a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:17.106985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2a810-ec60-4bb1-87ae-4d6b0514201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:17.107997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2a810-ec60-4bb1-87ae-4d6b0514201e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:17.108523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2a810-ec60-4bb1-87ae-4d6b0514201e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:17.108972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2a810-ec60-4bb1-87ae-4d6b0514201e None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:17.109825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2a810-ec60-4bb1-87ae-4d6b0514201e None admin] RBAC: Adding query filter params (name=image) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:17.110277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2a810-ec60-4bb1-87ae-4d6b0514201e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:17.111796 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2a810-ec60-4bb1-87ae-4d6b0514201e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:17.117457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 493/1001] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:17.122612 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2a810-ec60-4bb1-87ae-4d6b0514201e None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:17.126695 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2e1fe-157c-40f0-a35c-13115482f493 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:17.162052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab467113-82a6-4064-b451-7a862b3ad78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:17.162849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab467113-82a6-4064-b451-7a862b3ad78a None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:17.163486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab467113-82a6-4064-b451-7a862b3ad78a None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:17.163765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab467113-82a6-4064-b451-7a862b3ad78a None admin] PATH_INFO: `/v3/services/compute` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:17.164751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab467113-82a6-4064-b451-7a862b3ad78a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:17.166376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab467113-82a6-4064-b451-7a862b3ad78a None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-ab467113-82a6-4064-b451-7a862b3ad78a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:17.181659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:17.184450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:59:17.185878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:17.187200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 509/1002] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:59:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:17.189346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab467113-82a6-4064-b451-7a862b3ad78a None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:17.227952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2a810-ec60-4bb1-87ae-4d6b0514201e None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:17.262330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b457b-7f38-447f-be27-115eedbf396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:17.262989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b457b-7f38-447f-be27-115eedbf396f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:17.263269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b457b-7f38-447f-be27-115eedbf396f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:17.263541 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b457b-7f38-447f-be27-115eedbf396f None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:17.264273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b457b-7f38-447f-be27-115eedbf396f None admin] RBAC: Adding query filter params (type=image) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:17.264581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b457b-7f38-447f-be27-115eedbf396f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:17.265946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b457b-7f38-447f-be27-115eedbf396f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:17.276485 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 494/1003] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:17.287466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab467113-82a6-4064-b451-7a862b3ad78a None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:17.321980 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddbe9e-01ea-4c52-8218-7240ba57e050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:17.322652 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddbe9e-01ea-4c52-8218-7240ba57e050 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:17.322931 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddbe9e-01ea-4c52-8218-7240ba57e050 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:17.323199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddbe9e-01ea-4c52-8218-7240ba57e050 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:17.324279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddbe9e-01ea-4c52-8218-7240ba57e050 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:17.324604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddbe9e-01ea-4c52-8218-7240ba57e050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:17.325976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddbe9e-01ea-4c52-8218-7240ba57e050 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:17.337265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 510/1004] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:59:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:17.338124 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b457b-7f38-447f-be27-115eedbf396f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:17.439101 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b457b-7f38-447f-be27-115eedbf396f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:17.476881 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1832f9-aa3c-4caf-8780-4118b6a08e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:17.477484 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1832f9-aa3c-4caf-8780-4118b6a08e80 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:17.477767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1832f9-aa3c-4caf-8780-4118b6a08e80 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:17.478049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1832f9-aa3c-4caf-8780-4118b6a08e80 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:17.478771 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1832f9-aa3c-4caf-8780-4118b6a08e80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:17.479078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1832f9-aa3c-4caf-8780-4118b6a08e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:17.480500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1832f9-aa3c-4caf-8780-4118b6a08e80 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:17.486067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 495/1005] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:59:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:17.492619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddbe9e-01ea-4c52-8218-7240ba57e050 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:17.590310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddbe9e-01ea-4c52-8218-7240ba57e050 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:17.621916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23004d43-e1ea-4051-acb3-289adfffa37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:17.622571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23004d43-e1ea-4051-acb3-289adfffa37f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:17.622850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23004d43-e1ea-4051-acb3-289adfffa37f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:17.623121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23004d43-e1ea-4051-acb3-289adfffa37f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:17.623902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23004d43-e1ea-4051-acb3-289adfffa37f None admin] RBAC: Adding query filter params (interface=public, service_id=ce521b88ec3a4583bf2859f59988d934, region_id=RegionOne) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:17.624238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23004d43-e1ea-4051-acb3-289adfffa37f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:17.625587 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23004d43-e1ea-4051-acb3-289adfffa37f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:17.635532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 511/1006] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 08:59:17 2022] GET /identity/v3/endpoints?service_id=ce521b88ec3a4583bf2859f59988d934&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:17.636730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1832f9-aa3c-4caf-8780-4118b6a08e80 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:17.730184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1832f9-aa3c-4caf-8780-4118b6a08e80 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:17.762737 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812631ec-1951-4193-8982-6d926296ff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:17.763394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812631ec-1951-4193-8982-6d926296ff50 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:17.763678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812631ec-1951-4193-8982-6d926296ff50 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:17.763955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812631ec-1951-4193-8982-6d926296ff50 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:17.764668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812631ec-1951-4193-8982-6d926296ff50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:17.766032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812631ec-1951-4193-8982-6d926296ff50 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:17.772371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 496/1007] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 08:59:17 2022] GET /identity/v3/services => generated 1727 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:59:18.629712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bfa1f-edc7-42fe-8bf7-a11f11bb7c9f None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:18.630268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bfa1f-edc7-42fe-8bf7-a11f11bb7c9f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:18.630268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bfa1f-edc7-42fe-8bf7-a11f11bb7c9f None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:18.631740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 512/1008] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:18.636774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484e8f1-0943-467d-b827-ac2f3d2a64ea None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:18.637142 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484e8f1-0943-467d-b827-ac2f3d2a64ea None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:18.637493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484e8f1-0943-467d-b827-ac2f3d2a64ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:18.655408 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f484e8f1-0943-467d-b827-ac2f3d2a64ea None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:18.656628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f484e8f1-0943-467d-b827-ac2f3d2a64ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:18.719759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 497/1009] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:18 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:18.742833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bfa1f-edc7-42fe-8bf7-a11f11bb7c9f None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:18.843141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bfa1f-edc7-42fe-8bf7-a11f11bb7c9f None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:18.874508 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf1966-25c2-4b67-94e5-faad99ead3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:18.875300 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf1966-25c2-4b67-94e5-faad99ead3a9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:18.875583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf1966-25c2-4b67-94e5-faad99ead3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:18.875855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf1966-25c2-4b67-94e5-faad99ead3a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:18.877065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf1966-25c2-4b67-94e5-faad99ead3a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:18.878512 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf1966-25c2-4b67-94e5-faad99ead3a9 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:18.881287 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 513/1010] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:18.886989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484e8f1-0943-467d-b827-ac2f3d2a64ea None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:18.980985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484e8f1-0943-467d-b827-ac2f3d2a64ea None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:19.013744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a358889-65d4-4779-aff3-17d867f09ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:19.014398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a358889-65d4-4779-aff3-17d867f09ffc None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:19.014676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a358889-65d4-4779-aff3-17d867f09ffc None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:19.014948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a358889-65d4-4779-aff3-17d867f09ffc None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:19.015662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a358889-65d4-4779-aff3-17d867f09ffc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:19.017105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a358889-65d4-4779-aff3-17d867f09ffc None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:19.042716 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 498/1011] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 08:59:18 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:19.533889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f631b-436f-45aa-ac07-f77162a4c4ca None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:19.534193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f631b-436f-45aa-ac07-f77162a4c4ca None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:19.534488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f631b-436f-45aa-ac07-f77162a4c4ca None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:19.536659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 514/1012] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:19.541652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064c627-05cb-4410-9377-c4368f478ec5 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:19.541943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064c627-05cb-4410-9377-c4368f478ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:19.542279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064c627-05cb-4410-9377-c4368f478ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:19.559088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-b064c627-05cb-4410-9377-c4368f478ec5 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:19.560288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b064c627-05cb-4410-9377-c4368f478ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:19.624706 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 499/1013] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:59:19.646461 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f631b-436f-45aa-ac07-f77162a4c4ca None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:19.743568 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f631b-436f-45aa-ac07-f77162a4c4ca None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:19.775528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207fca0-e06c-4064-b4fa-c43aa36a44a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:19.776216 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207fca0-e06c-4064-b4fa-c43aa36a44a5 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:19.776501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207fca0-e06c-4064-b4fa-c43aa36a44a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:19.776779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207fca0-e06c-4064-b4fa-c43aa36a44a5 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:19.777507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207fca0-e06c-4064-b4fa-c43aa36a44a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:19.778864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207fca0-e06c-4064-b4fa-c43aa36a44a5 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:19.798735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 515/1014] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 08:59:19 2022] POST /identity/v3/services => generated 242 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:20.032064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f54f00-eac0-4740-be43-7edc8780f37d None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:20.032656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f54f00-eac0-4740-be43-7edc8780f37d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:20.032656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f54f00-eac0-4740-be43-7edc8780f37d None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:20.034145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 500/1015] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:20.039661 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088d060-08ee-4d16-9200-2c4025532d3a None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:20.039954 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088d060-08ee-4d16-9200-2c4025532d3a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:20.040275 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088d060-08ee-4d16-9200-2c4025532d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:20.056728 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e088d060-08ee-4d16-9200-2c4025532d3a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:20.057823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e088d060-08ee-4d16-9200-2c4025532d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:20.126912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 516/1016] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:20 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:20.150723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f54f00-eac0-4740-be43-7edc8780f37d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:20.250496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f54f00-eac0-4740-be43-7edc8780f37d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:20.286154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848223be-1fb4-459c-ae92-8745ed6c5d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:20.286934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848223be-1fb4-459c-ae92-8745ed6c5d3c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:20.287212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848223be-1fb4-459c-ae92-8745ed6c5d3c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:20.287488 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848223be-1fb4-459c-ae92-8745ed6c5d3c None admin] PATH_INFO: `/v3/services/compute` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:20.288162 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848223be-1fb4-459c-ae92-8745ed6c5d3c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:20.289524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848223be-1fb4-459c-ae92-8745ed6c5d3c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-848223be-1fb4-459c-ae92-8745ed6c5d3c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:20.301146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:20.302197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 08:59:20.303123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:20.307325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 501/1017] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:59:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:20.308287 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088d060-08ee-4d16-9200-2c4025532d3a None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:20.405099 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088d060-08ee-4d16-9200-2c4025532d3a None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:20.436172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ad812-6843-4c73-975e-130a1dccf860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:20.436825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ad812-6843-4c73-975e-130a1dccf860 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:20.437107 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ad812-6843-4c73-975e-130a1dccf860 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:20.437381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ad812-6843-4c73-975e-130a1dccf860 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:20.438081 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ad812-6843-4c73-975e-130a1dccf860 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:20.438387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ad812-6843-4c73-975e-130a1dccf860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:20.439737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ad812-6843-4c73-975e-130a1dccf860 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:20.445134 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 517/1018] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:59:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:20.450859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848223be-1fb4-459c-ae92-8745ed6c5d3c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:20.547139 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848223be-1fb4-459c-ae92-8745ed6c5d3c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:20.580150 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b794db-ae68-4e32-8d8f-228796110d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:20.580735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b794db-ae68-4e32-8d8f-228796110d1c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:20.581018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b794db-ae68-4e32-8d8f-228796110d1c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:20.581293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b794db-ae68-4e32-8d8f-228796110d1c None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:20.581997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b794db-ae68-4e32-8d8f-228796110d1c None admin] RBAC: Adding query filter params (type=compute) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:20.582331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b794db-ae68-4e32-8d8f-228796110d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:20.583697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b794db-ae68-4e32-8d8f-228796110d1c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:20.592179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 502/1019] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 08:59:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:20.594503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ad812-6843-4c73-975e-130a1dccf860 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:20.689662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ad812-6843-4c73-975e-130a1dccf860 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:20.722399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99df352-cca1-44b5-8775-c0183adaa02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:20.723054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99df352-cca1-44b5-8775-c0183adaa02c None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:20.723330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99df352-cca1-44b5-8775-c0183adaa02c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:20.723601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99df352-cca1-44b5-8775-c0183adaa02c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:20.724365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99df352-cca1-44b5-8775-c0183adaa02c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:20.725718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99df352-cca1-44b5-8775-c0183adaa02c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:20.744891 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 518/1020] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 08:59:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:21.335465 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8d852-141a-48f4-8932-4eac2861a9ab None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:21.335996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8d852-141a-48f4-8932-4eac2861a9ab None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:21.335996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8d852-141a-48f4-8932-4eac2861a9ab None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:21.337367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 503/1021] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:21.342874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb008531-b766-4fe7-9e7d-67a866a4e281 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:21.343163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb008531-b766-4fe7-9e7d-67a866a4e281 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:21.343442 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb008531-b766-4fe7-9e7d-67a866a4e281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:21.360393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-fb008531-b766-4fe7-9e7d-67a866a4e281 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:21.361561 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-fb008531-b766-4fe7-9e7d-67a866a4e281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:21.430303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 519/1022] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:21.455183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8d852-141a-48f4-8932-4eac2861a9ab None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:21.554159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8d852-141a-48f4-8932-4eac2861a9ab None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:21.587684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf445558-74bb-4d43-9373-e96c921f9ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:21.588498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf445558-74bb-4d43-9373-e96c921f9ffa None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:21.588778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf445558-74bb-4d43-9373-e96c921f9ffa None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:21.589047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf445558-74bb-4d43-9373-e96c921f9ffa None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:21.590219 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf445558-74bb-4d43-9373-e96c921f9ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:21.591638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf445558-74bb-4d43-9373-e96c921f9ffa None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:21.593423 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 504/1023] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:21.599703 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb008531-b766-4fe7-9e7d-67a866a4e281 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:21.692744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb008531-b766-4fe7-9e7d-67a866a4e281 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:21.725610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477deee-0ba6-41b4-a864-0e02dccedbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:21.726280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477deee-0ba6-41b4-a864-0e02dccedbba None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:21.726559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477deee-0ba6-41b4-a864-0e02dccedbba None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:21.726830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477deee-0ba6-41b4-a864-0e02dccedbba None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:21.727544 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477deee-0ba6-41b4-a864-0e02dccedbba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:21.728986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477deee-0ba6-41b4-a864-0e02dccedbba None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:21.750160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 520/1024] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:59:21 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:22.092346 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cd07e-6de0-4e28-8f0f-f9c6dc41261a None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:22.092741 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cd07e-6de0-4e28-8f0f-f9c6dc41261a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:22.093087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cd07e-6de0-4e28-8f0f-f9c6dc41261a None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:22.094619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 505/1025] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:22.100151 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b0745-3b05-4b25-b468-26913f750ca2 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:22.100532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b0745-3b05-4b25-b468-26913f750ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:22.100911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b0745-3b05-4b25-b468-26913f750ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:22.117137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-822b0745-3b05-4b25-b468-26913f750ca2 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:22.118309 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-822b0745-3b05-4b25-b468-26913f750ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:22.180936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 521/1026] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:22.203923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cd07e-6de0-4e28-8f0f-f9c6dc41261a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:22.306077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cd07e-6de0-4e28-8f0f-f9c6dc41261a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:22.338839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0134f-f2f5-423e-a83f-e5b2f11e5610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:22.339614 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0134f-f2f5-423e-a83f-e5b2f11e5610 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:22.339891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0134f-f2f5-423e-a83f-e5b2f11e5610 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:22.340185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0134f-f2f5-423e-a83f-e5b2f11e5610 None admin] PATH_INFO: `/v3/services/image` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:22.340833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0134f-f2f5-423e-a83f-e5b2f11e5610 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:22.342180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0134f-f2f5-423e-a83f-e5b2f11e5610 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-21d0134f-f2f5-423e-a83f-e5b2f11e5610 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:22.354033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:22.354994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:22.360782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 506/1027] 10.222.0.23 () {56 vars in 1105 bytes} [Tue May 3 08:59:22 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:22.363312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b0745-3b05-4b25-b468-26913f750ca2 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:22.461444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b0745-3b05-4b25-b468-26913f750ca2 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:22.493417 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef453b1-82bf-40b6-85a5-dac8c497436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:22.494079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef453b1-82bf-40b6-85a5-dac8c497436f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:22.494362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef453b1-82bf-40b6-85a5-dac8c497436f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:22.494635 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef453b1-82bf-40b6-85a5-dac8c497436f None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:22.495343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef453b1-82bf-40b6-85a5-dac8c497436f None admin] RBAC: Adding query filter params (name=image) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:22.495650 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef453b1-82bf-40b6-85a5-dac8c497436f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:22.497033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef453b1-82bf-40b6-85a5-dac8c497436f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:22.502666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 522/1028] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:22.509233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0134f-f2f5-423e-a83f-e5b2f11e5610 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:22.607378 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0134f-f2f5-423e-a83f-e5b2f11e5610 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:22.639242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84d48b-cddb-4523-8c98-2011a411dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:22.639897 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84d48b-cddb-4523-8c98-2011a411dc55 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:22.640213 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84d48b-cddb-4523-8c98-2011a411dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:22.640489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84d48b-cddb-4523-8c98-2011a411dc55 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:22.641187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84d48b-cddb-4523-8c98-2011a411dc55 None admin] RBAC: Adding query filter params (type=image) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:22.641489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84d48b-cddb-4523-8c98-2011a411dc55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:22.642843 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84d48b-cddb-4523-8c98-2011a411dc55 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:22.652848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 507/1029] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:22.654376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef453b1-82bf-40b6-85a5-dac8c497436f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:22.748690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef453b1-82bf-40b6-85a5-dac8c497436f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:22.781182 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc054a-5fd2-4fde-bd3f-f5d0b5a9102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:22.781842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc054a-5fd2-4fde-bd3f-f5d0b5a9102c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:22.782124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc054a-5fd2-4fde-bd3f-f5d0b5a9102c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:22.782398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc054a-5fd2-4fde-bd3f-f5d0b5a9102c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:22.783180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc054a-5fd2-4fde-bd3f-f5d0b5a9102c None admin] RBAC: Adding query filter params (interface=public, service_id=27a825a7d030429381b1949f2360b4a7, region_id=RegionOne) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:22.783490 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc054a-5fd2-4fde-bd3f-f5d0b5a9102c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:22.784990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc054a-5fd2-4fde-bd3f-f5d0b5a9102c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:22.789994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 523/1030] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 08:59:22 2022] GET /identity/v3/endpoints?service_id=27a825a7d030429381b1949f2360b4a7&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:22.795406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84d48b-cddb-4523-8c98-2011a411dc55 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:22.893464 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84d48b-cddb-4523-8c98-2011a411dc55 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:22.929941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80307030-ccad-48e5-be5d-cc8a8e9310ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:22.929941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80307030-ccad-48e5-be5d-cc8a8e9310ae None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:22.929941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80307030-ccad-48e5-be5d-cc8a8e9310ae None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:22.929941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80307030-ccad-48e5-be5d-cc8a8e9310ae None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:22.930401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80307030-ccad-48e5-be5d-cc8a8e9310ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:22.931825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80307030-ccad-48e5-be5d-cc8a8e9310ae None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:22.944147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 508/1031] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 08:59:22 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 08:59:23.128382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebace1f-aba3-457c-a766-5b660d0bbe65 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:23.128668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebace1f-aba3-457c-a766-5b660d0bbe65 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:23.128976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebace1f-aba3-457c-a766-5b660d0bbe65 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:23.130347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 524/1032] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:23.135663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c72d-b576-46f2-9fa8-08572e98a8ac None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:23.135958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c72d-b576-46f2-9fa8-08572e98a8ac None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:23.136282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c72d-b576-46f2-9fa8-08572e98a8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:23.153614 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-2c12c72d-b576-46f2-9fa8-08572e98a8ac None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:23.154712 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2c12c72d-b576-46f2-9fa8-08572e98a8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:23.228119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 509/1033] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:23.251350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebace1f-aba3-457c-a766-5b660d0bbe65 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:23.359497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebace1f-aba3-457c-a766-5b660d0bbe65 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:23.391799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d4959-915b-43cc-986a-c503ea8b61f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:23.392625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d4959-915b-43cc-986a-c503ea8b61f1 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:23.392904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d4959-915b-43cc-986a-c503ea8b61f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:23.393232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d4959-915b-43cc-986a-c503ea8b61f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:23.402952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d4959-915b-43cc-986a-c503ea8b61f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-8c3d4959-915b-43cc-986a-c503ea8b61f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:59:23.411585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:23.412562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:23.413454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:23.413454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:23.413454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:23.413454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:23.413454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:59:23.413454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:59:23.413454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:59:23.413454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:59:23.413454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:59:23.413454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:59:23.413454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:59:23.413454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:23.414868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 525/1034] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 3 08:59:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:23.418727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12c72d-b576-46f2-9fa8-08572e98a8ac None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:23.512241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12c72d-b576-46f2-9fa8-08572e98a8ac None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:23.545161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877711d-4557-4c48-9e59-101f5eb20ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:23.545827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877711d-4557-4c48-9e59-101f5eb20ec9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:23.546108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877711d-4557-4c48-9e59-101f5eb20ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:23.546375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877711d-4557-4c48-9e59-101f5eb20ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:23.547114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877711d-4557-4c48-9e59-101f5eb20ec9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:23.547415 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877711d-4557-4c48-9e59-101f5eb20ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:23.548804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877711d-4557-4c48-9e59-101f5eb20ec9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:23.556890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 510/1035] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 08:59:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:23.562272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d4959-915b-43cc-986a-c503ea8b61f1 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:23.662772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d4959-915b-43cc-986a-c503ea8b61f1 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:23.697200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5607b3-0cde-45a3-b1d0-80d7371037fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:23.697994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5607b3-0cde-45a3-b1d0-80d7371037fa None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:23.698541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5607b3-0cde-45a3-b1d0-80d7371037fa None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:23.698815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5607b3-0cde-45a3-b1d0-80d7371037fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:23.709556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5607b3-0cde-45a3-b1d0-80d7371037fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:23.711013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5607b3-0cde-45a3-b1d0-80d7371037fa None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-6a5607b3-0cde-45a3-b1d0-80d7371037fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:23.728137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:23.729063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:23.736581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:23.736581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:23.736581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:23.736581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:23.736581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 526/1036] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:23.736899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877711d-4557-4c48-9e59-101f5eb20ec9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:23.831187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877711d-4557-4c48-9e59-101f5eb20ec9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:23.865208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d541505-c1cd-4a3e-8f78-640315ad978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:23.865893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d541505-c1cd-4a3e-8f78-640315ad978d None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:23.866171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d541505-c1cd-4a3e-8f78-640315ad978d None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:23.866443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d541505-c1cd-4a3e-8f78-640315ad978d None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:23.867175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d541505-c1cd-4a3e-8f78-640315ad978d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:23.867482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d541505-c1cd-4a3e-8f78-640315ad978d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:23.868954 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d541505-c1cd-4a3e-8f78-640315ad978d None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:23.882540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 511/1037] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:23.888049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5607b3-0cde-45a3-b1d0-80d7371037fa None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:23.983556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5607b3-0cde-45a3-b1d0-80d7371037fa None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:24.016581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c901f9-48da-4534-bae9-3534a46bd283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:24.017372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c901f9-48da-4534-bae9-3534a46bd283 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:24.017649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c901f9-48da-4534-bae9-3534a46bd283 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:24.017917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c901f9-48da-4534-bae9-3534a46bd283 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:24.026137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c901f9-48da-4534-bae9-3534a46bd283 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:24.027576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c901f9-48da-4534-bae9-3534a46bd283 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-c3c901f9-48da-4534-bae9-3534a46bd283 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:59:24.041775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:24.042803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:24.048835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:24.048835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:24.048835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:59:24.048835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:59:24.048835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:59:24.048835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:59:24.048835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:59:24.048835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:59:24.048835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:59:24.048835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:24.049558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a205f-9a35-4f03-8f44-e1a1aded30f3 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:24.049558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a205f-9a35-4f03-8f44-e1a1aded30f3 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:24.049558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a205f-9a35-4f03-8f44-e1a1aded30f3 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:24.049558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 512/1038] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:24.050074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 527/1039] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 08:59:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:24.050167 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a205f-9a35-4f03-8f44-e1a1aded30f3 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:24.051731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d071824-6f62-4c8c-b4aa-a6563e6ebd91 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:24.051731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d071824-6f62-4c8c-b4aa-a6563e6ebd91 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:24.051931 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d071824-6f62-4c8c-b4aa-a6563e6ebd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:24.068437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-4d071824-6f62-4c8c-b4aa-a6563e6ebd91 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:24.069796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4d071824-6f62-4c8c-b4aa-a6563e6ebd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:24.137894 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 528/1040] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:59:24.148560 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a205f-9a35-4f03-8f44-e1a1aded30f3 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:24.161710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d071824-6f62-4c8c-b4aa-a6563e6ebd91 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:24.181195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf69a2-dbd4-470d-a4ec-636fb5481c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:24.181857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf69a2-dbd4-470d-a4ec-636fb5481c8a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:24.182195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf69a2-dbd4-470d-a4ec-636fb5481c8a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:24.182469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf69a2-dbd4-470d-a4ec-636fb5481c8a None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:24.183324 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf69a2-dbd4-470d-a4ec-636fb5481c8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:24.183632 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf69a2-dbd4-470d-a4ec-636fb5481c8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:24.185073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf69a2-dbd4-470d-a4ec-636fb5481c8a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:24.203375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 513/1041] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 08:59:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:24.213055 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf69a2-dbd4-470d-a4ec-636fb5481c8a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:24.261395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d071824-6f62-4c8c-b4aa-a6563e6ebd91 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:24.292937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf4386-bf5d-4b04-b6a0-2b4eac3fad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:24.293733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf4386-bf5d-4b04-b6a0-2b4eac3fad7a None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:24.294012 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf4386-bf5d-4b04-b6a0-2b4eac3fad7a None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:24.294287 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf4386-bf5d-4b04-b6a0-2b4eac3fad7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:24.304398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf4386-bf5d-4b04-b6a0-2b4eac3fad7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:59:24.308352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf69a2-dbd4-470d-a4ec-636fb5481c8a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-e7bf4386-bf5d-4b04-b6a0-2b4eac3fad7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:59:24.311953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:24.313029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:24.313850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:24.313850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:24.313850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:24.313850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:24.313850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:59:24.313850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:59:24.313850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:59:24.313850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:59:24.313850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:59:24.313850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:59:24.313850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:59:24.313850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:24.317016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 529/1042] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:59:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:24.319493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf4386-bf5d-4b04-b6a0-2b4eac3fad7a None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:24.341613 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9820c0d-6dd0-4a96-83d7-a2b5377d97cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:24.342255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9820c0d-6dd0-4a96-83d7-a2b5377d97cf None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:24.342534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9820c0d-6dd0-4a96-83d7-a2b5377d97cf None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:24.342808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9820c0d-6dd0-4a96-83d7-a2b5377d97cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:24.411946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9820c0d-6dd0-4a96-83d7-a2b5377d97cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:24.413424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9820c0d-6dd0-4a96-83d7-a2b5377d97cf None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:24.418339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf4386-bf5d-4b04-b6a0-2b4eac3fad7a None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:24.451524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8f311-3305-47e6-ab4d-512c07344391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:24.452249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8f311-3305-47e6-ab4d-512c07344391 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:24.452497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8f311-3305-47e6-ab4d-512c07344391 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:24.452832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8f311-3305-47e6-ab4d-512c07344391 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:24.453584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8f311-3305-47e6-ab4d-512c07344391 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:24.453940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8f311-3305-47e6-ab4d-512c07344391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:24.455294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8f311-3305-47e6-ab4d-512c07344391 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:24.463382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 530/1043] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:59:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:24.468925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8f311-3305-47e6-ab4d-512c07344391 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:24.515068 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 514/1044] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:59:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:59:24.519982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9820c0d-6dd0-4a96-83d7-a2b5377d97cf None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:24.565550 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8f311-3305-47e6-ab4d-512c07344391 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:24.599186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cb4cc-55b3-4c85-a7c1-eeb139ef8e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:24.600051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cb4cc-55b3-4c85-a7c1-eeb139ef8e9e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:24.600363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cb4cc-55b3-4c85-a7c1-eeb139ef8e9e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:24.600638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cb4cc-55b3-4c85-a7c1-eeb139ef8e9e None admin] PATH_INFO: `/v3/users/a768bfb5e66e4619a42600666b582278` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:24.614249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cb4cc-55b3-4c85-a7c1-eeb139ef8e9e None admin] RBAC: Authorizing `identity:get_user(user_id=a768bfb5e66e4619a42600666b582278)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:24.615737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cb4cc-55b3-4c85-a7c1-eeb139ef8e9e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:24.617678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 531/1045] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:59:24 2022] GET /identity/v3/users/a768bfb5e66e4619a42600666b582278 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:24.623012 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cb4cc-55b3-4c85-a7c1-eeb139ef8e9e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:24.626941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9820c0d-6dd0-4a96-83d7-a2b5377d97cf None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:24.659401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6cde6-fa8c-49eb-be12-4533d8b9589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:24.660821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6cde6-fa8c-49eb-be12-4533d8b9589b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:24.661053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6cde6-fa8c-49eb-be12-4533d8b9589b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:24.661321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6cde6-fa8c-49eb-be12-4533d8b9589b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:24.671237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6cde6-fa8c-49eb-be12-4533d8b9589b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:24.672727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6cde6-fa8c-49eb-be12-4533d8b9589b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-3fd6cde6-fa8c-49eb-be12-4533d8b9589b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:24.692078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:24.693041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:24.693920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:24.693920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:24.693920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:24.693920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:24.697923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 515/1046] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:24.698999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6cde6-fa8c-49eb-be12-4533d8b9589b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:24.719965 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cb4cc-55b3-4c85-a7c1-eeb139ef8e9e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:24.755190 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee78aa-bb1f-4e43-8d48-cee656b9b4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:24.755834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee78aa-bb1f-4e43-8d48-cee656b9b4a6 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:24.756131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee78aa-bb1f-4e43-8d48-cee656b9b4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:24.756407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee78aa-bb1f-4e43-8d48-cee656b9b4a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:24.797428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6cde6-fa8c-49eb-be12-4533d8b9589b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:24.821010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee78aa-bb1f-4e43-8d48-cee656b9b4a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:24.822460 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee78aa-bb1f-4e43-8d48-cee656b9b4a6 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:24.831927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db08e1e-42f9-4b2b-a5e4-3d37a5727282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:24.832807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db08e1e-42f9-4b2b-a5e4-3d37a5727282 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:24.833258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db08e1e-42f9-4b2b-a5e4-3d37a5727282 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:24.833528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db08e1e-42f9-4b2b-a5e4-3d37a5727282 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:24.834236 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db08e1e-42f9-4b2b-a5e4-3d37a5727282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:24.834554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db08e1e-42f9-4b2b-a5e4-3d37a5727282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:24.835890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db08e1e-42f9-4b2b-a5e4-3d37a5727282 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:24.846858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 516/1047] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:24.852727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db08e1e-42f9-4b2b-a5e4-3d37a5727282 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:24.921123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 532/1048] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:59:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 08:59:24.927369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee78aa-bb1f-4e43-8d48-cee656b9b4a6 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:24.949175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db08e1e-42f9-4b2b-a5e4-3d37a5727282 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:24.982979 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24830900-bf94-4f71-a4f3-cae36d847903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:24.983760 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24830900-bf94-4f71-a4f3-cae36d847903 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:24.984036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24830900-bf94-4f71-a4f3-cae36d847903 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:24.984344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24830900-bf94-4f71-a4f3-cae36d847903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:24.990704 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24830900-bf94-4f71-a4f3-cae36d847903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:24.992159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24830900-bf94-4f71-a4f3-cae36d847903 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-24830900-bf94-4f71-a4f3-cae36d847903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:59:25.005807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:25.006749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:25.008025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:59:25.008025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:59:25.008025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:59:25.008025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:59:25.008025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:59:25.008025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:59:25.008025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:25.008025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:25.011699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 517/1049] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:25.012550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24830900-bf94-4f71-a4f3-cae36d847903 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:25.044656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee78aa-bb1f-4e43-8d48-cee656b9b4a6 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:25.080213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007a4f4-3377-46c6-a469-cef12ba42ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:25.081006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007a4f4-3377-46c6-a469-cef12ba42ef9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:25.081286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007a4f4-3377-46c6-a469-cef12ba42ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:25.081559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007a4f4-3377-46c6-a469-cef12ba42ef9 None admin] PATH_INFO: `/v3/projects/e348a05b09f243ba9e3fb047958abc4b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:25.083323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007a4f4-3377-46c6-a469-cef12ba42ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=e348a05b09f243ba9e3fb047958abc4b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:25.084832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007a4f4-3377-46c6-a469-cef12ba42ef9 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:25.092010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 533/1050] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:59:24 2022] GET /identity/v3/projects/e348a05b09f243ba9e3fb047958abc4b => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:25.092797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007a4f4-3377-46c6-a469-cef12ba42ef9 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:25.114317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24830900-bf94-4f71-a4f3-cae36d847903 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:25.147359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783aa71-0a11-4bc7-bd84-765dbdd74be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:25.148015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783aa71-0a11-4bc7-bd84-765dbdd74be0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:25.148325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783aa71-0a11-4bc7-bd84-765dbdd74be0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:25.148598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783aa71-0a11-4bc7-bd84-765dbdd74be0 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:25.149382 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783aa71-0a11-4bc7-bd84-765dbdd74be0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:25.149681 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783aa71-0a11-4bc7-bd84-765dbdd74be0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:25.151096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783aa71-0a11-4bc7-bd84-765dbdd74be0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:25.163699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 518/1051] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:59:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:25.169563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783aa71-0a11-4bc7-bd84-765dbdd74be0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:25.192869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007a4f4-3377-46c6-a469-cef12ba42ef9 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:25.232468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208f4de-649a-47d2-89a7-446f32344a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:25.233077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208f4de-649a-47d2-89a7-446f32344a2c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:25.233457 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208f4de-649a-47d2-89a7-446f32344a2c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:25.233625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208f4de-649a-47d2-89a7-446f32344a2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:25.234445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208f4de-649a-47d2-89a7-446f32344a2c None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=e348a05b09f243ba9e3fb047958abc4b, user.id=a768bfb5e66e4619a42600666b582278) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:25.234820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208f4de-649a-47d2-89a7-446f32344a2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:25.236199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208f4de-649a-47d2-89a7-446f32344a2c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:25.241473 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 534/1052] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:59:25 2022] GET /identity/v3/role_assignments?user.id=a768bfb5e66e4619a42600666b582278&scope.project.id=e348a05b09f243ba9e3fb047958abc4b&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:25.259475 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966e0b8-f2b6-49bc-9f26-fa2820ac514c None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:25.259877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966e0b8-f2b6-49bc-9f26-fa2820ac514c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:25.260118 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966e0b8-f2b6-49bc-9f26-fa2820ac514c None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:25.261660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 535/1053] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:59:25.267389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823be9f-e078-4144-8905-1c8adade5fdd None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:25.267710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823be9f-e078-4144-8905-1c8adade5fdd None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:25.267958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823be9f-e078-4144-8905-1c8adade5fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:25.281868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783aa71-0a11-4bc7-bd84-765dbdd74be0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:25.285945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-8823be9f-e078-4144-8905-1c8adade5fdd None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:25.287171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8823be9f-e078-4144-8905-1c8adade5fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:25.318177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d69a5b-a7a2-4975-a023-d75b1a6bcd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:25.318847 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d69a5b-a7a2-4975-a023-d75b1a6bcd0b None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:25.319178 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d69a5b-a7a2-4975-a023-d75b1a6bcd0b None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:25.319459 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d69a5b-a7a2-4975-a023-d75b1a6bcd0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:25.320336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d69a5b-a7a2-4975-a023-d75b1a6bcd0b None admin] RBAC: Adding query filter params (role.id=2daf97ca638c49178dcb0c571a2b991b, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=2b863628035e4767b08fb5efc5c80958) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:25.320649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d69a5b-a7a2-4975-a023-d75b1a6bcd0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:25.322125 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d69a5b-a7a2-4975-a023-d75b1a6bcd0b None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:25.328640 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 519/1054] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:59:25 2022] GET /identity/v3/role_assignments?user.id=2b863628035e4767b08fb5efc5c80958&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=2daf97ca638c49178dcb0c571a2b991b => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:25.373849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 536/1055] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:59:25.398700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d69a5b-a7a2-4975-a023-d75b1a6bcd0b None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:25.506240 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d69a5b-a7a2-4975-a023-d75b1a6bcd0b None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:25.540428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa9268-6480-4c4c-8ca8-ba62fd3a1814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:25.541216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa9268-6480-4c4c-8ca8-ba62fd3a1814 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:25.541495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa9268-6480-4c4c-8ca8-ba62fd3a1814 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:25.541766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa9268-6480-4c4c-8ca8-ba62fd3a1814 None admin] PATH_INFO: `/v3/services/image` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:25.542417 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa9268-6480-4c4c-8ca8-ba62fd3a1814 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:25.543775 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa9268-6480-4c4c-8ca8-ba62fd3a1814 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-e3aa9268-6480-4c4c-8ca8-ba62fd3a1814 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:25.555231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:25.556514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:25.562398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 520/1056] 10.222.0.23 () {56 vars in 1105 bytes} [Tue May 3 08:59:25 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:25.564779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823be9f-e078-4144-8905-1c8adade5fdd None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:25.659507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823be9f-e078-4144-8905-1c8adade5fdd None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:25.693341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984b365-1644-4b24-b6f1-1d64323506f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:25.694001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b365-1644-4b24-b6f1-1d64323506f6 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:25.694279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b365-1644-4b24-b6f1-1d64323506f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:25.694548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b365-1644-4b24-b6f1-1d64323506f6 None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:25.695248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984b365-1644-4b24-b6f1-1d64323506f6 None admin] RBAC: Adding query filter params (name=image) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:25.695547 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984b365-1644-4b24-b6f1-1d64323506f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:25.696926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984b365-1644-4b24-b6f1-1d64323506f6 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:25.706549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 537/1057] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:25.708363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa9268-6480-4c4c-8ca8-ba62fd3a1814 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:25.803354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa9268-6480-4c4c-8ca8-ba62fd3a1814 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:25.835410 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68172bd-1667-4f98-9aca-5a245a3fa19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:25.836061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68172bd-1667-4f98-9aca-5a245a3fa19c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:25.836370 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68172bd-1667-4f98-9aca-5a245a3fa19c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:25.836643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68172bd-1667-4f98-9aca-5a245a3fa19c None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:25.837344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68172bd-1667-4f98-9aca-5a245a3fa19c None admin] RBAC: Adding query filter params (type=image) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:25.837643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68172bd-1667-4f98-9aca-5a245a3fa19c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:25.839084 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68172bd-1667-4f98-9aca-5a245a3fa19c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:25.843923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 521/1058] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:25.849369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984b365-1644-4b24-b6f1-1d64323506f6 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:25.942352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984b365-1644-4b24-b6f1-1d64323506f6 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:25.974316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4d2db-865a-44f2-a01c-c3b439fdef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:25.974973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4d2db-865a-44f2-a01c-c3b439fdef70 None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:25.975350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4d2db-865a-44f2-a01c-c3b439fdef70 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:25.975630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4d2db-865a-44f2-a01c-c3b439fdef70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:25.976403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4d2db-865a-44f2-a01c-c3b439fdef70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:25.977751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4d2db-865a-44f2-a01c-c3b439fdef70 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:25.997508 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 538/1059] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 08:59:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:27.546385 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ffd7f-08fb-423b-8dce-7c748ce314c0 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:27.546927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ffd7f-08fb-423b-8dce-7c748ce314c0 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:27.546927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ffd7f-08fb-423b-8dce-7c748ce314c0 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:27.548462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 522/1060] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:27.553551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e214-0075-42e9-9c5d-f9f7c601e626 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:27.553938 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e214-0075-42e9-9c5d-f9f7c601e626 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:27.554095 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e214-0075-42e9-9c5d-f9f7c601e626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:27.557679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c895155-1b87-43b8-b1c4-683d8017a4a1 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:27.557962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c895155-1b87-43b8-b1c4-683d8017a4a1 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:27.558233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c895155-1b87-43b8-b1c4-683d8017a4a1 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:27.559494 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 523/1061] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:59:27.564702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adff87-d0c3-45e2-aff9-d98f99d17d0c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:27.564987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adff87-d0c3-45e2-aff9-d98f99d17d0c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:27.565265 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adff87-d0c3-45e2-aff9-d98f99d17d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:27.570514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-0ce3e214-0075-42e9-9c5d-f9f7c601e626 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:27.571794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0ce3e214-0075-42e9-9c5d-f9f7c601e626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:27.581513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-e4adff87-d0c3-45e2-aff9-d98f99d17d0c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:27.583228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e4adff87-d0c3-45e2-aff9-d98f99d17d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:27.645530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 539/1062] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:27.650148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 524/1063] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:59:27.667177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3e214-0075-42e9-9c5d-f9f7c601e626 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:27.671914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adff87-d0c3-45e2-aff9-d98f99d17d0c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:27.762438 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3e214-0075-42e9-9c5d-f9f7c601e626 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:27.767252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adff87-d0c3-45e2-aff9-d98f99d17d0c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:27.795450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba0440-f915-4038-9412-a389f747d93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:27.796265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba0440-f915-4038-9412-a389f747d93f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:27.796600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba0440-f915-4038-9412-a389f747d93f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:27.796872 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba0440-f915-4038-9412-a389f747d93f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:27.799695 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a4bfe-52e1-4419-993f-a78e94029cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:27.800544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a4bfe-52e1-4419-993f-a78e94029cc3 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:27.800822 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a4bfe-52e1-4419-993f-a78e94029cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:27.801087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a4bfe-52e1-4419-993f-a78e94029cc3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:27.806541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba0440-f915-4038-9412-a389f747d93f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:59:27.810711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a4bfe-52e1-4419-993f-a78e94029cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-47ba0440-f915-4038-9412-a389f747d93f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:59:27.814305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:27.815209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:27.821859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 540/1064] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:59:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-a50a4bfe-52e1-4419-993f-a78e94029cc3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:59:27.822634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:27.823761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:27.824635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:27.824635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:27.824635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:27.824635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:27.824635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:59:27.824635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:59:27.824635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:59:27.824635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:59:27.824635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:59:27.824635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:59:27.824635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:59:27.824635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:27.825291 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba0440-f915-4038-9412-a389f747d93f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:27.826925 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 525/1065] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 3 08:59:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:27.827733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a4bfe-52e1-4419-993f-a78e94029cc3 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:27.922685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba0440-f915-4038-9412-a389f747d93f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:27.926516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a4bfe-52e1-4419-993f-a78e94029cc3 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:27.955795 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acb074-1ff6-4df1-aedd-b997411e6361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:27.957417 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acb074-1ff6-4df1-aedd-b997411e6361 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:27.957868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acb074-1ff6-4df1-aedd-b997411e6361 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:27.958343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acb074-1ff6-4df1-aedd-b997411e6361 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:27.959593 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acb074-1ff6-4df1-aedd-b997411e6361 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:27.960131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acb074-1ff6-4df1-aedd-b997411e6361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:27.960490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9706772-7549-48a3-851e-16a39e67c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:27.961236 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9706772-7549-48a3-851e-16a39e67c769 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:27.961521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9706772-7549-48a3-851e-16a39e67c769 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:27.961793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9706772-7549-48a3-851e-16a39e67c769 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:27.961900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acb074-1ff6-4df1-aedd-b997411e6361 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:27.962531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9706772-7549-48a3-851e-16a39e67c769 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:27.962833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9706772-7549-48a3-851e-16a39e67c769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:27.964195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9706772-7549-48a3-851e-16a39e67c769 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:27.969912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 541/1066] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:27.976732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 526/1067] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 08:59:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:27.976895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acb074-1ff6-4df1-aedd-b997411e6361 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:27.978099 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9706772-7549-48a3-851e-16a39e67c769 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:28.075218 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acb074-1ff6-4df1-aedd-b997411e6361 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:28.075406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9706772-7549-48a3-851e-16a39e67c769 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:28.109382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc91d0-63a6-438b-a232-770d7113c837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:28.109611 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd332a-ba40-4ac7-a775-422a76193341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:28.110273 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc91d0-63a6-438b-a232-770d7113c837 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:28.110399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd332a-ba40-4ac7-a775-422a76193341 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:28.110570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc91d0-63a6-438b-a232-770d7113c837 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:28.110679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd332a-ba40-4ac7-a775-422a76193341 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:28.110829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc91d0-63a6-438b-a232-770d7113c837 None admin] PATH_INFO: `/v3/users/a768bfb5e66e4619a42600666b582278` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:28.110922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd332a-ba40-4ac7-a775-422a76193341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:28.112051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc91d0-63a6-438b-a232-770d7113c837 None admin] RBAC: Authorizing `identity:get_user(user_id=a768bfb5e66e4619a42600666b582278)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:28.114062 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc91d0-63a6-438b-a232-770d7113c837 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:28.115892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 542/1068] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:59:27 2022] GET /identity/v3/users/a768bfb5e66e4619a42600666b582278 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:28.121671 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc91d0-63a6-438b-a232-770d7113c837 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:28.123105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd332a-ba40-4ac7-a775-422a76193341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:28.124594 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd332a-ba40-4ac7-a775-422a76193341 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-8cfd332a-ba40-4ac7-a775-422a76193341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:28.142005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:28.142949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:28.143857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:28.143857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:28.143857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:28.143857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:28.143857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 527/1069] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:28.149408 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd332a-ba40-4ac7-a775-422a76193341 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:28.229950 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc91d0-63a6-438b-a232-770d7113c837 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:28.249757 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd332a-ba40-4ac7-a775-422a76193341 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:28.264596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee6d33-0a4f-4357-9b72-ec229e59690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:28.265457 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee6d33-0a4f-4357-9b72-ec229e59690b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:28.265739 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee6d33-0a4f-4357-9b72-ec229e59690b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:28.266035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee6d33-0a4f-4357-9b72-ec229e59690b None admin] PATH_INFO: `/v3/projects/e348a05b09f243ba9e3fb047958abc4b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:28.267182 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee6d33-0a4f-4357-9b72-ec229e59690b None admin] RBAC: Authorizing `identity:get_project(project_id=e348a05b09f243ba9e3fb047958abc4b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:28.268646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee6d33-0a4f-4357-9b72-ec229e59690b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:28.275567 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 543/1070] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:59:28 2022] GET /identity/v3/projects/e348a05b09f243ba9e3fb047958abc4b => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:28.277017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae90fe-40af-45cf-9dc4-43a07a14ebf3 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:28.277303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae90fe-40af-45cf-9dc4-43a07a14ebf3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:28.277582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae90fe-40af-45cf-9dc4-43a07a14ebf3 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:28.278830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 544/1071] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:59:28.279493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae90fe-40af-45cf-9dc4-43a07a14ebf3 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:28.283323 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ce523-09df-4f15-9b2c-9bdb84c31951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:28.283981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ce523-09df-4f15-9b2c-9bdb84c31951 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:28.284288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ce523-09df-4f15-9b2c-9bdb84c31951 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:28.284560 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ce523-09df-4f15-9b2c-9bdb84c31951 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:28.285361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ce523-09df-4f15-9b2c-9bdb84c31951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:28.285665 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ce523-09df-4f15-9b2c-9bdb84c31951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:28.287013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ce523-09df-4f15-9b2c-9bdb84c31951 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:28.298291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 528/1072] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:28.299518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae9ac-17dc-416d-a448-c80bed880e2f None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:28.299804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae9ac-17dc-416d-a448-c80bed880e2f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:28.300071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae9ac-17dc-416d-a448-c80bed880e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:28.316849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-668ae9ac-17dc-416d-a448-c80bed880e2f None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:28.318027 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-668ae9ac-17dc-416d-a448-c80bed880e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:28.375124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae90fe-40af-45cf-9dc4-43a07a14ebf3 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:28.379918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 529/1073] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:28.380750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae9ac-17dc-416d-a448-c80bed880e2f None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:28.407720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836ee6e-2248-43ca-a7c0-612899561bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:28.408635 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836ee6e-2248-43ca-a7c0-612899561bb2 None admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:28.408913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836ee6e-2248-43ca-a7c0-612899561bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:28.409186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836ee6e-2248-43ca-a7c0-612899561bb2 None admin] PATH_INFO: `/v3/projects/e348a05b09f243ba9e3fb047958abc4b/users/a768bfb5e66e4619a42600666b582278/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:28.411717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836ee6e-2248-43ca-a7c0-612899561bb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e348a05b09f243ba9e3fb047958abc4b, user_id=a768bfb5e66e4619a42600666b582278, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:28.413193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836ee6e-2248-43ca-a7c0-612899561bb2 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:28.431596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 545/1074] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:59:28 2022] PUT /identity/v3/projects/e348a05b09f243ba9e3fb047958abc4b/users/a768bfb5e66e4619a42600666b582278/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:59:28.432738 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836ee6e-2248-43ca-a7c0-612899561bb2 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:28.485023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae9ac-17dc-416d-a448-c80bed880e2f None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:28.522823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb32000-350b-41d5-a3a8-b5a071e25356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:28.523623 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb32000-350b-41d5-a3a8-b5a071e25356 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:28.523901 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb32000-350b-41d5-a3a8-b5a071e25356 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:28.524199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb32000-350b-41d5-a3a8-b5a071e25356 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:28.531899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb32000-350b-41d5-a3a8-b5a071e25356 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:28.533416 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb32000-350b-41d5-a3a8-b5a071e25356 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:28.541829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836ee6e-2248-43ca-a7c0-612899561bb2 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-5cb32000-350b-41d5-a3a8-b5a071e25356 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:59:28.548984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:28.550338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:28.551933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:28.551933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:28.551933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:59:28.551933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:59:28.551933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:59:28.551933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:59:28.551933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:59:28.551933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:59:28.551933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:59:28.551933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:28.551933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 530/1075] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 08:59:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:28.556685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb32000-350b-41d5-a3a8-b5a071e25356 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:28.581000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21120eb-deeb-40e5-aa27-2b6ac38f244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:28.581682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21120eb-deeb-40e5-aa27-2b6ac38f244b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:28.581970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21120eb-deeb-40e5-aa27-2b6ac38f244b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:28.582241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21120eb-deeb-40e5-aa27-2b6ac38f244b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:28.651126 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21120eb-deeb-40e5-aa27-2b6ac38f244b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:28.652518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21120eb-deeb-40e5-aa27-2b6ac38f244b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:28.660505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb32000-350b-41d5-a3a8-b5a071e25356 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:28.693685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09012eb2-f123-46a7-9cc3-6b4fed40ab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:28.694350 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09012eb2-f123-46a7-9cc3-6b4fed40ab80 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:28.694627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09012eb2-f123-46a7-9cc3-6b4fed40ab80 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:28.694895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09012eb2-f123-46a7-9cc3-6b4fed40ab80 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:28.695719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09012eb2-f123-46a7-9cc3-6b4fed40ab80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:28.696021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09012eb2-f123-46a7-9cc3-6b4fed40ab80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:28.697461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09012eb2-f123-46a7-9cc3-6b4fed40ab80 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:28.715467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 531/1076] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 08:59:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:28.720936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09012eb2-f123-46a7-9cc3-6b4fed40ab80 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:28.758041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 546/1077] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:59:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:59:28.759714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21120eb-deeb-40e5-aa27-2b6ac38f244b None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:28.826749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09012eb2-f123-46a7-9cc3-6b4fed40ab80 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:28.853954 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21120eb-deeb-40e5-aa27-2b6ac38f244b None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:28.859950 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4e70d-a2a7-46c4-a748-c766b58d0f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:28.860770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4e70d-a2a7-46c4-a748-c766b58d0f22 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:28.861051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4e70d-a2a7-46c4-a748-c766b58d0f22 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:28.861324 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4e70d-a2a7-46c4-a748-c766b58d0f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:28.871082 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4e70d-a2a7-46c4-a748-c766b58d0f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:28.872558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4e70d-a2a7-46c4-a748-c766b58d0f22 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:28.888509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb42d72-cba7-4156-8088-027075a11b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:28.889296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb42d72-cba7-4156-8088-027075a11b47 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:28.889574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb42d72-cba7-4156-8088-027075a11b47 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:28.889844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb42d72-cba7-4156-8088-027075a11b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-08f4e70d-a2a7-46c4-a748-c766b58d0f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:28.890840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:28.891666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:28.893010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:28.893010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:28.893010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:28.893010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:28.893010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 532/1078] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:28.898353 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4e70d-a2a7-46c4-a748-c766b58d0f22 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:28.903911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb42d72-cba7-4156-8088-027075a11b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:28.905332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb42d72-cba7-4156-8088-027075a11b47 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-9fb42d72-cba7-4156-8088-027075a11b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:28.922771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:28.923678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:28.924601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:28.924601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:28.924601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:28.924601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:28.928238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 547/1079] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:28.929729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb42d72-cba7-4156-8088-027075a11b47 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:29.005230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4e70d-a2a7-46c4-a748-c766b58d0f22 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:29.028064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb42d72-cba7-4156-8088-027075a11b47 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:29.040597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e75cb-d2a7-4730-adf8-3976ae62ee2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:29.041250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e75cb-d2a7-4730-adf8-3976ae62ee2d None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:29.041528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e75cb-d2a7-4730-adf8-3976ae62ee2d None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:29.041798 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e75cb-d2a7-4730-adf8-3976ae62ee2d None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:29.042517 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e75cb-d2a7-4730-adf8-3976ae62ee2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:29.042820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e75cb-d2a7-4730-adf8-3976ae62ee2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:29.044201 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e75cb-d2a7-4730-adf8-3976ae62ee2d None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:29.060428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 533/1080] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:29.061157 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368a9e-e24f-44e8-a4bb-b4d67d50c802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:29.061299 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e75cb-d2a7-4730-adf8-3976ae62ee2d None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:29.061816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368a9e-e24f-44e8-a4bb-b4d67d50c802 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:29.062089 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368a9e-e24f-44e8-a4bb-b4d67d50c802 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:29.062353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368a9e-e24f-44e8-a4bb-b4d67d50c802 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:29.063069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368a9e-e24f-44e8-a4bb-b4d67d50c802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:29.063367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368a9e-e24f-44e8-a4bb-b4d67d50c802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:29.064767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368a9e-e24f-44e8-a4bb-b4d67d50c802 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:29.092338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 548/1081] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:29.165469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e75cb-d2a7-4730-adf8-3976ae62ee2d None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:29.200168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51778d12-4d95-4d5d-87c3-bd1d01c3d806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:29.200971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51778d12-4d95-4d5d-87c3-bd1d01c3d806 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:29.201252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51778d12-4d95-4d5d-87c3-bd1d01c3d806 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:29.201525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51778d12-4d95-4d5d-87c3-bd1d01c3d806 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:29.210074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51778d12-4d95-4d5d-87c3-bd1d01c3d806 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:29.212709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51778d12-4d95-4d5d-87c3-bd1d01c3d806 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-51778d12-4d95-4d5d-87c3-bd1d01c3d806 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:59:29.227556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:29.228654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:29.229564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:59:29.229564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:59:29.229564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:59:29.229564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:59:29.229564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:59:29.229564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:59:29.229564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:29.229564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:29.232457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 534/1082] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:29.234965 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368a9e-e24f-44e8-a4bb-b4d67d50c802 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:29.342592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368a9e-e24f-44e8-a4bb-b4d67d50c802 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:29.381107 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a4cc9-2eea-4ebe-a9df-5ce5bc590974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:29.381770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4cc9-2eea-4ebe-a9df-5ce5bc590974 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:29.382103 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4cc9-2eea-4ebe-a9df-5ce5bc590974 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:29.383384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4cc9-2eea-4ebe-a9df-5ce5bc590974 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:29.383384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a4cc9-2eea-4ebe-a9df-5ce5bc590974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:29.383584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a4cc9-2eea-4ebe-a9df-5ce5bc590974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:29.384879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a4cc9-2eea-4ebe-a9df-5ce5bc590974 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:29.397193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 549/1083] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:29.403547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51778d12-4d95-4d5d-87c3-bd1d01c3d806 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:29.504631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51778d12-4d95-4d5d-87c3-bd1d01c3d806 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:29.537913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542777e-4319-4d06-8d00-fe4226945089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:29.538799 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542777e-4319-4d06-8d00-fe4226945089 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:29.539077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542777e-4319-4d06-8d00-fe4226945089 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:29.539344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542777e-4319-4d06-8d00-fe4226945089 None admin] PATH_INFO: `/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/2b863628035e4767b08fb5efc5c80958/roles/2daf97ca638c49178dcb0c571a2b991b` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:29.541567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542777e-4319-4d06-8d00-fe4226945089 None admin] RBAC: Authorizing `identity:create_grant(project_id=250761bd5a9e48e0b26fedcf65d88a5d, user_id=2b863628035e4767b08fb5efc5c80958, role_id=2daf97ca638c49178dcb0c571a2b991b)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:29.542988 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542777e-4319-4d06-8d00-fe4226945089 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:29.556767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 535/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:59:29 2022] PUT /identity/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/2b863628035e4767b08fb5efc5c80958/roles/2daf97ca638c49178dcb0c571a2b991b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:59:30.697708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be1d95-c775-4cbb-9b66-eafb0f81556e None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:30.698492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be1d95-c775-4cbb-9b66-eafb0f81556e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:30.698492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be1d95-c775-4cbb-9b66-eafb0f81556e None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:30.699872 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 550/1085] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:30.705178 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34991cca-484d-43a3-9366-4131e0d45b0d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:30.705578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34991cca-484d-43a3-9366-4131e0d45b0d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:30.705845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34991cca-484d-43a3-9366-4131e0d45b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:30.721886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-34991cca-484d-43a3-9366-4131e0d45b0d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:30.723577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-34991cca-484d-43a3-9366-4131e0d45b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:30.784195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 536/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:30.807854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be1d95-c775-4cbb-9b66-eafb0f81556e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:30.902395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be1d95-c775-4cbb-9b66-eafb0f81556e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:30.934717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39182a69-4362-4aa4-99ae-47e2369940cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:30.935499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39182a69-4362-4aa4-99ae-47e2369940cd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:30.935780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39182a69-4362-4aa4-99ae-47e2369940cd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:30.936052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39182a69-4362-4aa4-99ae-47e2369940cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:30.945659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39182a69-4362-4aa4-99ae-47e2369940cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-39182a69-4362-4aa4-99ae-47e2369940cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:59:30.953570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:30.954562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:30.955391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 551/1087] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:59:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:30.961317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34991cca-484d-43a3-9366-4131e0d45b0d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:31.053804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34991cca-484d-43a3-9366-4131e0d45b0d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:31.086137 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ed645-7cdc-490f-928f-43d0866be05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:31.086792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ed645-7cdc-490f-928f-43d0866be05a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:31.087074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ed645-7cdc-490f-928f-43d0866be05a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:31.087348 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ed645-7cdc-490f-928f-43d0866be05a None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:31.088110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ed645-7cdc-490f-928f-43d0866be05a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:31.088415 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ed645-7cdc-490f-928f-43d0866be05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:31.089773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ed645-7cdc-490f-928f-43d0866be05a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:31.098235 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 537/1088] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:59:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:31.103789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39182a69-4362-4aa4-99ae-47e2369940cd None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:31.196248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39182a69-4362-4aa4-99ae-47e2369940cd None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:31.231098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dc180-5096-4522-a5f5-c050961a035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:31.231967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc180-5096-4522-a5f5-c050961a035c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:31.232277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc180-5096-4522-a5f5-c050961a035c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:31.232552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc180-5096-4522-a5f5-c050961a035c None admin] PATH_INFO: `/v3/users/a768bfb5e66e4619a42600666b582278` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:31.233731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc180-5096-4522-a5f5-c050961a035c None admin] RBAC: Authorizing `identity:get_user(user_id=a768bfb5e66e4619a42600666b582278)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:31.235147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc180-5096-4522-a5f5-c050961a035c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:31.236960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 552/1089] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:59:31 2022] GET /identity/v3/users/a768bfb5e66e4619a42600666b582278 => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:31.242495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ed645-7cdc-490f-928f-43d0866be05a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:31.343563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ed645-7cdc-490f-928f-43d0866be05a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:31.389995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2d331-5f7f-4186-bc12-436638e4c840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:31.390636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2d331-5f7f-4186-bc12-436638e4c840 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:31.390916 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2d331-5f7f-4186-bc12-436638e4c840 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:31.391189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2d331-5f7f-4186-bc12-436638e4c840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:31.454685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2d331-5f7f-4186-bc12-436638e4c840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:31.456152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2d331-5f7f-4186-bc12-436638e4c840 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:31.547905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 538/1090] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:59:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:59:31.553600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dc180-5096-4522-a5f5-c050961a035c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:31.650946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dc180-5096-4522-a5f5-c050961a035c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:31.682400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5855fdc-9ba9-4dc6-a482-45c8f9346475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:31.683270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5855fdc-9ba9-4dc6-a482-45c8f9346475 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:31.683554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5855fdc-9ba9-4dc6-a482-45c8f9346475 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:31.683829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5855fdc-9ba9-4dc6-a482-45c8f9346475 None admin] PATH_INFO: `/v3/projects/e348a05b09f243ba9e3fb047958abc4b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:31.685031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5855fdc-9ba9-4dc6-a482-45c8f9346475 None admin] RBAC: Authorizing `identity:get_project(project_id=e348a05b09f243ba9e3fb047958abc4b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:31.686459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5855fdc-9ba9-4dc6-a482-45c8f9346475 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:31.688215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 553/1091] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:59:31 2022] GET /identity/v3/projects/e348a05b09f243ba9e3fb047958abc4b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:31.694841 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2d331-5f7f-4186-bc12-436638e4c840 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:31.788457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2d331-5f7f-4186-bc12-436638e4c840 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:31.789100 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58812b5a-fc32-4dec-bcdc-ecad397460c4 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:31.789100 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58812b5a-fc32-4dec-bcdc-ecad397460c4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:31.789523 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58812b5a-fc32-4dec-bcdc-ecad397460c4 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:31.790683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 554/1092] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 08:59:31.795391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a70d-e3a6-4790-b531-5af73bbd9efa None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:31.795674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a70d-e3a6-4790-b531-5af73bbd9efa None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:31.795944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a70d-e3a6-4790-b531-5af73bbd9efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:31.812466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-3985a70d-e3a6-4790-b531-5af73bbd9efa None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:31.813570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3985a70d-e3a6-4790-b531-5af73bbd9efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:31.821676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5a88b-8144-4f30-99fb-96b57611ac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:31.822319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5a88b-8144-4f30-99fb-96b57611ac94 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:31.822599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5a88b-8144-4f30-99fb-96b57611ac94 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:31.823118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5a88b-8144-4f30-99fb-96b57611ac94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:31.824290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5a88b-8144-4f30-99fb-96b57611ac94 None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=e348a05b09f243ba9e3fb047958abc4b, user.id=a768bfb5e66e4619a42600666b582278) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:31.824604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5a88b-8144-4f30-99fb-96b57611ac94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:31.826030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5a88b-8144-4f30-99fb-96b57611ac94 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:31.831615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 539/1093] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:59:31 2022] GET /identity/v3/role_assignments?user.id=a768bfb5e66e4619a42600666b582278&scope.project.id=e348a05b09f243ba9e3fb047958abc4b&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:31.881813 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 555/1094] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 08:59:31.905341 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5a88b-8144-4f30-99fb-96b57611ac94 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:32.005133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5a88b-8144-4f30-99fb-96b57611ac94 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:32.037333 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd137b0-5591-4f03-a7b6-59005c9f0fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:32.038135 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd137b0-5591-4f03-a7b6-59005c9f0fb6 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:32.038412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd137b0-5591-4f03-a7b6-59005c9f0fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:32.038684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd137b0-5591-4f03-a7b6-59005c9f0fb6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:32.048480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd137b0-5591-4f03-a7b6-59005c9f0fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-1bd137b0-5591-4f03-a7b6-59005c9f0fb6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:59:32.057036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:32.057976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:32.058941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 540/1095] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 3 08:59:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:32.064412 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985a70d-e3a6-4790-b531-5af73bbd9efa None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:32.154763 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985a70d-e3a6-4790-b531-5af73bbd9efa None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:32.186961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c9d8b-4d36-4b4c-8442-654296f1d1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:32.188953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c9d8b-4d36-4b4c-8442-654296f1d1dd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:32.188953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c9d8b-4d36-4b4c-8442-654296f1d1dd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:32.188953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c9d8b-4d36-4b4c-8442-654296f1d1dd None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:32.190863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c9d8b-4d36-4b4c-8442-654296f1d1dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:32.190863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c9d8b-4d36-4b4c-8442-654296f1d1dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:32.193047 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c9d8b-4d36-4b4c-8442-654296f1d1dd None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:32.203520 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 556/1096] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 08:59:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:32.209174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd137b0-5591-4f03-a7b6-59005c9f0fb6 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:32.302523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd137b0-5591-4f03-a7b6-59005c9f0fb6 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:32.333090 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927453c-54f8-49b0-9331-a73fc447afae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:32.333808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927453c-54f8-49b0-9331-a73fc447afae None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:32.334083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927453c-54f8-49b0-9331-a73fc447afae None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:32.334355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927453c-54f8-49b0-9331-a73fc447afae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:32.344222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927453c-54f8-49b0-9331-a73fc447afae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:32.345649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927453c-54f8-49b0-9331-a73fc447afae None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-4927453c-54f8-49b0-9331-a73fc447afae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:32.362133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:32.363620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:32.364686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:32.364686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:32.364686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:32.364686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:32.364686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 541/1097] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:32.369485 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c9d8b-4d36-4b4c-8442-654296f1d1dd None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:32.463154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c9d8b-4d36-4b4c-8442-654296f1d1dd None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:32.493836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe97c73-f952-4b49-90a7-25316eba09e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:32.494480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe97c73-f952-4b49-90a7-25316eba09e4 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:32.494755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe97c73-f952-4b49-90a7-25316eba09e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:32.495023 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe97c73-f952-4b49-90a7-25316eba09e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:32.495724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe97c73-f952-4b49-90a7-25316eba09e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:32.496022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe97c73-f952-4b49-90a7-25316eba09e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:32.497383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe97c73-f952-4b49-90a7-25316eba09e4 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:32.508266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 557/1098] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:32.513808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927453c-54f8-49b0-9331-a73fc447afae None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:32.608433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927453c-54f8-49b0-9331-a73fc447afae None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:32.639128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54f74d-b057-499b-84b3-8d12d3c356df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:32.639898 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f74d-b057-499b-84b3-8d12d3c356df None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:32.640214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f74d-b057-499b-84b3-8d12d3c356df None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:32.640486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f74d-b057-499b-84b3-8d12d3c356df None admin] PATH_INFO: `/v3/users/nova` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:32.648141 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54f74d-b057-499b-84b3-8d12d3c356df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:32.649553 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54f74d-b057-499b-84b3-8d12d3c356df None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-1b54f74d-b057-499b-84b3-8d12d3c356df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 08:59:32.663579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:32.664548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:32.665584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:32.665584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:32.665584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 08:59:32.665584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 08:59:32.665584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 08:59:32.665584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 08:59:32.665584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 08:59:32.665584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 08:59:32.665584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 08:59:32.665584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:32.665584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 542/1099] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 08:59:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 08:59:32.670453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe97c73-f952-4b49-90a7-25316eba09e4 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:32.772461 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe97c73-f952-4b49-90a7-25316eba09e4 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:32.804266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84269ee1-c15a-4509-a476-54f215a97ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:32.805024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84269ee1-c15a-4509-a476-54f215a97ecd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:32.805307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84269ee1-c15a-4509-a476-54f215a97ecd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:32.805577 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84269ee1-c15a-4509-a476-54f215a97ecd None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:32.806404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84269ee1-c15a-4509-a476-54f215a97ecd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:32.806721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84269ee1-c15a-4509-a476-54f215a97ecd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:32.808152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84269ee1-c15a-4509-a476-54f215a97ecd None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:32.824538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 558/1100] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 08:59:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:32.830204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54f74d-b057-499b-84b3-8d12d3c356df None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:32.924134 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54f74d-b057-499b-84b3-8d12d3c356df None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:32.957443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5973e4c-d974-4e50-adca-22ecabeab6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:32.958076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5973e4c-d974-4e50-adca-22ecabeab6b3 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:32.958358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5973e4c-d974-4e50-adca-22ecabeab6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:32.958629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5973e4c-d974-4e50-adca-22ecabeab6b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:33.023620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5973e4c-d974-4e50-adca-22ecabeab6b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:33.025100 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5973e4c-d974-4e50-adca-22ecabeab6b3 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:33.126871 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 543/1101] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:59:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:59:33.133124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84269ee1-c15a-4509-a476-54f215a97ecd None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:33.231238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84269ee1-c15a-4509-a476-54f215a97ecd None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:33.264076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872475b9-7170-4f17-b05f-ed6187e3ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:33.264883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872475b9-7170-4f17-b05f-ed6187e3ac3b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:33.265163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872475b9-7170-4f17-b05f-ed6187e3ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:33.265440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872475b9-7170-4f17-b05f-ed6187e3ac3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:33.274835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872475b9-7170-4f17-b05f-ed6187e3ac3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:33.276295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872475b9-7170-4f17-b05f-ed6187e3ac3b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-872475b9-7170-4f17-b05f-ed6187e3ac3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 08:59:33.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:33.293676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:33.295106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 08:59:33.295106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 08:59:33.295106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 08:59:33.295106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:33.295106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 559/1102] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:33.299600 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5973e4c-d974-4e50-adca-22ecabeab6b3 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:33.394225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5973e4c-d974-4e50-adca-22ecabeab6b3 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:33.426578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a88f30-7e95-49aa-b080-140b0935b169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:33.427231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a88f30-7e95-49aa-b080-140b0935b169 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:33.427514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a88f30-7e95-49aa-b080-140b0935b169 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:33.427786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a88f30-7e95-49aa-b080-140b0935b169 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:33.428541 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a88f30-7e95-49aa-b080-140b0935b169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:33.428849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a88f30-7e95-49aa-b080-140b0935b169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:33.430212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a88f30-7e95-49aa-b080-140b0935b169 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:33.441683 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 544/1103] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 08:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:33.447036 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872475b9-7170-4f17-b05f-ed6187e3ac3b None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:33.540129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872475b9-7170-4f17-b05f-ed6187e3ac3b None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:33.573052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f34508-8ff1-4c98-a094-20fab6cbc201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:33.573842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f34508-8ff1-4c98-a094-20fab6cbc201 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:33.574121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f34508-8ff1-4c98-a094-20fab6cbc201 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:33.574394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f34508-8ff1-4c98-a094-20fab6cbc201 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:33.580729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f34508-8ff1-4c98-a094-20fab6cbc201 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:33.582167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f34508-8ff1-4c98-a094-20fab6cbc201 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-93f34508-8ff1-4c98-a094-20fab6cbc201 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 08:59:33.595325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:33.596437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:33.597863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 08:59:33.597863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 08:59:33.597863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 08:59:33.597863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 08:59:33.597863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 08:59:33.597863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 08:59:33.597863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 08:59:33.597863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:33.597863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 560/1104] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 08:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:33.602852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a88f30-7e95-49aa-b080-140b0935b169 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:33.696263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a88f30-7e95-49aa-b080-140b0935b169 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:33.728254 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3af00-c63e-4173-886d-273d50daebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:33.728899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3af00-c63e-4173-886d-273d50daebff None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:33.729181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3af00-c63e-4173-886d-273d50daebff None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:33.729456 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3af00-c63e-4173-886d-273d50daebff None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:33.730230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3af00-c63e-4173-886d-273d50daebff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:33.730540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3af00-c63e-4173-886d-273d50daebff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:33.731958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3af00-c63e-4173-886d-273d50daebff None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:33.744688 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 545/1105] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 08:59:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:33.750829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f34508-8ff1-4c98-a094-20fab6cbc201 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:33.843128 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f34508-8ff1-4c98-a094-20fab6cbc201 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:33.874873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93e862-0827-4732-9d24-4f25a5a2f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:33.875511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93e862-0827-4732-9d24-4f25a5a2f307 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:33.875791 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93e862-0827-4732-9d24-4f25a5a2f307 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:33.876064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93e862-0827-4732-9d24-4f25a5a2f307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:33.876914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93e862-0827-4732-9d24-4f25a5a2f307 None admin] RBAC: Adding query filter params (role.id=2daf97ca638c49178dcb0c571a2b991b, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=2b863628035e4767b08fb5efc5c80958) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:33.877221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93e862-0827-4732-9d24-4f25a5a2f307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:33.878633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93e862-0827-4732-9d24-4f25a5a2f307 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:33.884204 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 561/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:59:33 2022] GET /identity/v3/role_assignments?user.id=2b863628035e4767b08fb5efc5c80958&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=2daf97ca638c49178dcb0c571a2b991b => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:34.117420 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f36772-f80b-4094-9b27-b0f8996f41ac None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:34.117910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f36772-f80b-4094-9b27-b0f8996f41ac None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:34.117910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f36772-f80b-4094-9b27-b0f8996f41ac None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:34.119236 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 546/1107] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:34.124551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b477-d7b4-46a2-92e4-0e8666fd4c85 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:34.124844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b477-d7b4-46a2-92e4-0e8666fd4c85 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:34.125123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b477-d7b4-46a2-92e4-0e8666fd4c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:34.142441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-4f64b477-d7b4-46a2-92e4-0e8666fd4c85 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:34.143608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4f64b477-d7b4-46a2-92e4-0e8666fd4c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:34.208185 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 562/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:34.233580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f36772-f80b-4094-9b27-b0f8996f41ac None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:34.332988 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f36772-f80b-4094-9b27-b0f8996f41ac None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:34.366604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0767b-e12a-4719-81d5-1d38bf63c38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:34.367391 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0767b-e12a-4719-81d5-1d38bf63c38e None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:34.367720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0767b-e12a-4719-81d5-1d38bf63c38e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:34.367948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0767b-e12a-4719-81d5-1d38bf63c38e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:34.369158 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0767b-e12a-4719-81d5-1d38bf63c38e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:34.370586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0767b-e12a-4719-81d5-1d38bf63c38e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:34.372202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 547/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:34.378089 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64b477-d7b4-46a2-92e4-0e8666fd4c85 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:34.474541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64b477-d7b4-46a2-92e4-0e8666fd4c85 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:34.506471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58bec1-1d9f-40a9-9e23-0d67b5702cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:34.507125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58bec1-1d9f-40a9-9e23-0d67b5702cdb None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:34.507400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58bec1-1d9f-40a9-9e23-0d67b5702cdb None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:34.507666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58bec1-1d9f-40a9-9e23-0d67b5702cdb None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:34.508411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58bec1-1d9f-40a9-9e23-0d67b5702cdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:34.509814 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58bec1-1d9f-40a9-9e23-0d67b5702cdb None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:34.528476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 563/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:59:34 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:36.788260 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b482b-e39d-4d02-a813-5fd35f996778 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:36.788790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b482b-e39d-4d02-a813-5fd35f996778 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:36.788790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b482b-e39d-4d02-a813-5fd35f996778 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:36.790156 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 548/1111] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:36.795285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f0db6-f546-4e48-b594-23c70a693e9c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:36.795708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f0db6-f546-4e48-b594-23c70a693e9c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:36.795836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f0db6-f546-4e48-b594-23c70a693e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:36.812373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ea3f0db6-f546-4e48-b594-23c70a693e9c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:36.813519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ea3f0db6-f546-4e48-b594-23c70a693e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:36.873768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 564/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:36.896502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b482b-e39d-4d02-a813-5fd35f996778 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:36.991461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b482b-e39d-4d02-a813-5fd35f996778 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:37.022584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c7991-b5e0-4396-972b-933dfedf50a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:37.023452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c7991-b5e0-4396-972b-933dfedf50a2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:37.023735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c7991-b5e0-4396-972b-933dfedf50a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:37.024004 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c7991-b5e0-4396-972b-933dfedf50a2 None admin] PATH_INFO: `/v3/roles/f12928ff609a47a9bef9cb8abc28932b` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:37.025483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c7991-b5e0-4396-972b-933dfedf50a2 None admin] RBAC: Authorizing `identity:get_role(role_id=f12928ff609a47a9bef9cb8abc28932b)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:37.026838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c7991-b5e0-4396-972b-933dfedf50a2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:37.028187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 549/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:59:36 2022] GET /identity/v3/roles/f12928ff609a47a9bef9cb8abc28932b => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 08:59:37.033713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f0db6-f546-4e48-b594-23c70a693e9c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:37.123823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f0db6-f546-4e48-b594-23c70a693e9c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:37.154418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79655023-64c8-4a6c-96b8-ee2538d07ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:37.155255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79655023-64c8-4a6c-96b8-ee2538d07ba0 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:37.155532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79655023-64c8-4a6c-96b8-ee2538d07ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:37.155802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79655023-64c8-4a6c-96b8-ee2538d07ba0 None admin] PATH_INFO: `/v3/users/e0f482db9f71465596a28e7434dc0a94` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:37.168966 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79655023-64c8-4a6c-96b8-ee2538d07ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f482db9f71465596a28e7434dc0a94)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:37.170362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79655023-64c8-4a6c-96b8-ee2538d07ba0 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:37.171939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 565/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:59:37 2022] GET /identity/v3/users/e0f482db9f71465596a28e7434dc0a94 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:37.177419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c7991-b5e0-4396-972b-933dfedf50a2 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:37.270005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c7991-b5e0-4396-972b-933dfedf50a2 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:37.301414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f5ba5-27d4-42aa-a8c7-80fdf61dcd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:37.302036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5ba5-27d4-42aa-a8c7-80fdf61dcd80 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:37.302312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5ba5-27d4-42aa-a8c7-80fdf61dcd80 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:37.302581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5ba5-27d4-42aa-a8c7-80fdf61dcd80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:37.364407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f5ba5-27d4-42aa-a8c7-80fdf61dcd80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:37.365829 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f5ba5-27d4-42aa-a8c7-80fdf61dcd80 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:37.457363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 550/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:59:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:59:37.463141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79655023-64c8-4a6c-96b8-ee2538d07ba0 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:37.555044 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79655023-64c8-4a6c-96b8-ee2538d07ba0 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:37.586970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a998e88-f947-4a05-b61c-33240cfc45bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:37.587803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a998e88-f947-4a05-b61c-33240cfc45bf None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:37.588081 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a998e88-f947-4a05-b61c-33240cfc45bf None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:37.588381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a998e88-f947-4a05-b61c-33240cfc45bf None admin] PATH_INFO: `/v3/projects/e348a05b09f243ba9e3fb047958abc4b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:37.589528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a998e88-f947-4a05-b61c-33240cfc45bf None admin] RBAC: Authorizing `identity:get_project(project_id=e348a05b09f243ba9e3fb047958abc4b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:37.590933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a998e88-f947-4a05-b61c-33240cfc45bf None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:37.592626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 566/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:59:37 2022] GET /identity/v3/projects/e348a05b09f243ba9e3fb047958abc4b => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:37.598708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f5ba5-27d4-42aa-a8c7-80fdf61dcd80 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:37.690292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f5ba5-27d4-42aa-a8c7-80fdf61dcd80 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:37.721574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b7da9-6298-4c75-8179-8934d89a00f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:37.722709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b7da9-6298-4c75-8179-8934d89a00f8 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:37.722985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b7da9-6298-4c75-8179-8934d89a00f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:37.723252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b7da9-6298-4c75-8179-8934d89a00f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:37.724060 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b7da9-6298-4c75-8179-8934d89a00f8 None admin] RBAC: Adding query filter params (role.id=f12928ff609a47a9bef9cb8abc28932b, scope.project.id=e348a05b09f243ba9e3fb047958abc4b, user.id=e0f482db9f71465596a28e7434dc0a94) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:37.724393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b7da9-6298-4c75-8179-8934d89a00f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:37.725801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b7da9-6298-4c75-8179-8934d89a00f8 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:37.730839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 551/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:59:37 2022] GET /identity/v3/role_assignments?user.id=e0f482db9f71465596a28e7434dc0a94&scope.project.id=e348a05b09f243ba9e3fb047958abc4b&role.id=f12928ff609a47a9bef9cb8abc28932b => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:39.917554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af5fdd-a647-46ba-8d03-9267f37eb405 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:39.918084 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af5fdd-a647-46ba-8d03-9267f37eb405 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:39.918084 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af5fdd-a647-46ba-8d03-9267f37eb405 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:39.919448 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 567/1118] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:39.924586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12041a02-0b83-4320-8cbe-c0d3ced50baa None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:39.925035 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12041a02-0b83-4320-8cbe-c0d3ced50baa None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:39.925138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12041a02-0b83-4320-8cbe-c0d3ced50baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:39.942468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-12041a02-0b83-4320-8cbe-c0d3ced50baa None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:39.943636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-12041a02-0b83-4320-8cbe-c0d3ced50baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:40.006177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 552/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:40.028303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af5fdd-a647-46ba-8d03-9267f37eb405 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:40.121325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af5fdd-a647-46ba-8d03-9267f37eb405 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:40.152193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cd45c-2c82-419c-b1f2-471498e8ac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:40.153012 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cd45c-2c82-419c-b1f2-471498e8ac83 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:40.153291 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cd45c-2c82-419c-b1f2-471498e8ac83 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:40.153562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cd45c-2c82-419c-b1f2-471498e8ac83 None admin] PATH_INFO: `/v3/roles/f12928ff609a47a9bef9cb8abc28932b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:40.155003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cd45c-2c82-419c-b1f2-471498e8ac83 None admin] RBAC: Authorizing `identity:get_role(role_id=f12928ff609a47a9bef9cb8abc28932b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:40.156368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cd45c-2c82-419c-b1f2-471498e8ac83 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:40.157690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 568/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:59:40 2022] GET /identity/v3/roles/f12928ff609a47a9bef9cb8abc28932b => generated 223 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:40.163104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12041a02-0b83-4320-8cbe-c0d3ced50baa None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:40.254778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12041a02-0b83-4320-8cbe-c0d3ced50baa None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:40.285635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44aced-5679-4b52-bf16-8b7b5ab382e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:40.286485 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44aced-5679-4b52-bf16-8b7b5ab382e9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:40.286765 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44aced-5679-4b52-bf16-8b7b5ab382e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:40.287038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44aced-5679-4b52-bf16-8b7b5ab382e9 None admin] PATH_INFO: `/v3/users/e0f482db9f71465596a28e7434dc0a94` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:40.288242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44aced-5679-4b52-bf16-8b7b5ab382e9 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f482db9f71465596a28e7434dc0a94)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:40.289671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44aced-5679-4b52-bf16-8b7b5ab382e9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:40.291276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 553/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:59:40 2022] GET /identity/v3/users/e0f482db9f71465596a28e7434dc0a94 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:40.297041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cd45c-2c82-419c-b1f2-471498e8ac83 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:40.388742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cd45c-2c82-419c-b1f2-471498e8ac83 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:40.419825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d2222-5a97-45e1-9db7-17ca43fa2985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:40.420677 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d2222-5a97-45e1-9db7-17ca43fa2985 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:40.420955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d2222-5a97-45e1-9db7-17ca43fa2985 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:40.421226 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d2222-5a97-45e1-9db7-17ca43fa2985 None admin] PATH_INFO: `/v3/projects/e348a05b09f243ba9e3fb047958abc4b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:40.422376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d2222-5a97-45e1-9db7-17ca43fa2985 None admin] RBAC: Authorizing `identity:get_project(project_id=e348a05b09f243ba9e3fb047958abc4b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:40.423770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d2222-5a97-45e1-9db7-17ca43fa2985 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:40.425981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 569/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:59:40 2022] GET /identity/v3/projects/e348a05b09f243ba9e3fb047958abc4b => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:40.431598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44aced-5679-4b52-bf16-8b7b5ab382e9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:40.526388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44aced-5679-4b52-bf16-8b7b5ab382e9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:40.559737 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db541b-cc67-4955-b57e-58ad720ccf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:40.560631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db541b-cc67-4955-b57e-58ad720ccf4f None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:40.560911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db541b-cc67-4955-b57e-58ad720ccf4f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:40.561179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db541b-cc67-4955-b57e-58ad720ccf4f None admin] PATH_INFO: `/v3/projects/e348a05b09f243ba9e3fb047958abc4b/users/e0f482db9f71465596a28e7434dc0a94/roles/f12928ff609a47a9bef9cb8abc28932b` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:40.563352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db541b-cc67-4955-b57e-58ad720ccf4f None admin] RBAC: Authorizing `identity:create_grant(project_id=e348a05b09f243ba9e3fb047958abc4b, user_id=e0f482db9f71465596a28e7434dc0a94, role_id=f12928ff609a47a9bef9cb8abc28932b)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:40.564812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db541b-cc67-4955-b57e-58ad720ccf4f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:40.577896 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 554/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:59:40 2022] PUT /identity/v3/projects/e348a05b09f243ba9e3fb047958abc4b/users/e0f482db9f71465596a28e7434dc0a94/roles/f12928ff609a47a9bef9cb8abc28932b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:59:42.770191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36829-d7b5-4ec7-812d-91fa6f6152bb None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:42.770751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36829-d7b5-4ec7-812d-91fa6f6152bb None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:42.770751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36829-d7b5-4ec7-812d-91fa6f6152bb None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:42.772073 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 570/1124] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:42.777289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd1dc5-b6d6-40f9-a7c5-91a86f2d5352 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:42.777658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd1dc5-b6d6-40f9-a7c5-91a86f2d5352 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:42.777838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd1dc5-b6d6-40f9-a7c5-91a86f2d5352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:42.794844 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-1cfd1dc5-b6d6-40f9-a7c5-91a86f2d5352 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:42.796064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1cfd1dc5-b6d6-40f9-a7c5-91a86f2d5352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:42.860727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 555/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:42.884228 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36829-d7b5-4ec7-812d-91fa6f6152bb None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:42.977221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36829-d7b5-4ec7-812d-91fa6f6152bb None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:43.007610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276a4df-230f-45a6-9870-7dff79be854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:43.008466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276a4df-230f-45a6-9870-7dff79be854f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:43.008747 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276a4df-230f-45a6-9870-7dff79be854f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:43.009020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276a4df-230f-45a6-9870-7dff79be854f None admin] PATH_INFO: `/v3/roles/f12928ff609a47a9bef9cb8abc28932b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:43.010469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276a4df-230f-45a6-9870-7dff79be854f None admin] RBAC: Authorizing `identity:get_role(role_id=f12928ff609a47a9bef9cb8abc28932b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:43.011811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276a4df-230f-45a6-9870-7dff79be854f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:43.013167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 571/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:59:42 2022] GET /identity/v3/roles/f12928ff609a47a9bef9cb8abc28932b => generated 223 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:43.019229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd1dc5-b6d6-40f9-a7c5-91a86f2d5352 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:43.111228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd1dc5-b6d6-40f9-a7c5-91a86f2d5352 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:43.142233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f7983-64f5-41b9-81b4-7d219c536abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:43.143084 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f7983-64f5-41b9-81b4-7d219c536abf None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:43.143361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f7983-64f5-41b9-81b4-7d219c536abf None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:43.144196 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f7983-64f5-41b9-81b4-7d219c536abf None admin] PATH_INFO: `/v3/users/e0f482db9f71465596a28e7434dc0a94` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:43.145379 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f7983-64f5-41b9-81b4-7d219c536abf None admin] RBAC: Authorizing `identity:get_user(user_id=e0f482db9f71465596a28e7434dc0a94)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:43.146804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f7983-64f5-41b9-81b4-7d219c536abf None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:43.148416 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 556/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:59:43 2022] GET /identity/v3/users/e0f482db9f71465596a28e7434dc0a94 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:43.153913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276a4df-230f-45a6-9870-7dff79be854f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:43.245702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276a4df-230f-45a6-9870-7dff79be854f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:43.276861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda8249-3b8d-4515-bb48-9eaaf6869e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:43.277487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8249-3b8d-4515-bb48-9eaaf6869e74 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:43.277766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8249-3b8d-4515-bb48-9eaaf6869e74 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:43.278037 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8249-3b8d-4515-bb48-9eaaf6869e74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:43.339411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda8249-3b8d-4515-bb48-9eaaf6869e74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:43.340844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda8249-3b8d-4515-bb48-9eaaf6869e74 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:43.430407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 572/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:59:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:59:43.436110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f7983-64f5-41b9-81b4-7d219c536abf None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:43.529080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f7983-64f5-41b9-81b4-7d219c536abf None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:43.560870 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dd92e-ce26-489b-a3fd-06278afbfb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:43.561698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dd92e-ce26-489b-a3fd-06278afbfb82 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:43.561976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dd92e-ce26-489b-a3fd-06278afbfb82 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:43.562245 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dd92e-ce26-489b-a3fd-06278afbfb82 None admin] PATH_INFO: `/v3/projects/e348a05b09f243ba9e3fb047958abc4b` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:43.563408 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1dd92e-ce26-489b-a3fd-06278afbfb82 None admin] RBAC: Authorizing `identity:get_project(project_id=e348a05b09f243ba9e3fb047958abc4b)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:43.564852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1dd92e-ce26-489b-a3fd-06278afbfb82 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:43.566509 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 557/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:59:43 2022] GET /identity/v3/projects/e348a05b09f243ba9e3fb047958abc4b => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:43.572211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda8249-3b8d-4515-bb48-9eaaf6869e74 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:43.662726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda8249-3b8d-4515-bb48-9eaaf6869e74 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:43.693780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0fd9e-4aae-461a-a83f-8bff285b1477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:43.694355 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0fd9e-4aae-461a-a83f-8bff285b1477 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:43.694633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0fd9e-4aae-461a-a83f-8bff285b1477 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:43.694904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0fd9e-4aae-461a-a83f-8bff285b1477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:43.695711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0fd9e-4aae-461a-a83f-8bff285b1477 None admin] RBAC: Adding query filter params (role.id=f12928ff609a47a9bef9cb8abc28932b, scope.project.id=e348a05b09f243ba9e3fb047958abc4b, user.id=e0f482db9f71465596a28e7434dc0a94) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:43.696018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0fd9e-4aae-461a-a83f-8bff285b1477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:43.697823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0fd9e-4aae-461a-a83f-8bff285b1477 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:43.703253 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 573/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:59:43 2022] GET /identity/v3/role_assignments?user.id=e0f482db9f71465596a28e7434dc0a94&scope.project.id=e348a05b09f243ba9e3fb047958abc4b&role.id=f12928ff609a47a9bef9cb8abc28932b => generated 608 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:45.924148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a6cd-3293-49e5-9ab4-c4238fe01891 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:45.925273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a6cd-3293-49e5-9ab4-c4238fe01891 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:45.925273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a6cd-3293-49e5-9ab4-c4238fe01891 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:45.926588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 558/1131] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:45.931731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11ec7-aab8-42d1-bfac-ccf96d6ac20e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:45.932172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11ec7-aab8-42d1-bfac-ccf96d6ac20e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:45.932315 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11ec7-aab8-42d1-bfac-ccf96d6ac20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:45.948560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-c1d11ec7-aab8-42d1-bfac-ccf96d6ac20e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:45.949717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c1d11ec7-aab8-42d1-bfac-ccf96d6ac20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:46.011135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 574/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:46.034857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4a6cd-3293-49e5-9ab4-c4238fe01891 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:46.129186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4a6cd-3293-49e5-9ab4-c4238fe01891 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:46.160983 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d44b9a-867f-4556-83be-8730082e0847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:46.161740 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d44b9a-867f-4556-83be-8730082e0847 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:46.162016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d44b9a-867f-4556-83be-8730082e0847 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:46.162283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d44b9a-867f-4556-83be-8730082e0847 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:46.163431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d44b9a-867f-4556-83be-8730082e0847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:46.164860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d44b9a-867f-4556-83be-8730082e0847 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:46.166403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 559/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:46.171967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d11ec7-aab8-42d1-bfac-ccf96d6ac20e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:46.262236 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d11ec7-aab8-42d1-bfac-ccf96d6ac20e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:46.293514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a1019-1402-4c77-aeee-5a8f2484481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:46.294151 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a1019-1402-4c77-aeee-5a8f2484481b None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:46.294428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a1019-1402-4c77-aeee-5a8f2484481b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:46.294699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a1019-1402-4c77-aeee-5a8f2484481b None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:46.295383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a1019-1402-4c77-aeee-5a8f2484481b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:46.296829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a1019-1402-4c77-aeee-5a8f2484481b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:46.319574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 575/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 08:59:46 2022] POST /identity/v3/projects => generated 311 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:48.546406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70306d-2a41-451e-90b2-af186945442e None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:48.546918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70306d-2a41-451e-90b2-af186945442e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:48.546918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70306d-2a41-451e-90b2-af186945442e None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:48.548447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 560/1135] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:48.554094 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244ba31-4468-487d-9929-a1310f560635 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:48.554500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244ba31-4468-487d-9929-a1310f560635 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:48.554643 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244ba31-4468-487d-9929-a1310f560635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:48.571169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-3244ba31-4468-487d-9929-a1310f560635 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:48.572601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3244ba31-4468-487d-9929-a1310f560635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:48.632882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 576/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:48.656387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70306d-2a41-451e-90b2-af186945442e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:48.750534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70306d-2a41-451e-90b2-af186945442e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:48.781376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb8b26-fc30-4254-bacd-95ca4fad6d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:48.782132 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8b26-fc30-4254-bacd-95ca4fad6d5d None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:48.782404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8b26-fc30-4254-bacd-95ca4fad6d5d None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:48.782669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8b26-fc30-4254-bacd-95ca4fad6d5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:48.784357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb8b26-fc30-4254-bacd-95ca4fad6d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:48.785765 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb8b26-fc30-4254-bacd-95ca4fad6d5d None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:48.787329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 561/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 08:59:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:48.793623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244ba31-4468-487d-9929-a1310f560635 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:48.886865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244ba31-4468-487d-9929-a1310f560635 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:48.918100 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdf2db-fac1-4833-b5f9-be60f98457cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:48.918747 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdf2db-fac1-4833-b5f9-be60f98457cd None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:48.919030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdf2db-fac1-4833-b5f9-be60f98457cd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:48.919307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdf2db-fac1-4833-b5f9-be60f98457cd None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:48.920002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdf2db-fac1-4833-b5f9-be60f98457cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:48.921449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdf2db-fac1-4833-b5f9-be60f98457cd None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:48.940682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 577/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 08:59:48 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 08:59:51.180914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adcd77-6270-4e5e-9111-5691510d5726 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:51.181501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adcd77-6270-4e5e-9111-5691510d5726 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:51.181501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adcd77-6270-4e5e-9111-5691510d5726 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:51.182779 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 562/1139] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:51.187934 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a452cf-7978-4c44-ada2-5d87c844b58e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:51.188376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a452cf-7978-4c44-ada2-5d87c844b58e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:51.188525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a452cf-7978-4c44-ada2-5d87c844b58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:51.205434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-d6a452cf-7978-4c44-ada2-5d87c844b58e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:51.207208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d6a452cf-7978-4c44-ada2-5d87c844b58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:51.269164 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 578/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:51.292826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adcd77-6270-4e5e-9111-5691510d5726 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:51.385798 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adcd77-6270-4e5e-9111-5691510d5726 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:51.417636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95842792-d268-4a15-927e-466679919fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:51.418393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95842792-d268-4a15-927e-466679919fdd None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:51.418669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95842792-d268-4a15-927e-466679919fdd None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:51.418935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95842792-d268-4a15-927e-466679919fdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:51.429189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95842792-d268-4a15-927e-466679919fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-95842792-d268-4a15-927e-466679919fdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:59:51.436749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:51.437931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:51.439079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 563/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:51.444187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a452cf-7978-4c44-ada2-5d87c844b58e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:51.533932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a452cf-7978-4c44-ada2-5d87c844b58e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:51.565588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790becb-9983-4736-ba7a-fb9a65290407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:51.566236 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790becb-9983-4736-ba7a-fb9a65290407 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:51.566518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790becb-9983-4736-ba7a-fb9a65290407 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:51.566788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790becb-9983-4736-ba7a-fb9a65290407 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:51.567522 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790becb-9983-4736-ba7a-fb9a65290407 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:51.567824 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790becb-9983-4736-ba7a-fb9a65290407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:51.569202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790becb-9983-4736-ba7a-fb9a65290407 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:51.577003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 579/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:51.582624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95842792-d268-4a15-927e-466679919fdd None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:51.675371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95842792-d268-4a15-927e-466679919fdd None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:51.706400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c4533-e89e-4253-a640-e6b7505ea5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:51.707184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c4533-e89e-4253-a640-e6b7505ea5ca None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:51.707464 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c4533-e89e-4253-a640-e6b7505ea5ca None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:51.707733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c4533-e89e-4253-a640-e6b7505ea5ca None admin] PATH_INFO: `/v3/users/1adb9139575e4b0db89cb4a9531528a8` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:51.719946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c4533-e89e-4253-a640-e6b7505ea5ca None admin] RBAC: Authorizing `identity:get_user(user_id=1adb9139575e4b0db89cb4a9531528a8)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:51.721924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c4533-e89e-4253-a640-e6b7505ea5ca None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:51.723509 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 564/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:59:51 2022] GET /identity/v3/users/1adb9139575e4b0db89cb4a9531528a8 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:51.728895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790becb-9983-4736-ba7a-fb9a65290407 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:51.821144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790becb-9983-4736-ba7a-fb9a65290407 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:51.852807 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27f045-945a-4021-8ce6-a3357cba3358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:51.853429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27f045-945a-4021-8ce6-a3357cba3358 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:51.853710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27f045-945a-4021-8ce6-a3357cba3358 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:51.853985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27f045-945a-4021-8ce6-a3357cba3358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:51.916557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27f045-945a-4021-8ce6-a3357cba3358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:51.917970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27f045-945a-4021-8ce6-a3357cba3358 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:52.010502 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 580/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:59:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:59:52.016355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c4533-e89e-4253-a640-e6b7505ea5ca None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:52.107094 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c4533-e89e-4253-a640-e6b7505ea5ca None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:52.139211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34756e-7f00-4bf7-838c-b9b4bea931b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:52.140049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34756e-7f00-4bf7-838c-b9b4bea931b4 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:52.140361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34756e-7f00-4bf7-838c-b9b4bea931b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:52.140633 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34756e-7f00-4bf7-838c-b9b4bea931b4 None admin] PATH_INFO: `/v3/projects/9cf0fe0a287141e3be8b58b1cd5178c7` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:52.141799 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34756e-7f00-4bf7-838c-b9b4bea931b4 None admin] RBAC: Authorizing `identity:get_project(project_id=9cf0fe0a287141e3be8b58b1cd5178c7)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:52.143216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34756e-7f00-4bf7-838c-b9b4bea931b4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:52.144890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 565/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:59:52 2022] GET /identity/v3/projects/9cf0fe0a287141e3be8b58b1cd5178c7 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:52.150698 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27f045-945a-4021-8ce6-a3357cba3358 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:52.241993 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27f045-945a-4021-8ce6-a3357cba3358 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:52.273488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083fe36-55e6-44c1-9e2e-d8fcc76bbcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:52.274063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083fe36-55e6-44c1-9e2e-d8fcc76bbcf1 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:52.274341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083fe36-55e6-44c1-9e2e-d8fcc76bbcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:52.274604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083fe36-55e6-44c1-9e2e-d8fcc76bbcf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:52.275409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083fe36-55e6-44c1-9e2e-d8fcc76bbcf1 None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=9cf0fe0a287141e3be8b58b1cd5178c7, user.id=1adb9139575e4b0db89cb4a9531528a8) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:52.275710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083fe36-55e6-44c1-9e2e-d8fcc76bbcf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:52.277146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083fe36-55e6-44c1-9e2e-d8fcc76bbcf1 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:52.282193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 581/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:59:52 2022] GET /identity/v3/role_assignments?user.id=1adb9139575e4b0db89cb4a9531528a8&scope.project.id=9cf0fe0a287141e3be8b58b1cd5178c7&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:54.462430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f7729-09b9-4641-9aee-e642f96e6d53 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:54.462963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f7729-09b9-4641-9aee-e642f96e6d53 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:54.462963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f7729-09b9-4641-9aee-e642f96e6d53 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:54.464355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 566/1147] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:54.469439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d014a-ca9d-495a-bf58-48919c41bfd3 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:54.469842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d014a-ca9d-495a-bf58-48919c41bfd3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:54.469990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d014a-ca9d-495a-bf58-48919c41bfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:54.490624 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-a54d014a-ca9d-495a-bf58-48919c41bfd3 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:54.491891 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a54d014a-ca9d-495a-bf58-48919c41bfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:54.558347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 582/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:54.581462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f7729-09b9-4641-9aee-e642f96e6d53 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:54.675076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f7729-09b9-4641-9aee-e642f96e6d53 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:54.707700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993deb5-80e5-46f0-9b3a-adec97ea8f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:54.708487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993deb5-80e5-46f0-9b3a-adec97ea8f72 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:54.708767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993deb5-80e5-46f0-9b3a-adec97ea8f72 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:54.709033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993deb5-80e5-46f0-9b3a-adec97ea8f72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:54.718462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993deb5-80e5-46f0-9b3a-adec97ea8f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-c993deb5-80e5-46f0-9b3a-adec97ea8f72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:59:54.726001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:54.727107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 08:59:54.728197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 567/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:54.733211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d014a-ca9d-495a-bf58-48919c41bfd3 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:54.828672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d014a-ca9d-495a-bf58-48919c41bfd3 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:54.859680 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844229c-17c1-43ca-b11b-e873d20563b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:54.860354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844229c-17c1-43ca-b11b-e873d20563b8 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:54.860631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844229c-17c1-43ca-b11b-e873d20563b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:54.860902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844229c-17c1-43ca-b11b-e873d20563b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:54.861661 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844229c-17c1-43ca-b11b-e873d20563b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:54.861964 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844229c-17c1-43ca-b11b-e873d20563b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:54.863306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844229c-17c1-43ca-b11b-e873d20563b8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:54.870810 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 583/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:54.876734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993deb5-80e5-46f0-9b3a-adec97ea8f72 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:54.970346 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993deb5-80e5-46f0-9b3a-adec97ea8f72 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:55.001351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0d766-aadc-4ed1-9208-86a15ffd2db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:55.002719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0d766-aadc-4ed1-9208-86a15ffd2db2 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:55.003007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0d766-aadc-4ed1-9208-86a15ffd2db2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:55.003276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0d766-aadc-4ed1-9208-86a15ffd2db2 None admin] PATH_INFO: `/v3/users/1adb9139575e4b0db89cb4a9531528a8` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:55.004482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0d766-aadc-4ed1-9208-86a15ffd2db2 None admin] RBAC: Authorizing `identity:get_user(user_id=1adb9139575e4b0db89cb4a9531528a8)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:55.005896 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0d766-aadc-4ed1-9208-86a15ffd2db2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:55.007492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 568/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:59:54 2022] GET /identity/v3/users/1adb9139575e4b0db89cb4a9531528a8 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:55.013653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844229c-17c1-43ca-b11b-e873d20563b8 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:55.106188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844229c-17c1-43ca-b11b-e873d20563b8 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:55.139265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269d458-8482-4f36-a899-d75c1e489b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:55.140141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269d458-8482-4f36-a899-d75c1e489b96 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:55.140423 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269d458-8482-4f36-a899-d75c1e489b96 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:55.140690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269d458-8482-4f36-a899-d75c1e489b96 None admin] PATH_INFO: `/v3/projects/9cf0fe0a287141e3be8b58b1cd5178c7` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:55.141852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269d458-8482-4f36-a899-d75c1e489b96 None admin] RBAC: Authorizing `identity:get_project(project_id=9cf0fe0a287141e3be8b58b1cd5178c7)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:55.143294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269d458-8482-4f36-a899-d75c1e489b96 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:55.144992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 584/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:59:55 2022] GET /identity/v3/projects/9cf0fe0a287141e3be8b58b1cd5178c7 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:55.150828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0d766-aadc-4ed1-9208-86a15ffd2db2 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:55.245045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0d766-aadc-4ed1-9208-86a15ffd2db2 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:55.276556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa98da9-3e1a-43b8-9d06-f40e316d62d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:55.277424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa98da9-3e1a-43b8-9d06-f40e316d62d2 None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:55.277723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa98da9-3e1a-43b8-9d06-f40e316d62d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:55.277978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa98da9-3e1a-43b8-9d06-f40e316d62d2 None admin] PATH_INFO: `/v3/projects/9cf0fe0a287141e3be8b58b1cd5178c7/users/1adb9139575e4b0db89cb4a9531528a8/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:55.279928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa98da9-3e1a-43b8-9d06-f40e316d62d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf0fe0a287141e3be8b58b1cd5178c7, user_id=1adb9139575e4b0db89cb4a9531528a8, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:55.281375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa98da9-3e1a-43b8-9d06-f40e316d62d2 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:55.294296 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 569/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 08:59:55 2022] PUT /identity/v3/projects/9cf0fe0a287141e3be8b58b1cd5178c7/users/1adb9139575e4b0db89cb4a9531528a8/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 08:59:57.538946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2400f36-379b-4a60-b80e-a1767e6a9737 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:57.539487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2400f36-379b-4a60-b80e-a1767e6a9737 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:57.539487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2400f36-379b-4a60-b80e-a1767e6a9737 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:57.540899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 585/1154] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 08:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 08:59:57.545965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a856a-783f-448f-8077-dddf422a8730 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:57.546336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a856a-783f-448f-8077-dddf422a8730 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:57.546512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a856a-783f-448f-8077-dddf422a8730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:57.562735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f81a856a-783f-448f-8077-dddf422a8730 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 08:59:57.563904 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f81a856a-783f-448f-8077-dddf422a8730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 08:59:57.626107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 570/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 08:59:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 08:59:57.650645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2400f36-379b-4a60-b80e-a1767e6a9737 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:57.744053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2400f36-379b-4a60-b80e-a1767e6a9737 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:57.776293 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9901e7-1cb0-4e65-8ba0-6d60dde03e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:57.777072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9901e7-1cb0-4e65-8ba0-6d60dde03e3b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:57.777352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9901e7-1cb0-4e65-8ba0-6d60dde03e3b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:57.777625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9901e7-1cb0-4e65-8ba0-6d60dde03e3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:57.787100 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9901e7-1cb0-4e65-8ba0-6d60dde03e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-8e9901e7-1cb0-4e65-8ba0-6d60dde03e3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 08:59:57.794760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 08:59:57.795833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 08:59:57.796862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 586/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 08:59:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 08:59:57.802538 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a856a-783f-448f-8077-dddf422a8730 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:57.894763 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a856a-783f-448f-8077-dddf422a8730 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:57.925775 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f532dc-4efc-4482-a2c1-7fb37c3c651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:57.926417 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f532dc-4efc-4482-a2c1-7fb37c3c651c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:57.926696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f532dc-4efc-4482-a2c1-7fb37c3c651c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:57.926969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f532dc-4efc-4482-a2c1-7fb37c3c651c None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:57.927706 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f532dc-4efc-4482-a2c1-7fb37c3c651c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:57.928010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f532dc-4efc-4482-a2c1-7fb37c3c651c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:57.929391 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f532dc-4efc-4482-a2c1-7fb37c3c651c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:57.936964 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 571/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 08:59:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:57.943139 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9901e7-1cb0-4e65-8ba0-6d60dde03e3b None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:58.034246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9901e7-1cb0-4e65-8ba0-6d60dde03e3b None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:58.065885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa444e-a355-4a62-b476-867589a7dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:58.067069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa444e-a355-4a62-b476-867589a7dfbe None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:58.067487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa444e-a355-4a62-b476-867589a7dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:58.067759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa444e-a355-4a62-b476-867589a7dfbe None admin] PATH_INFO: `/v3/users/1adb9139575e4b0db89cb4a9531528a8` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:58.068997 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa444e-a355-4a62-b476-867589a7dfbe None admin] RBAC: Authorizing `identity:get_user(user_id=1adb9139575e4b0db89cb4a9531528a8)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:58.070424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa444e-a355-4a62-b476-867589a7dfbe None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:58.072323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 587/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 08:59:57 2022] GET /identity/v3/users/1adb9139575e4b0db89cb4a9531528a8 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:58.081102 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f532dc-4efc-4482-a2c1-7fb37c3c651c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:58.174445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f532dc-4efc-4482-a2c1-7fb37c3c651c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:58.207718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced02a3b-1cc3-49bc-ad51-bcd2a8b52827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:58.208380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced02a3b-1cc3-49bc-ad51-bcd2a8b52827 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:58.208656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced02a3b-1cc3-49bc-ad51-bcd2a8b52827 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:58.208962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced02a3b-1cc3-49bc-ad51-bcd2a8b52827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:58.271088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced02a3b-1cc3-49bc-ad51-bcd2a8b52827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:58.272549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced02a3b-1cc3-49bc-ad51-bcd2a8b52827 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:58.362793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 572/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 08:59:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 08:59:58.368751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa444e-a355-4a62-b476-867589a7dfbe None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:58.460146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa444e-a355-4a62-b476-867589a7dfbe None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:58.491173 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db45d3-c30d-4902-9ede-82aa5496b0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:58.492004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db45d3-c30d-4902-9ede-82aa5496b0c3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:58.492303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db45d3-c30d-4902-9ede-82aa5496b0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:58.492574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db45d3-c30d-4902-9ede-82aa5496b0c3 None admin] PATH_INFO: `/v3/projects/9cf0fe0a287141e3be8b58b1cd5178c7` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:58.493715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db45d3-c30d-4902-9ede-82aa5496b0c3 None admin] RBAC: Authorizing `identity:get_project(project_id=9cf0fe0a287141e3be8b58b1cd5178c7)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:58.495106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db45d3-c30d-4902-9ede-82aa5496b0c3 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:58.496773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 588/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 08:59:58 2022] GET /identity/v3/projects/9cf0fe0a287141e3be8b58b1cd5178c7 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 08:59:58.502692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced02a3b-1cc3-49bc-ad51-bcd2a8b52827 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 08:59:58.593880 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced02a3b-1cc3-49bc-ad51-bcd2a8b52827 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 08:59:58.625494 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5f5e8-98fe-4a86-911d-b99bfadeb4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 08:59:58.626073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5f5e8-98fe-4a86-911d-b99bfadeb4ae None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 08:59:58.626347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5f5e8-98fe-4a86-911d-b99bfadeb4ae None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 08:59:58.626614 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5f5e8-98fe-4a86-911d-b99bfadeb4ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 08:59:58.627466 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5f5e8-98fe-4a86-911d-b99bfadeb4ae None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=9cf0fe0a287141e3be8b58b1cd5178c7, user.id=1adb9139575e4b0db89cb4a9531528a8) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 08:59:58.627769 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5f5e8-98fe-4a86-911d-b99bfadeb4ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 08:59:58.629197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5f5e8-98fe-4a86-911d-b99bfadeb4ae None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 08:59:58.634587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 573/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 08:59:58 2022] GET /identity/v3/role_assignments?user.id=1adb9139575e4b0db89cb4a9531528a8&scope.project.id=9cf0fe0a287141e3be8b58b1cd5178c7&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:00:00.851912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b84d-27fe-42cb-bdda-db2d7d63c452 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:00.852493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b84d-27fe-42cb-bdda-db2d7d63c452 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:00.852493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b84d-27fe-42cb-bdda-db2d7d63c452 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:00.853860 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 589/1162] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:00:00.858916 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa302-289f-4007-a618-c0b624002922 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:00.859358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa302-289f-4007-a618-c0b624002922 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:00.859451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa302-289f-4007-a618-c0b624002922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:00.875962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-73dfa302-289f-4007-a618-c0b624002922 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:00:00.877222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-73dfa302-289f-4007-a618-c0b624002922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:00.938913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 574/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:00:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:00:00.961369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629b84d-27fe-42cb-bdda-db2d7d63c452 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:01.057368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629b84d-27fe-42cb-bdda-db2d7d63c452 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:01.089173 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43c8cc-a3a8-4224-baa0-56a9a78111ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:01.089801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43c8cc-a3a8-4224-baa0-56a9a78111ad None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:01.090082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43c8cc-a3a8-4224-baa0-56a9a78111ad None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:01.090356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43c8cc-a3a8-4224-baa0-56a9a78111ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:01.152072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43c8cc-a3a8-4224-baa0-56a9a78111ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:01.153466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43c8cc-a3a8-4224-baa0-56a9a78111ad None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:01.243708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 590/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 09:00:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:00:01.249598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa302-289f-4007-a618-c0b624002922 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:01.340605 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa302-289f-4007-a618-c0b624002922 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:01.372582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e45e7e-3d1f-4ca8-a7f4-f4a2a35f38fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:01.373355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e45e7e-3d1f-4ca8-a7f4-f4a2a35f38fb None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:01.373627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e45e7e-3d1f-4ca8-a7f4-f4a2a35f38fb None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:01.373890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e45e7e-3d1f-4ca8-a7f4-f4a2a35f38fb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:01.380257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e45e7e-3d1f-4ca8-a7f4-f4a2a35f38fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:01.381667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e45e7e-3d1f-4ca8-a7f4-f4a2a35f38fb None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-48e45e7e-3d1f-4ca8-a7f4-f4a2a35f38fb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:00:01.395113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:00:01.396358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:00:01.397227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 575/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 09:00:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:00:01.402058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43c8cc-a3a8-4224-baa0-56a9a78111ad None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:01.494298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43c8cc-a3a8-4224-baa0-56a9a78111ad None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:01.526427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548b5db-b67b-4edf-94dc-bdda876b3a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:01.527073 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548b5db-b67b-4edf-94dc-bdda876b3a07 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:01.527355 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548b5db-b67b-4edf-94dc-bdda876b3a07 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:01.527631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548b5db-b67b-4edf-94dc-bdda876b3a07 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:01.528373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548b5db-b67b-4edf-94dc-bdda876b3a07 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:00:01.528689 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548b5db-b67b-4edf-94dc-bdda876b3a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:01.530043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548b5db-b67b-4edf-94dc-bdda876b3a07 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:01.536996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 591/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 09:00:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:03.755677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7b97e-8ffb-4a8c-ac43-e8c44ca7f8f9 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:03.756237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7b97e-8ffb-4a8c-ac43-e8c44ca7f8f9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:03.756237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7b97e-8ffb-4a8c-ac43-e8c44ca7f8f9 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:03.757583 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 576/1167] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:00:03.762609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d681d1-71a8-46be-970d-9614bd8c618d None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:03.763030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d681d1-71a8-46be-970d-9614bd8c618d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:03.763161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d681d1-71a8-46be-970d-9614bd8c618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:03.779246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-59d681d1-71a8-46be-970d-9614bd8c618d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:00:03.780457 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-59d681d1-71a8-46be-970d-9614bd8c618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:03.842537 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 592/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:00:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:00:03.866724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7b97e-8ffb-4a8c-ac43-e8c44ca7f8f9 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:03.960989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7b97e-8ffb-4a8c-ac43-e8c44ca7f8f9 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:03.992080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036beb8-836b-411a-8a3b-48c64473570c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:03.992726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036beb8-836b-411a-8a3b-48c64473570c None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:03.993001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036beb8-836b-411a-8a3b-48c64473570c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:03.993273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036beb8-836b-411a-8a3b-48c64473570c None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:03.993985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036beb8-836b-411a-8a3b-48c64473570c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:03.995326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036beb8-836b-411a-8a3b-48c64473570c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:04.008920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 577/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Tue May 3 09:00:03 2022] POST /identity/v3/domains => generated 267 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:00:06.251824 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3435dfe-07ce-4a9f-a9eb-a6dcb5efc272 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:06.252346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3435dfe-07ce-4a9f-a9eb-a6dcb5efc272 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:06.252448 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3435dfe-07ce-4a9f-a9eb-a6dcb5efc272 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:06.253751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 593/1170] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:00:06.258952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65135657-fa00-4595-b02e-014819109eb4 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:06.259382 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65135657-fa00-4595-b02e-014819109eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:06.259493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65135657-fa00-4595-b02e-014819109eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:06.276229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-65135657-fa00-4595-b02e-014819109eb4 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:00:06.277399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-65135657-fa00-4595-b02e-014819109eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:06.340561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 578/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:00:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:00:06.364103 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3435dfe-07ce-4a9f-a9eb-a6dcb5efc272 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:06.456866 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3435dfe-07ce-4a9f-a9eb-a6dcb5efc272 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:06.488131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d0400-893d-4f18-afcf-f3c465cfbbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:06.488925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d0400-893d-4f18-afcf-f3c465cfbbdd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:06.489242 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d0400-893d-4f18-afcf-f3c465cfbbdd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:06.489471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d0400-893d-4f18-afcf-f3c465cfbbdd None admin] PATH_INFO: `/v3/domains/9d7431432be04b1eb9bf0189746d3bad` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:06.499219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d0400-893d-4f18-afcf-f3c465cfbbdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=9d7431432be04b1eb9bf0189746d3bad)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:06.500674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d0400-893d-4f18-afcf-f3c465cfbbdd None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:06.502486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 594/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Tue May 3 09:00:06 2022] GET /identity/v3/domains/9d7431432be04b1eb9bf0189746d3bad => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:06.508214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65135657-fa00-4595-b02e-014819109eb4 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:06.601830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65135657-fa00-4595-b02e-014819109eb4 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:06.633473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a61c32-f04f-49f8-ae1e-3fb1991de86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:06.634108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61c32-f04f-49f8-ae1e-3fb1991de86e None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:06.634387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61c32-f04f-49f8-ae1e-3fb1991de86e None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:06.634659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61c32-f04f-49f8-ae1e-3fb1991de86e None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:06.635363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a61c32-f04f-49f8-ae1e-3fb1991de86e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:06.636809 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a61c32-f04f-49f8-ae1e-3fb1991de86e None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:06.661837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 579/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 09:00:06 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:00:08.919360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aa1ad-28dc-40a7-b924-b98373784911 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:08.919915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aa1ad-28dc-40a7-b924-b98373784911 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:08.919915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aa1ad-28dc-40a7-b924-b98373784911 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:08.921292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 595/1174] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:00:08.927155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a4cc7-2b90-4072-95ba-be84d0c36c90 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:08.927539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a4cc7-2b90-4072-95ba-be84d0c36c90 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:08.927715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a4cc7-2b90-4072-95ba-be84d0c36c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:08.943885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-063a4cc7-2b90-4072-95ba-be84d0c36c90 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:00:08.945093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-063a4cc7-2b90-4072-95ba-be84d0c36c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:09.006726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 580/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:00:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:00:09.031250 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aa1ad-28dc-40a7-b924-b98373784911 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:09.128012 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aa1ad-28dc-40a7-b924-b98373784911 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:09.159530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc3338-d7e5-4d75-9e08-d7f3ef494edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:09.160403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc3338-d7e5-4d75-9e08-d7f3ef494edc None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:09.160678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc3338-d7e5-4d75-9e08-d7f3ef494edc None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:09.160949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc3338-d7e5-4d75-9e08-d7f3ef494edc None admin] PATH_INFO: `/v3/domains/9d7431432be04b1eb9bf0189746d3bad` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:09.162113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc3338-d7e5-4d75-9e08-d7f3ef494edc None admin] RBAC: Authorizing `identity:get_domain(domain_id=9d7431432be04b1eb9bf0189746d3bad)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:09.163527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc3338-d7e5-4d75-9e08-d7f3ef494edc None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:09.165144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 596/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Tue May 3 09:00:09 2022] GET /identity/v3/domains/9d7431432be04b1eb9bf0189746d3bad => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:09.171021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a4cc7-2b90-4072-95ba-be84d0c36c90 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:09.265210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a4cc7-2b90-4072-95ba-be84d0c36c90 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:09.297260 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59d5cd-bf9f-469b-acc3-6f0ffae023ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:09.297911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59d5cd-bf9f-469b-acc3-6f0ffae023ef None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:09.298190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59d5cd-bf9f-469b-acc3-6f0ffae023ef None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:09.298486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59d5cd-bf9f-469b-acc3-6f0ffae023ef None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:09.299185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59d5cd-bf9f-469b-acc3-6f0ffae023ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:09.300635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59d5cd-bf9f-469b-acc3-6f0ffae023ef None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:09.318930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 581/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 09:00:09 2022] POST /identity/v3/users => generated 311 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:00:11.588917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38968529-ea31-424d-84dc-d1460d17b021 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:11.589464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38968529-ea31-424d-84dc-d1460d17b021 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:11.589464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38968529-ea31-424d-84dc-d1460d17b021 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:11.590807 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 597/1178] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:00:11.596513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93cc2-2817-4cb4-8e4f-40ee8b825b9c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:11.596898 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93cc2-2817-4cb4-8e4f-40ee8b825b9c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:11.597061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93cc2-2817-4cb4-8e4f-40ee8b825b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:11.613149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-49c93cc2-2817-4cb4-8e4f-40ee8b825b9c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:00:11.614320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-49c93cc2-2817-4cb4-8e4f-40ee8b825b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:11.675469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 582/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:00:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:00:11.698349 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38968529-ea31-424d-84dc-d1460d17b021 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:11.793546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38968529-ea31-424d-84dc-d1460d17b021 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:11.824608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bad027-304b-4fc1-b18d-1c1e367c4c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:11.825384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bad027-304b-4fc1-b18d-1c1e367c4c87 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:11.825661 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bad027-304b-4fc1-b18d-1c1e367c4c87 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:11.825927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bad027-304b-4fc1-b18d-1c1e367c4c87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:11.835818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bad027-304b-4fc1-b18d-1c1e367c4c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-31bad027-304b-4fc1-b18d-1c1e367c4c87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:00:11.843510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:00:11.844705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:00:11.846227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 598/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 09:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:00:11.851253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c93cc2-2817-4cb4-8e4f-40ee8b825b9c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:11.942203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c93cc2-2817-4cb4-8e4f-40ee8b825b9c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:11.974342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcec05f-8b91-4a2e-b895-cc962b49dda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:11.974993 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcec05f-8b91-4a2e-b895-cc962b49dda7 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:11.975271 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcec05f-8b91-4a2e-b895-cc962b49dda7 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:11.975544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcec05f-8b91-4a2e-b895-cc962b49dda7 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:11.976313 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcec05f-8b91-4a2e-b895-cc962b49dda7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:00:11.976618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcec05f-8b91-4a2e-b895-cc962b49dda7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:11.977974 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcec05f-8b91-4a2e-b895-cc962b49dda7 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:11.985573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 583/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 09:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:11.991214 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bad027-304b-4fc1-b18d-1c1e367c4c87 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:12.083418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bad027-304b-4fc1-b18d-1c1e367c4c87 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:12.113742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a2af2-71d6-4421-a6b8-cdfb94b806cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:12.114531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a2af2-71d6-4421-a6b8-cdfb94b806cd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:12.114812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a2af2-71d6-4421-a6b8-cdfb94b806cd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:12.115083 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a2af2-71d6-4421-a6b8-cdfb94b806cd None admin] PATH_INFO: `/v3/users/9fcdc2abe9dd4e6897d78b2c7d21ab8c` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:12.127733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a2af2-71d6-4421-a6b8-cdfb94b806cd None admin] RBAC: Authorizing `identity:get_user(user_id=9fcdc2abe9dd4e6897d78b2c7d21ab8c)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:12.129189 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a2af2-71d6-4421-a6b8-cdfb94b806cd None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:12.130781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 599/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 09:00:11 2022] GET /identity/v3/users/9fcdc2abe9dd4e6897d78b2c7d21ab8c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:12.136339 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcec05f-8b91-4a2e-b895-cc962b49dda7 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:12.229169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcec05f-8b91-4a2e-b895-cc962b49dda7 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:12.260604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486efab-9d50-4f8f-86f2-4fe64be160cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:12.261225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486efab-9d50-4f8f-86f2-4fe64be160cb None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:12.261499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486efab-9d50-4f8f-86f2-4fe64be160cb None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:12.261766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486efab-9d50-4f8f-86f2-4fe64be160cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:12.323433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486efab-9d50-4f8f-86f2-4fe64be160cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:12.324883 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486efab-9d50-4f8f-86f2-4fe64be160cb None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:12.413577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 584/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 09:00:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:00:12.419488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a2af2-71d6-4421-a6b8-cdfb94b806cd None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:12.511749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a2af2-71d6-4421-a6b8-cdfb94b806cd None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:12.542455 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec9d04-b814-42c1-a45a-6b2a5e92be1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:12.543289 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec9d04-b814-42c1-a45a-6b2a5e92be1b None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:12.543572 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec9d04-b814-42c1-a45a-6b2a5e92be1b None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:12.543848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec9d04-b814-42c1-a45a-6b2a5e92be1b None admin] PATH_INFO: `/v3/projects/645a8289d129417e92a083eeee018b71` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:12.545041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec9d04-b814-42c1-a45a-6b2a5e92be1b None admin] RBAC: Authorizing `identity:get_project(project_id=645a8289d129417e92a083eeee018b71)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:12.546452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec9d04-b814-42c1-a45a-6b2a5e92be1b None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:12.548773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 600/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 09:00:12 2022] GET /identity/v3/projects/645a8289d129417e92a083eeee018b71 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:12.554597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486efab-9d50-4f8f-86f2-4fe64be160cb None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:12.648214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486efab-9d50-4f8f-86f2-4fe64be160cb None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:12.680106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d137405-bea6-4264-b46d-5bc85bf4f172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:12.680693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d137405-bea6-4264-b46d-5bc85bf4f172 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:12.680969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d137405-bea6-4264-b46d-5bc85bf4f172 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:12.681237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d137405-bea6-4264-b46d-5bc85bf4f172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:12.682045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d137405-bea6-4264-b46d-5bc85bf4f172 None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=645a8289d129417e92a083eeee018b71, user.id=9fcdc2abe9dd4e6897d78b2c7d21ab8c) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:00:12.682349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d137405-bea6-4264-b46d-5bc85bf4f172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:12.683753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d137405-bea6-4264-b46d-5bc85bf4f172 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:12.688938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 585/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 09:00:12 2022] GET /identity/v3/role_assignments?user.id=9fcdc2abe9dd4e6897d78b2c7d21ab8c&scope.project.id=645a8289d129417e92a083eeee018b71&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:14.905297 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b11f0-fc89-45c2-8647-38aaac15ad02 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:14.905848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b11f0-fc89-45c2-8647-38aaac15ad02 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:14.905848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b11f0-fc89-45c2-8647-38aaac15ad02 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:14.907208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 601/1186] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:00:14.912434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde0601-1d9f-4a5d-ab60-2b1bb49bbe31 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:14.912835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde0601-1d9f-4a5d-ab60-2b1bb49bbe31 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:14.912986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde0601-1d9f-4a5d-ab60-2b1bb49bbe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:14.929142 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-dcde0601-1d9f-4a5d-ab60-2b1bb49bbe31 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:00:14.930300 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-dcde0601-1d9f-4a5d-ab60-2b1bb49bbe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:14.992144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 586/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:00:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:00:15.015660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b11f0-fc89-45c2-8647-38aaac15ad02 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:15.110043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b11f0-fc89-45c2-8647-38aaac15ad02 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:15.141042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14c2f1-81a4-4b9c-bfac-60900cc64fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:15.142351 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14c2f1-81a4-4b9c-bfac-60900cc64fef None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:15.142631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14c2f1-81a4-4b9c-bfac-60900cc64fef None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:15.142910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14c2f1-81a4-4b9c-bfac-60900cc64fef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:15.152293 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14c2f1-81a4-4b9c-bfac-60900cc64fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-cd14c2f1-81a4-4b9c-bfac-60900cc64fef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:00:15.159859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:00:15.160994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:00:15.162050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 602/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 09:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:00:15.167030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde0601-1d9f-4a5d-ab60-2b1bb49bbe31 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:15.259227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde0601-1d9f-4a5d-ab60-2b1bb49bbe31 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:15.290579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48c6e4-0e6f-44f7-afc9-6f8ed4015fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:15.291223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48c6e4-0e6f-44f7-afc9-6f8ed4015fd4 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:15.291500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48c6e4-0e6f-44f7-afc9-6f8ed4015fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:15.291769 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48c6e4-0e6f-44f7-afc9-6f8ed4015fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:15.292527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48c6e4-0e6f-44f7-afc9-6f8ed4015fd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:00:15.292823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48c6e4-0e6f-44f7-afc9-6f8ed4015fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:15.294169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48c6e4-0e6f-44f7-afc9-6f8ed4015fd4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:15.302163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 587/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 09:00:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:15.308753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14c2f1-81a4-4b9c-bfac-60900cc64fef None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:15.400794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14c2f1-81a4-4b9c-bfac-60900cc64fef None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:15.431155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64000fb0-6b93-425d-adad-010297e2b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:15.431941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64000fb0-6b93-425d-adad-010297e2b592 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:15.432245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64000fb0-6b93-425d-adad-010297e2b592 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:15.432514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64000fb0-6b93-425d-adad-010297e2b592 None admin] PATH_INFO: `/v3/users/9fcdc2abe9dd4e6897d78b2c7d21ab8c` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:15.433655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64000fb0-6b93-425d-adad-010297e2b592 None admin] RBAC: Authorizing `identity:get_user(user_id=9fcdc2abe9dd4e6897d78b2c7d21ab8c)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:15.435069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64000fb0-6b93-425d-adad-010297e2b592 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:15.436676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 603/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 09:00:15 2022] GET /identity/v3/users/9fcdc2abe9dd4e6897d78b2c7d21ab8c => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:15.443502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48c6e4-0e6f-44f7-afc9-6f8ed4015fd4 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:15.536373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48c6e4-0e6f-44f7-afc9-6f8ed4015fd4 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:15.568328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6672be7-1ee5-43de-ae68-6193c4d87ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:15.569169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672be7-1ee5-43de-ae68-6193c4d87ac1 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:15.569449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672be7-1ee5-43de-ae68-6193c4d87ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:15.569723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672be7-1ee5-43de-ae68-6193c4d87ac1 None admin] PATH_INFO: `/v3/projects/645a8289d129417e92a083eeee018b71` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:15.570883 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6672be7-1ee5-43de-ae68-6193c4d87ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=645a8289d129417e92a083eeee018b71)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:15.572667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6672be7-1ee5-43de-ae68-6193c4d87ac1 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:15.574310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 588/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 09:00:15 2022] GET /identity/v3/projects/645a8289d129417e92a083eeee018b71 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:15.579931 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64000fb0-6b93-425d-adad-010297e2b592 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:15.669993 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64000fb0-6b93-425d-adad-010297e2b592 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:15.700670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98584af-0978-43fe-abd6-06cdbc6db6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:15.701466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98584af-0978-43fe-abd6-06cdbc6db6ae None admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:15.701736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98584af-0978-43fe-abd6-06cdbc6db6ae None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:15.702000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98584af-0978-43fe-abd6-06cdbc6db6ae None admin] PATH_INFO: `/v3/projects/645a8289d129417e92a083eeee018b71/users/9fcdc2abe9dd4e6897d78b2c7d21ab8c/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:15.703887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98584af-0978-43fe-abd6-06cdbc6db6ae None admin] RBAC: Authorizing `identity:create_grant(project_id=645a8289d129417e92a083eeee018b71, user_id=9fcdc2abe9dd4e6897d78b2c7d21ab8c, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:15.705324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98584af-0978-43fe-abd6-06cdbc6db6ae None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:15.717057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 604/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 09:00:15 2022] PUT /identity/v3/projects/645a8289d129417e92a083eeee018b71/users/9fcdc2abe9dd4e6897d78b2c7d21ab8c/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:00:17.917125 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c0c8a-6cbb-422d-8284-6388e4bfab16 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:17.917680 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c0c8a-6cbb-422d-8284-6388e4bfab16 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:17.917680 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c0c8a-6cbb-422d-8284-6388e4bfab16 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:17.919004 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 589/1193] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:00:17.924634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb1211-bb7e-492d-b4d0-557f10837a1d None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:17.925007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb1211-bb7e-492d-b4d0-557f10837a1d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:17.925193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb1211-bb7e-492d-b4d0-557f10837a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:17.941260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e9eb1211-bb7e-492d-b4d0-557f10837a1d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:00:17.942430 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e9eb1211-bb7e-492d-b4d0-557f10837a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:00:18.004172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 605/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:00:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:00:18.027702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c0c8a-6cbb-422d-8284-6388e4bfab16 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:18.122173 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c0c8a-6cbb-422d-8284-6388e4bfab16 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:18.152543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d1368-a291-4d08-8c3f-d50cf1e7a757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:18.153299 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d1368-a291-4d08-8c3f-d50cf1e7a757 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:18.153572 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d1368-a291-4d08-8c3f-d50cf1e7a757 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:18.153836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d1368-a291-4d08-8c3f-d50cf1e7a757 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:18.163706 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d1368-a291-4d08-8c3f-d50cf1e7a757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-522d1368-a291-4d08-8c3f-d50cf1e7a757 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:00:18.171238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:00:18.172369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:00:18.173976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 590/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 09:00:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:00:18.178648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb1211-bb7e-492d-b4d0-557f10837a1d None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:18.268995 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb1211-bb7e-492d-b4d0-557f10837a1d None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:18.299848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb3f24-cec5-4aa1-bfac-f7edb23c114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:18.300515 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb3f24-cec5-4aa1-bfac-f7edb23c114e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:18.300792 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb3f24-cec5-4aa1-bfac-f7edb23c114e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:18.301060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb3f24-cec5-4aa1-bfac-f7edb23c114e None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:18.301786 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb3f24-cec5-4aa1-bfac-f7edb23c114e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:00:18.302085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb3f24-cec5-4aa1-bfac-f7edb23c114e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:18.303420 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb3f24-cec5-4aa1-bfac-f7edb23c114e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:18.310869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 606/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 09:00:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:18.316632 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d1368-a291-4d08-8c3f-d50cf1e7a757 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:18.411401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d1368-a291-4d08-8c3f-d50cf1e7a757 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:18.441815 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b13093-5f41-401e-95ee-0ba6c8b2880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:18.442602 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b13093-5f41-401e-95ee-0ba6c8b2880f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:18.442878 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b13093-5f41-401e-95ee-0ba6c8b2880f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:18.443142 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b13093-5f41-401e-95ee-0ba6c8b2880f None admin] PATH_INFO: `/v3/users/9fcdc2abe9dd4e6897d78b2c7d21ab8c` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:18.444318 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b13093-5f41-401e-95ee-0ba6c8b2880f None admin] RBAC: Authorizing `identity:get_user(user_id=9fcdc2abe9dd4e6897d78b2c7d21ab8c)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:18.445731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b13093-5f41-401e-95ee-0ba6c8b2880f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:18.447565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 591/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 09:00:18 2022] GET /identity/v3/users/9fcdc2abe9dd4e6897d78b2c7d21ab8c => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:18.453582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb3f24-cec5-4aa1-bfac-f7edb23c114e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:18.547145 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb3f24-cec5-4aa1-bfac-f7edb23c114e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:18.577645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0fd8d-a192-49f3-a928-2147847b0c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:18.578271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0fd8d-a192-49f3-a928-2147847b0c71 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:18.578553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0fd8d-a192-49f3-a928-2147847b0c71 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:18.578830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0fd8d-a192-49f3-a928-2147847b0c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:18.643800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0fd8d-a192-49f3-a928-2147847b0c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:18.645325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0fd8d-a192-49f3-a928-2147847b0c71 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:18.741740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 607/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 09:00:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:00:18.747491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b13093-5f41-401e-95ee-0ba6c8b2880f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:18.840963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b13093-5f41-401e-95ee-0ba6c8b2880f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:18.871636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082e39f-652c-49ea-a4e0-619474b00cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:18.872498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082e39f-652c-49ea-a4e0-619474b00cac None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:18.872777 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082e39f-652c-49ea-a4e0-619474b00cac None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:18.873048 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082e39f-652c-49ea-a4e0-619474b00cac None admin] PATH_INFO: `/v3/projects/645a8289d129417e92a083eeee018b71` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:18.874202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082e39f-652c-49ea-a4e0-619474b00cac None admin] RBAC: Authorizing `identity:get_project(project_id=645a8289d129417e92a083eeee018b71)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:18.875611 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082e39f-652c-49ea-a4e0-619474b00cac None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:18.877786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 592/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 09:00:18 2022] GET /identity/v3/projects/645a8289d129417e92a083eeee018b71 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:00:18.883833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0fd8d-a192-49f3-a928-2147847b0c71 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:00:18.974904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0fd8d-a192-49f3-a928-2147847b0c71 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:00:19.006684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc7382-dd80-4adc-9fae-9d9b32fd17ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:00:19.007311 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7382-dd80-4adc-9fae-9d9b32fd17ad None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:00:19.007591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7382-dd80-4adc-9fae-9d9b32fd17ad None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:00:19.007862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7382-dd80-4adc-9fae-9d9b32fd17ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:00:19.008705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc7382-dd80-4adc-9fae-9d9b32fd17ad None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=645a8289d129417e92a083eeee018b71, user.id=9fcdc2abe9dd4e6897d78b2c7d21ab8c) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:00:19.009014 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc7382-dd80-4adc-9fae-9d9b32fd17ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:00:19.010426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc7382-dd80-4adc-9fae-9d9b32fd17ad None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:00:19.015883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 608/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 09:00:18 2022] GET /identity/v3/role_assignments?user.id=9fcdc2abe9dd4e6897d78b2c7d21ab8c&scope.project.id=645a8289d129417e92a083eeee018b71&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:01:19.659887 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4faf2-adc8-4c24-b464-02f7f132a310 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:19.660492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4faf2-adc8-4c24-b464-02f7f132a310 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:19.660492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4faf2-adc8-4c24-b464-02f7f132a310 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:19.662244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 593/1201] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:01:19.667667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9f33b-a046-463d-a746-622f03a51a8f None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:19.668158 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9f33b-a046-463d-a746-622f03a51a8f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:19.668260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9f33b-a046-463d-a746-622f03a51a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:19.690271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-30d9f33b-a046-463d-a746-622f03a51a8f None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:01:19.691633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-30d9f33b-a046-463d-a746-622f03a51a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:01:19.773440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 609/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:01:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:01:19.799963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4faf2-adc8-4c24-b464-02f7f132a310 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:19.916155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4faf2-adc8-4c24-b464-02f7f132a310 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:19.954595 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0d6e-596c-4188-a89a-38b78026ea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:19.955399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0d6e-596c-4188-a89a-38b78026ea3f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:19.955681 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0d6e-596c-4188-a89a-38b78026ea3f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:19.955953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0d6e-596c-4188-a89a-38b78026ea3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:19.967229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e0d6e-596c-4188-a89a-38b78026ea3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:19.968939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e0d6e-596c-4188-a89a-38b78026ea3f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-cb8e0d6e-596c-4188-a89a-38b78026ea3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:19.988243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:19.989322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:19.990387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:19.990387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:19.990387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:19.990387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:19.992299 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 594/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:19.995583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9f33b-a046-463d-a746-622f03a51a8f None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:20.109714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9f33b-a046-463d-a746-622f03a51a8f None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:20.154906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2206a83-d53f-4e88-a83a-ead79954f6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:20.155580 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2206a83-d53f-4e88-a83a-ead79954f6e6 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:20.155859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2206a83-d53f-4e88-a83a-ead79954f6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:20.156163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2206a83-d53f-4e88-a83a-ead79954f6e6 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:20.156888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2206a83-d53f-4e88-a83a-ead79954f6e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:20.157202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2206a83-d53f-4e88-a83a-ead79954f6e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:20.158571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2206a83-d53f-4e88-a83a-ead79954f6e6 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:20.172400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 610/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:20.177084 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0d6e-596c-4188-a89a-38b78026ea3f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:20.295651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0d6e-596c-4188-a89a-38b78026ea3f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:20.339991 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4b2eb-9a8e-47df-8df3-8cac79a85211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:20.341910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4b2eb-9a8e-47df-8df3-8cac79a85211 None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:20.342186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4b2eb-9a8e-47df-8df3-8cac79a85211 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:20.342458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4b2eb-9a8e-47df-8df3-8cac79a85211 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:20.343192 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4b2eb-9a8e-47df-8df3-8cac79a85211 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:20.344725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4b2eb-9a8e-47df-8df3-8cac79a85211 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:20.367625 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 595/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 09:01:20 2022] POST /identity/v3/users => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:01:22.795209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d46be-1a72-49d9-ad20-d1fe562f6da5 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:22.795791 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d46be-1a72-49d9-ad20-d1fe562f6da5 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:22.795791 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d46be-1a72-49d9-ad20-d1fe562f6da5 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:22.797308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 611/1206] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:01:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:01:22.802781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46363c27-8301-4a2b-8d79-9420333733ce None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:22.803220 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46363c27-8301-4a2b-8d79-9420333733ce None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:22.803371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46363c27-8301-4a2b-8d79-9420333733ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:22.821532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-46363c27-8301-4a2b-8d79-9420333733ce None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:01:22.822710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-46363c27-8301-4a2b-8d79-9420333733ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:01:22.891853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 596/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:01:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:01:22.917549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d46be-1a72-49d9-ad20-d1fe562f6da5 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:23.023404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d46be-1a72-49d9-ad20-d1fe562f6da5 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:23.063198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def9f37-246d-4655-bb4d-2bfd78494bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:23.064379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def9f37-246d-4655-bb4d-2bfd78494bac None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:23.064868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def9f37-246d-4655-bb4d-2bfd78494bac None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:23.065403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def9f37-246d-4655-bb4d-2bfd78494bac None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:23.076111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def9f37-246d-4655-bb4d-2bfd78494bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-8def9f37-246d-4655-bb4d-2bfd78494bac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:01:23.083875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:23.084996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:23.094468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 612/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 09:01:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:23.095211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46363c27-8301-4a2b-8d79-9420333733ce None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:23.193747 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46363c27-8301-4a2b-8d79-9420333733ce None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:23.229814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca901299-6783-4f5b-a3b2-199d3ba0ee8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:23.230494 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca901299-6783-4f5b-a3b2-199d3ba0ee8c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:23.230778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca901299-6783-4f5b-a3b2-199d3ba0ee8c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:23.231050 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca901299-6783-4f5b-a3b2-199d3ba0ee8c None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:23.232404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca901299-6783-4f5b-a3b2-199d3ba0ee8c None admin] RBAC: Adding query filter params (name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:23.232713 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca901299-6783-4f5b-a3b2-199d3ba0ee8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:23.234081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca901299-6783-4f5b-a3b2-199d3ba0ee8c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:23.243410 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 597/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 09:01:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:23.249147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def9f37-246d-4655-bb4d-2bfd78494bac None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:23.355627 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def9f37-246d-4655-bb4d-2bfd78494bac None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:23.389879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b479de-6be0-4595-924a-a64b99b86947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:23.390738 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b479de-6be0-4595-924a-a64b99b86947 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:23.391018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b479de-6be0-4595-924a-a64b99b86947 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:23.391286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b479de-6be0-4595-924a-a64b99b86947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:23.404663 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b479de-6be0-4595-924a-a64b99b86947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:23.406068 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b479de-6be0-4595-924a-a64b99b86947 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-74b479de-6be0-4595-924a-a64b99b86947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:23.423844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:23.425093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:23.429368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:23.429368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:23.429368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:23.429368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:23.429368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 613/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:23.431020 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca901299-6783-4f5b-a3b2-199d3ba0ee8c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:23.543227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca901299-6783-4f5b-a3b2-199d3ba0ee8c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:23.579129 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85eedf-27b8-4a7f-982a-25cae56dedd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:23.579862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85eedf-27b8-4a7f-982a-25cae56dedd4 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:23.580174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85eedf-27b8-4a7f-982a-25cae56dedd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:23.580457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85eedf-27b8-4a7f-982a-25cae56dedd4 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:23.581253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85eedf-27b8-4a7f-982a-25cae56dedd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:23.581634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85eedf-27b8-4a7f-982a-25cae56dedd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:23.583042 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85eedf-27b8-4a7f-982a-25cae56dedd4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:23.596661 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 598/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:23.602264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b479de-6be0-4595-924a-a64b99b86947 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:23.726163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b479de-6be0-4595-924a-a64b99b86947 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:23.763869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bf40c-d4f0-4c57-8689-da29e8db6f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:23.764905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bf40c-d4f0-4c57-8689-da29e8db6f64 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:23.765288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bf40c-d4f0-4c57-8689-da29e8db6f64 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:23.765647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bf40c-d4f0-4c57-8689-da29e8db6f64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:23.774073 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5bf40c-d4f0-4c57-8689-da29e8db6f64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:23.775750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5bf40c-d4f0-4c57-8689-da29e8db6f64 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-0a5bf40c-d4f0-4c57-8689-da29e8db6f64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:01:23.794905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:23.796563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:23.797602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:23.797602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:23.797602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:01:23.797602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:01:23.797602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:01:23.797602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:01:23.797602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:01:23.797602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:01:23.797602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 09:01:23.797602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:23.797602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 614/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:01:23.802455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85eedf-27b8-4a7f-982a-25cae56dedd4 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:23.903210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85eedf-27b8-4a7f-982a-25cae56dedd4 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:23.939226 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00bac1-4de5-4eff-a029-462855332983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:23.939880 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00bac1-4de5-4eff-a029-462855332983 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:23.940182 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00bac1-4de5-4eff-a029-462855332983 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:23.940443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00bac1-4de5-4eff-a029-462855332983 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:23.941267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00bac1-4de5-4eff-a029-462855332983 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:23.941570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00bac1-4de5-4eff-a029-462855332983 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:23.942976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00bac1-4de5-4eff-a029-462855332983 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:23.965921 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 599/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 3 09:01:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:23.967240 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bf40c-d4f0-4c57-8689-da29e8db6f64 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:24.073580 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bf40c-d4f0-4c57-8689-da29e8db6f64 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:24.108832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f6af7-c770-42db-bb5a-ff93eedd96c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:24.109592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f6af7-c770-42db-bb5a-ff93eedd96c4 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:24.109945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f6af7-c770-42db-bb5a-ff93eedd96c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:24.110290 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f6af7-c770-42db-bb5a-ff93eedd96c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:24.186653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f6af7-c770-42db-bb5a-ff93eedd96c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:24.188256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f6af7-c770-42db-bb5a-ff93eedd96c4 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:24.296169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 615/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 09:01:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:01:24.297438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00bac1-4de5-4eff-a029-462855332983 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:24.404061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00bac1-4de5-4eff-a029-462855332983 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:24.440225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848929e-6745-443c-8c61-dcbe5bc783b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:24.441016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848929e-6745-443c-8c61-dcbe5bc783b9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:24.441289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848929e-6745-443c-8c61-dcbe5bc783b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:24.441555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848929e-6745-443c-8c61-dcbe5bc783b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:24.452653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848929e-6745-443c-8c61-dcbe5bc783b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:24.454337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848929e-6745-443c-8c61-dcbe5bc783b9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-3848929e-6745-443c-8c61-dcbe5bc783b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:24.472322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:24.473503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:24.474412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:24.474412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:24.474412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:24.474412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:24.474412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 600/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:24.479392 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f6af7-c770-42db-bb5a-ff93eedd96c4 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:24.588546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f6af7-c770-42db-bb5a-ff93eedd96c4 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:24.623477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2b9d4-1e1e-40da-b9f6-5ed947b1dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:24.624565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2b9d4-1e1e-40da-b9f6-5ed947b1dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:24.625070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2b9d4-1e1e-40da-b9f6-5ed947b1dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:24.625560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2b9d4-1e1e-40da-b9f6-5ed947b1dcb9 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:24.626497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2b9d4-1e1e-40da-b9f6-5ed947b1dcb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:24.627022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2b9d4-1e1e-40da-b9f6-5ed947b1dcb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:24.628619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2b9d4-1e1e-40da-b9f6-5ed947b1dcb9 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:24.646329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 616/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:24.647264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848929e-6745-443c-8c61-dcbe5bc783b9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:24.756156 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848929e-6745-443c-8c61-dcbe5bc783b9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:24.793592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ad246-bcfb-4930-84c7-7c354a937a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:24.795053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ad246-bcfb-4930-84c7-7c354a937a51 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:24.795411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ad246-bcfb-4930-84c7-7c354a937a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:24.795711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ad246-bcfb-4930-84c7-7c354a937a51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:24.803735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ad246-bcfb-4930-84c7-7c354a937a51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:24.805280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ad246-bcfb-4930-84c7-7c354a937a51 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-690ad246-bcfb-4930-84c7-7c354a937a51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:01:24.820490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:24.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:24.822780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:01:24.822780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:01:24.822780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:01:24.822780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:01:24.822780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:01:24.822780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:01:24.822780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:01:24.822780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:24.826435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 601/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 09:01:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:24.828550 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2b9d4-1e1e-40da-b9f6-5ed947b1dcb9 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:24.948399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2b9d4-1e1e-40da-b9f6-5ed947b1dcb9 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:24.991347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c37f6-0238-4abb-a757-f0b63270b7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:24.992042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c37f6-0238-4abb-a757-f0b63270b7d8 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:24.992362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c37f6-0238-4abb-a757-f0b63270b7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:24.992603 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c37f6-0238-4abb-a757-f0b63270b7d8 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:24.993430 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c37f6-0238-4abb-a757-f0b63270b7d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:24.993716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c37f6-0238-4abb-a757-f0b63270b7d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:24.995179 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c37f6-0238-4abb-a757-f0b63270b7d8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:25.008968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 617/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 09:01:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:25.014779 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ad246-bcfb-4930-84c7-7c354a937a51 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:25.122950 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ad246-bcfb-4930-84c7-7c354a937a51 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:25.165262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e2ca3-1c36-4aa2-9448-b6f2d2cc4bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:25.166083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e2ca3-1c36-4aa2-9448-b6f2d2cc4bdf None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:25.166479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e2ca3-1c36-4aa2-9448-b6f2d2cc4bdf None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:25.166739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e2ca3-1c36-4aa2-9448-b6f2d2cc4bdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:25.167634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e2ca3-1c36-4aa2-9448-b6f2d2cc4bdf None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=0f7f2aea3e494546a04e20d8cedccc9c) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:25.167944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e2ca3-1c36-4aa2-9448-b6f2d2cc4bdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:25.170021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e2ca3-1c36-4aa2-9448-b6f2d2cc4bdf None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:25.176380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 602/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 09:01:25 2022] GET /identity/v3/role_assignments?user.id=0f7f2aea3e494546a04e20d8cedccc9c&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:27.472130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5837c7a-884b-4958-830f-91ad11e76d35 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:27.472688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5837c7a-884b-4958-830f-91ad11e76d35 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:27.472688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5837c7a-884b-4958-830f-91ad11e76d35 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:27.473927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 618/1220] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:01:27.479281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d956c7-7347-4e61-bc38-b3bdb67c798d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:27.479687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d956c7-7347-4e61-bc38-b3bdb67c798d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:27.479766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d956c7-7347-4e61-bc38-b3bdb67c798d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:27.496914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-20d956c7-7347-4e61-bc38-b3bdb67c798d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:01:27.498081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-20d956c7-7347-4e61-bc38-b3bdb67c798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:01:27.569644 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 603/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:01:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:01:27.593672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5837c7a-884b-4958-830f-91ad11e76d35 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:27.717947 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5837c7a-884b-4958-830f-91ad11e76d35 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:27.758058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aed716-791c-476f-9ad3-b297c366fd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:27.759063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aed716-791c-476f-9ad3-b297c366fd54 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:27.759440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aed716-791c-476f-9ad3-b297c366fd54 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:27.759718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aed716-791c-476f-9ad3-b297c366fd54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:27.773610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aed716-791c-476f-9ad3-b297c366fd54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-20aed716-791c-476f-9ad3-b297c366fd54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:01:27.783920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:27.785172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:27.786241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 619/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 09:01:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:27.794981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d956c7-7347-4e61-bc38-b3bdb67c798d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:27.898988 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d956c7-7347-4e61-bc38-b3bdb67c798d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:27.933418 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf672ba-4e35-4244-ad7c-80a5e09fa69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:27.934127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf672ba-4e35-4244-ad7c-80a5e09fa69c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:27.934909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf672ba-4e35-4244-ad7c-80a5e09fa69c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:27.935185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf672ba-4e35-4244-ad7c-80a5e09fa69c None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:27.935934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf672ba-4e35-4244-ad7c-80a5e09fa69c None admin] RBAC: Adding query filter params (name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:27.936283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf672ba-4e35-4244-ad7c-80a5e09fa69c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:27.937962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf672ba-4e35-4244-ad7c-80a5e09fa69c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:27.946521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 604/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 09:01:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:27.954132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aed716-791c-476f-9ad3-b297c366fd54 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:28.062024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aed716-791c-476f-9ad3-b297c366fd54 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:28.097017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e71b2-335c-4ef2-ad95-4defcd0049d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:28.097895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e71b2-335c-4ef2-ad95-4defcd0049d9 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:28.098176 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e71b2-335c-4ef2-ad95-4defcd0049d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:28.098445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e71b2-335c-4ef2-ad95-4defcd0049d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:28.109794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e71b2-335c-4ef2-ad95-4defcd0049d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:28.111233 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e71b2-335c-4ef2-ad95-4defcd0049d9 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-ff4e71b2-335c-4ef2-ad95-4defcd0049d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:28.129581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:28.130783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:28.131911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:28.131911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:28.131911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:28.131911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:28.135883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 620/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:28.137003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf672ba-4e35-4244-ad7c-80a5e09fa69c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:28.244465 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf672ba-4e35-4244-ad7c-80a5e09fa69c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:28.282106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42809bbd-3ff1-4aca-8e69-353d9f0320f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:28.282767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42809bbd-3ff1-4aca-8e69-353d9f0320f0 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:28.283079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42809bbd-3ff1-4aca-8e69-353d9f0320f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:28.283358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42809bbd-3ff1-4aca-8e69-353d9f0320f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:28.284130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42809bbd-3ff1-4aca-8e69-353d9f0320f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:28.284443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42809bbd-3ff1-4aca-8e69-353d9f0320f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:28.285890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42809bbd-3ff1-4aca-8e69-353d9f0320f0 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:28.300240 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 605/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:28.306796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e71b2-335c-4ef2-ad95-4defcd0049d9 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:28.415171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e71b2-335c-4ef2-ad95-4defcd0049d9 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:28.449363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50be8b0-2041-4183-988a-451f13ef7f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:28.450340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50be8b0-2041-4183-988a-451f13ef7f35 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:28.450743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50be8b0-2041-4183-988a-451f13ef7f35 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:28.451134 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50be8b0-2041-4183-988a-451f13ef7f35 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:28.458776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50be8b0-2041-4183-988a-451f13ef7f35 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:28.460312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50be8b0-2041-4183-988a-451f13ef7f35 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-e50be8b0-2041-4183-988a-451f13ef7f35 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:01:28.474768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:28.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:28.477549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:28.477549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:28.477549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:01:28.477549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:01:28.477549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:01:28.477549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:01:28.477549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:01:28.477549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:01:28.477549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 09:01:28.477549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:28.477549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 621/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:28.482353 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42809bbd-3ff1-4aca-8e69-353d9f0320f0 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:28.584892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42809bbd-3ff1-4aca-8e69-353d9f0320f0 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:28.618154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a258c-ffb0-42c8-a175-05636d6af43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:28.618860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a258c-ffb0-42c8-a175-05636d6af43c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:28.619179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a258c-ffb0-42c8-a175-05636d6af43c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:28.619453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a258c-ffb0-42c8-a175-05636d6af43c None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:28.620360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a258c-ffb0-42c8-a175-05636d6af43c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:28.620714 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a258c-ffb0-42c8-a175-05636d6af43c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:28.622304 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a258c-ffb0-42c8-a175-05636d6af43c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:28.639589 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 606/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 3 09:01:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:28.645449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50be8b0-2041-4183-988a-451f13ef7f35 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:28.747314 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50be8b0-2041-4183-988a-451f13ef7f35 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:28.781034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e1fde-3791-46cd-a783-0dbc51d3c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:28.781818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e1fde-3791-46cd-a783-0dbc51d3c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:28.782093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e1fde-3791-46cd-a783-0dbc51d3c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:28.782361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e1fde-3791-46cd-a783-0dbc51d3c2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:28.793403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e1fde-3791-46cd-a783-0dbc51d3c2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:28.794832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e1fde-3791-46cd-a783-0dbc51d3c2d6 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-580e1fde-3791-46cd-a783-0dbc51d3c2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:28.811686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:28.812847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:28.814030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:28.814030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:28.814030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:28.814030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:28.814030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 622/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:28.818985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a258c-ffb0-42c8-a175-05636d6af43c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:28.927089 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a258c-ffb0-42c8-a175-05636d6af43c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:28.963406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6ec39-598b-43a4-884f-8b6744aa9de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:28.964063 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6ec39-598b-43a4-884f-8b6744aa9de9 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:28.964368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6ec39-598b-43a4-884f-8b6744aa9de9 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:28.964635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6ec39-598b-43a4-884f-8b6744aa9de9 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:28.965361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6ec39-598b-43a4-884f-8b6744aa9de9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:28.966202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6ec39-598b-43a4-884f-8b6744aa9de9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:28.967985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6ec39-598b-43a4-884f-8b6744aa9de9 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:28.979305 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 607/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:28.984832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e1fde-3791-46cd-a783-0dbc51d3c2d6 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:29.098285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e1fde-3791-46cd-a783-0dbc51d3c2d6 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:29.132193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115303fd-6bdb-45f6-85d9-aa4d320f6c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:29.132985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115303fd-6bdb-45f6-85d9-aa4d320f6c04 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:29.133260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115303fd-6bdb-45f6-85d9-aa4d320f6c04 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:29.133530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115303fd-6bdb-45f6-85d9-aa4d320f6c04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:29.141629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115303fd-6bdb-45f6-85d9-aa4d320f6c04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:29.143060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115303fd-6bdb-45f6-85d9-aa4d320f6c04 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-115303fd-6bdb-45f6-85d9-aa4d320f6c04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:01:29.158622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:29.159718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:29.160691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:01:29.160691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:01:29.160691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:01:29.160691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:01:29.160691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:01:29.160691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:01:29.160691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:01:29.160691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:29.160691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 623/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 09:01:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:29.165617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6ec39-598b-43a4-884f-8b6744aa9de9 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:29.268821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6ec39-598b-43a4-884f-8b6744aa9de9 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:29.305816 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e5a8a-17bb-42b5-ae4b-5582b67cd211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:29.306493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e5a8a-17bb-42b5-ae4b-5582b67cd211 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:29.306792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e5a8a-17bb-42b5-ae4b-5582b67cd211 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:29.307049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e5a8a-17bb-42b5-ae4b-5582b67cd211 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:29.307826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e5a8a-17bb-42b5-ae4b-5582b67cd211 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:29.308157 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e5a8a-17bb-42b5-ae4b-5582b67cd211 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:29.310127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e5a8a-17bb-42b5-ae4b-5582b67cd211 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:29.322229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 608/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 09:01:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:29.328913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115303fd-6bdb-45f6-85d9-aa4d320f6c04 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:29.432824 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115303fd-6bdb-45f6-85d9-aa4d320f6c04 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:29.470807 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c3359-131a-4149-90f7-1ef872238a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:29.471840 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c3359-131a-4149-90f7-1ef872238a45 None admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:29.472170 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c3359-131a-4149-90f7-1ef872238a45 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:29.472508 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c3359-131a-4149-90f7-1ef872238a45 None admin] PATH_INFO: `/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/0f7f2aea3e494546a04e20d8cedccc9c/roles/4bf5d4bd3a884670a5898236973cff13` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:29.487631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c3359-131a-4149-90f7-1ef872238a45 None admin] RBAC: Authorizing `identity:create_grant(project_id=250761bd5a9e48e0b26fedcf65d88a5d, user_id=0f7f2aea3e494546a04e20d8cedccc9c, role_id=4bf5d4bd3a884670a5898236973cff13)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:29.489082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c3359-131a-4149-90f7-1ef872238a45 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:29.501666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 624/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 09:01:29 2022] PUT /identity/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/0f7f2aea3e494546a04e20d8cedccc9c/roles/4bf5d4bd3a884670a5898236973cff13 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:01:31.872352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312a4de-79cf-48db-b476-cf400241ca3c None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:31.872910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312a4de-79cf-48db-b476-cf400241ca3c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:31.872910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312a4de-79cf-48db-b476-cf400241ca3c None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:31.874413 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 609/1233] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:01:31.879749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9c559-d444-4537-b665-08a4b8b046c0 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:31.880293 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9c559-d444-4537-b665-08a4b8b046c0 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:31.880384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9c559-d444-4537-b665-08a4b8b046c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:31.899301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-9dc9c559-d444-4537-b665-08a4b8b046c0 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:01:31.900608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9dc9c559-d444-4537-b665-08a4b8b046c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:01:31.967626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 625/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:01:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:01:31.992668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312a4de-79cf-48db-b476-cf400241ca3c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:32.106666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312a4de-79cf-48db-b476-cf400241ca3c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:32.143731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2144e-dc5d-45c2-87f2-1d11a3801ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:32.144485 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2144e-dc5d-45c2-87f2-1d11a3801ef6 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:32.144795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2144e-dc5d-45c2-87f2-1d11a3801ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:32.145144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2144e-dc5d-45c2-87f2-1d11a3801ef6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:32.158127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2144e-dc5d-45c2-87f2-1d11a3801ef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-10f2144e-dc5d-45c2-87f2-1d11a3801ef6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:01:32.170563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:32.171817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:32.172789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 610/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 09:01:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:32.178736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9c559-d444-4537-b665-08a4b8b046c0 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:32.286953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9c559-d444-4537-b665-08a4b8b046c0 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:32.323551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1eaee-8ed3-4e03-8136-948d45382ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:32.324378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1eaee-8ed3-4e03-8136-948d45382ead None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:32.325247 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1eaee-8ed3-4e03-8136-948d45382ead None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:32.325698 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1eaee-8ed3-4e03-8136-948d45382ead None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:32.326687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1eaee-8ed3-4e03-8136-948d45382ead None admin] RBAC: Adding query filter params (name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:32.327103 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1eaee-8ed3-4e03-8136-948d45382ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:32.328929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1eaee-8ed3-4e03-8136-948d45382ead None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:32.343325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 626/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 09:01:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:01:32.344606 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2144e-dc5d-45c2-87f2-1d11a3801ef6 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:32.445362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2144e-dc5d-45c2-87f2-1d11a3801ef6 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:32.485146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da66b2e-a7e6-4998-9e94-f7cefd2ff34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:32.485948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da66b2e-a7e6-4998-9e94-f7cefd2ff34a None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:32.486249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da66b2e-a7e6-4998-9e94-f7cefd2ff34a None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:32.486522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da66b2e-a7e6-4998-9e94-f7cefd2ff34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:32.499326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da66b2e-a7e6-4998-9e94-f7cefd2ff34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:32.501224 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da66b2e-a7e6-4998-9e94-f7cefd2ff34a None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-8da66b2e-a7e6-4998-9e94-f7cefd2ff34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:32.523869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:32.524893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:32.525793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:32.525793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:32.525793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:32.525793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:32.525793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 611/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:32.533230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1eaee-8ed3-4e03-8136-948d45382ead None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:32.654811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1eaee-8ed3-4e03-8136-948d45382ead None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:32.690009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321439e-203d-4ece-b689-facb82a77ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:32.690669 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321439e-203d-4ece-b689-facb82a77ae3 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:32.690950 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321439e-203d-4ece-b689-facb82a77ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:32.691225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321439e-203d-4ece-b689-facb82a77ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:32.691943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321439e-203d-4ece-b689-facb82a77ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:32.692276 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321439e-203d-4ece-b689-facb82a77ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:32.693974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321439e-203d-4ece-b689-facb82a77ae3 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:32.706174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 627/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:32.711855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da66b2e-a7e6-4998-9e94-f7cefd2ff34a None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:32.824301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da66b2e-a7e6-4998-9e94-f7cefd2ff34a None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:32.857780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e9c83-44a0-40fd-94ab-37f22b90b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:32.858565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9c83-44a0-40fd-94ab-37f22b90b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:32.858849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9c83-44a0-40fd-94ab-37f22b90b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:32.859103 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9c83-44a0-40fd-94ab-37f22b90b0c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:32.866443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e9c83-44a0-40fd-94ab-37f22b90b0c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:32.867865 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e9c83-44a0-40fd-94ab-37f22b90b0c5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-a96e9c83-44a0-40fd-94ab-37f22b90b0c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:01:32.884852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:32.886389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:32.887372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:32.887372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:32.887372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:01:32.887372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:01:32.887372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:01:32.887372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:01:32.887372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:01:32.887372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:01:32.887372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 09:01:32.887372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:32.887372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 612/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:32.892397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321439e-203d-4ece-b689-facb82a77ae3 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:32.998110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321439e-203d-4ece-b689-facb82a77ae3 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:33.033306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c43708-78c1-4c0c-ac1b-8aee23ab42f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:33.033978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c43708-78c1-4c0c-ac1b-8aee23ab42f1 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:33.034254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c43708-78c1-4c0c-ac1b-8aee23ab42f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:33.034523 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c43708-78c1-4c0c-ac1b-8aee23ab42f1 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:33.035343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c43708-78c1-4c0c-ac1b-8aee23ab42f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:33.035646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c43708-78c1-4c0c-ac1b-8aee23ab42f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:33.037079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c43708-78c1-4c0c-ac1b-8aee23ab42f1 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:33.055460 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 628/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 3 09:01:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:33.061314 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e9c83-44a0-40fd-94ab-37f22b90b0c5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:33.169597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e9c83-44a0-40fd-94ab-37f22b90b0c5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:33.203737 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88fae6-eb4a-41ff-b5e9-c5fb98d433c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:33.204405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88fae6-eb4a-41ff-b5e9-c5fb98d433c6 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:33.204687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88fae6-eb4a-41ff-b5e9-c5fb98d433c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:33.204955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88fae6-eb4a-41ff-b5e9-c5fb98d433c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:33.276174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88fae6-eb4a-41ff-b5e9-c5fb98d433c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:33.278932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88fae6-eb4a-41ff-b5e9-c5fb98d433c6 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:33.385651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 613/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 09:01:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:01:33.392440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c43708-78c1-4c0c-ac1b-8aee23ab42f1 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:33.495149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c43708-78c1-4c0c-ac1b-8aee23ab42f1 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:33.529708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5582c-c535-4ad2-b283-ac53b00b03b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:33.530427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5582c-c535-4ad2-b283-ac53b00b03b8 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:33.530701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5582c-c535-4ad2-b283-ac53b00b03b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:33.530972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5582c-c535-4ad2-b283-ac53b00b03b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:33.541676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5582c-c535-4ad2-b283-ac53b00b03b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:33.543433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5582c-c535-4ad2-b283-ac53b00b03b8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-ecc5582c-c535-4ad2-b283-ac53b00b03b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:33.561272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:33.562719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:33.563861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:33.563861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:33.563861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:33.563861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:33.563861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 629/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:33.568768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88fae6-eb4a-41ff-b5e9-c5fb98d433c6 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:33.671603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88fae6-eb4a-41ff-b5e9-c5fb98d433c6 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:33.706074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea985b90-4974-41fd-a616-8745df0290a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:33.706732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea985b90-4974-41fd-a616-8745df0290a6 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:33.707013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea985b90-4974-41fd-a616-8745df0290a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:33.707282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea985b90-4974-41fd-a616-8745df0290a6 None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:33.707997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea985b90-4974-41fd-a616-8745df0290a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:33.708328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea985b90-4974-41fd-a616-8745df0290a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:33.709698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea985b90-4974-41fd-a616-8745df0290a6 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:33.725830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 614/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:33.727150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5582c-c535-4ad2-b283-ac53b00b03b8 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:33.827325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5582c-c535-4ad2-b283-ac53b00b03b8 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:33.864108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60c9cc-42ea-43aa-b312-60243fbcbf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:33.864912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60c9cc-42ea-43aa-b312-60243fbcbf9c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:33.865231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60c9cc-42ea-43aa-b312-60243fbcbf9c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:33.865476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60c9cc-42ea-43aa-b312-60243fbcbf9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:33.872985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60c9cc-42ea-43aa-b312-60243fbcbf9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:33.874419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60c9cc-42ea-43aa-b312-60243fbcbf9c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-6c60c9cc-42ea-43aa-b312-60243fbcbf9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:01:33.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:33.890809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:33.891886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:01:33.891886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:01:33.891886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:01:33.891886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:01:33.891886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:01:33.891886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:01:33.891886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:01:33.891886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:33.895952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 630/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 09:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:33.897344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea985b90-4974-41fd-a616-8745df0290a6 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:34.005699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea985b90-4974-41fd-a616-8745df0290a6 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:34.042187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fc74f-decb-464f-94c5-d384a15662e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:34.042957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fc74f-decb-464f-94c5-d384a15662e4 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:34.043770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fc74f-decb-464f-94c5-d384a15662e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:34.044052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fc74f-decb-464f-94c5-d384a15662e4 None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:34.044885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fc74f-decb-464f-94c5-d384a15662e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:34.045193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fc74f-decb-464f-94c5-d384a15662e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:34.046623 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fc74f-decb-464f-94c5-d384a15662e4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:34.060692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 615/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 09:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:34.067305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60c9cc-42ea-43aa-b312-60243fbcbf9c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:34.179080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60c9cc-42ea-43aa-b312-60243fbcbf9c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:34.215540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ae54f-2a69-4704-adba-328173ed9ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:34.216224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ae54f-2a69-4704-adba-328173ed9ede None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:34.216502 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ae54f-2a69-4704-adba-328173ed9ede None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:34.216777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ae54f-2a69-4704-adba-328173ed9ede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:34.217617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ae54f-2a69-4704-adba-328173ed9ede None admin] RBAC: Adding query filter params (role.id=4bf5d4bd3a884670a5898236973cff13, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=0f7f2aea3e494546a04e20d8cedccc9c) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:34.217898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ae54f-2a69-4704-adba-328173ed9ede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:34.219299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ae54f-2a69-4704-adba-328173ed9ede None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:34.225548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 631/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 09:01:34 2022] GET /identity/v3/role_assignments?user.id=0f7f2aea3e494546a04e20d8cedccc9c&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=4bf5d4bd3a884670a5898236973cff13 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:36.726769 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7dd93-5cce-4d6e-8662-5fa40bede47a None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:36.727536 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7dd93-5cce-4d6e-8662-5fa40bede47a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:36.727536 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7dd93-5cce-4d6e-8662-5fa40bede47a None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:36.728920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 616/1247] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:01:36.734408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198c35-9654-46d1-a7aa-5b3a346da22c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:36.734926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198c35-9654-46d1-a7aa-5b3a346da22c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:36.735018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198c35-9654-46d1-a7aa-5b3a346da22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:36.754491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-25198c35-9654-46d1-a7aa-5b3a346da22c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:01:36.755681 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-25198c35-9654-46d1-a7aa-5b3a346da22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:01:36.820078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 632/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:01:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:01:36.848172 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7dd93-5cce-4d6e-8662-5fa40bede47a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:36.958071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7dd93-5cce-4d6e-8662-5fa40bede47a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:36.995353 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24b9bc-cb6f-42af-a857-8ef2b3ec967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:36.996065 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24b9bc-cb6f-42af-a857-8ef2b3ec967f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:36.996920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24b9bc-cb6f-42af-a857-8ef2b3ec967f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:36.997210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24b9bc-cb6f-42af-a857-8ef2b3ec967f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:37.008467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24b9bc-cb6f-42af-a857-8ef2b3ec967f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-8d24b9bc-cb6f-42af-a857-8ef2b3ec967f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:01:37.018165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:37.019310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:37.020498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 617/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 09:01:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:37.026046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198c35-9654-46d1-a7aa-5b3a346da22c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:37.128215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198c35-9654-46d1-a7aa-5b3a346da22c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:37.162496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768e109-8ad9-4725-b4e9-e6e53c1ff206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:37.163163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768e109-8ad9-4725-b4e9-e6e53c1ff206 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:37.163447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768e109-8ad9-4725-b4e9-e6e53c1ff206 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:37.163716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768e109-8ad9-4725-b4e9-e6e53c1ff206 None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:37.164571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768e109-8ad9-4725-b4e9-e6e53c1ff206 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:37.164884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768e109-8ad9-4725-b4e9-e6e53c1ff206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:37.166346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768e109-8ad9-4725-b4e9-e6e53c1ff206 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:37.175006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 633/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 09:01:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:37.181147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24b9bc-cb6f-42af-a857-8ef2b3ec967f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:37.285890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24b9bc-cb6f-42af-a857-8ef2b3ec967f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:37.320972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c5741-1d80-49ba-9002-d17fd4686749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:37.321753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c5741-1d80-49ba-9002-d17fd4686749 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:37.322030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c5741-1d80-49ba-9002-d17fd4686749 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:37.322293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c5741-1d80-49ba-9002-d17fd4686749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:37.332409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c5741-1d80-49ba-9002-d17fd4686749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:37.333850 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c5741-1d80-49ba-9002-d17fd4686749 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-2f0c5741-1d80-49ba-9002-d17fd4686749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:37.353208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:37.354243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:37.355445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:37.355445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:37.355445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:37.355445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:37.355445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 618/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:01:37.361147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768e109-8ad9-4725-b4e9-e6e53c1ff206 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:37.460940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768e109-8ad9-4725-b4e9-e6e53c1ff206 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:37.494667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcda18-dfdb-4a13-ad3c-6a90ac369928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:37.495338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcda18-dfdb-4a13-ad3c-6a90ac369928 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:37.495620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcda18-dfdb-4a13-ad3c-6a90ac369928 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:37.495897 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcda18-dfdb-4a13-ad3c-6a90ac369928 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:37.496665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcda18-dfdb-4a13-ad3c-6a90ac369928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:37.496971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcda18-dfdb-4a13-ad3c-6a90ac369928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:37.498323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcda18-dfdb-4a13-ad3c-6a90ac369928 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:37.509695 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 634/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:37.515526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c5741-1d80-49ba-9002-d17fd4686749 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:37.631277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c5741-1d80-49ba-9002-d17fd4686749 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:37.666629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e796b5-a8af-4985-abe9-da1076489f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:37.667654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e796b5-a8af-4985-abe9-da1076489f71 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:37.668635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e796b5-a8af-4985-abe9-da1076489f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:37.668918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e796b5-a8af-4985-abe9-da1076489f71 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:37.677194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e796b5-a8af-4985-abe9-da1076489f71 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:37.678654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e796b5-a8af-4985-abe9-da1076489f71 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-c5e796b5-a8af-4985-abe9-da1076489f71 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:01:37.692518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:37.694121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:37.695457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:37.695457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:37.695457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:01:37.695457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:01:37.695457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:01:37.695457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:01:37.695457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:01:37.695457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:01:37.695457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 09:01:37.695457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:37.695457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 619/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:37.700471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcda18-dfdb-4a13-ad3c-6a90ac369928 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:37.803426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcda18-dfdb-4a13-ad3c-6a90ac369928 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:37.838512 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037f8f3-567b-4862-ae86-bb433ece7d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:37.839027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037f8f3-567b-4862-ae86-bb433ece7d19 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:37.839313 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037f8f3-567b-4862-ae86-bb433ece7d19 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:37.839594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037f8f3-567b-4862-ae86-bb433ece7d19 None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:37.841015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037f8f3-567b-4862-ae86-bb433ece7d19 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:37.841341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037f8f3-567b-4862-ae86-bb433ece7d19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:37.842770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037f8f3-567b-4862-ae86-bb433ece7d19 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:37.862276 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 635/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 3 09:01:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:37.867927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e796b5-a8af-4985-abe9-da1076489f71 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:37.974239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e796b5-a8af-4985-abe9-da1076489f71 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:38.006565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3156c-18db-4d1f-b955-ace473f77d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:38.007224 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3156c-18db-4d1f-b955-ace473f77d28 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:38.007499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3156c-18db-4d1f-b955-ace473f77d28 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:38.007766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3156c-18db-4d1f-b955-ace473f77d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:38.076627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3156c-18db-4d1f-b955-ace473f77d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:38.078093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3156c-18db-4d1f-b955-ace473f77d28 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:38.175412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 620/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 09:01:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:01:38.181269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037f8f3-567b-4862-ae86-bb433ece7d19 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:38.280285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037f8f3-567b-4862-ae86-bb433ece7d19 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:38.313340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c118ab-8a30-4f0c-bf04-db00e160491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:38.313999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c118ab-8a30-4f0c-bf04-db00e160491f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:38.314282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c118ab-8a30-4f0c-bf04-db00e160491f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:38.314556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c118ab-8a30-4f0c-bf04-db00e160491f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:38.325108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c118ab-8a30-4f0c-bf04-db00e160491f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:38.326529 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c118ab-8a30-4f0c-bf04-db00e160491f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-19c118ab-8a30-4f0c-bf04-db00e160491f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:38.344440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:38.345583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:38.347043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:38.347043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:38.347043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:38.347043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:38.347043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 636/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:38.352143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3156c-18db-4d1f-b955-ace473f77d28 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:38.447833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3156c-18db-4d1f-b955-ace473f77d28 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:38.481161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d2af2-6dc5-4c46-ad16-139d9d4cd99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:38.481738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d2af2-6dc5-4c46-ad16-139d9d4cd99c None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:38.482013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d2af2-6dc5-4c46-ad16-139d9d4cd99c None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:38.482315 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d2af2-6dc5-4c46-ad16-139d9d4cd99c None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:38.482985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d2af2-6dc5-4c46-ad16-139d9d4cd99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:38.483283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d2af2-6dc5-4c46-ad16-139d9d4cd99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:38.484665 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d2af2-6dc5-4c46-ad16-139d9d4cd99c None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:38.495391 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 621/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:38.501610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c118ab-8a30-4f0c-bf04-db00e160491f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:38.599773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c118ab-8a30-4f0c-bf04-db00e160491f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:38.631771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eea9fc-0a0b-4c3b-8237-c6b206fdd2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:38.632578 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eea9fc-0a0b-4c3b-8237-c6b206fdd2d2 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:38.632856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eea9fc-0a0b-4c3b-8237-c6b206fdd2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:38.633124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eea9fc-0a0b-4c3b-8237-c6b206fdd2d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:38.639359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eea9fc-0a0b-4c3b-8237-c6b206fdd2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:38.640809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eea9fc-0a0b-4c3b-8237-c6b206fdd2d2 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-22eea9fc-0a0b-4c3b-8237-c6b206fdd2d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:01:38.653957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:38.654929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:38.655837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:01:38.655837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:01:38.655837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:01:38.655837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:01:38.655837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:01:38.655837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:01:38.655837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:01:38.655837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:38.655837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 637/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 09:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:38.661007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d2af2-6dc5-4c46-ad16-139d9d4cd99c None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:38.753996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d2af2-6dc5-4c46-ad16-139d9d4cd99c None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:38.784374 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549a39f-eb20-4d28-965e-b965ceac71eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:38.785007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549a39f-eb20-4d28-965e-b965ceac71eb None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:38.785285 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549a39f-eb20-4d28-965e-b965ceac71eb None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:38.785555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549a39f-eb20-4d28-965e-b965ceac71eb None admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:38.786321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549a39f-eb20-4d28-965e-b965ceac71eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:38.786624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549a39f-eb20-4d28-965e-b965ceac71eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:38.788034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549a39f-eb20-4d28-965e-b965ceac71eb None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:38.799897 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 622/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 09:01:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:38.805980 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eea9fc-0a0b-4c3b-8237-c6b206fdd2d2 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:38.899385 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eea9fc-0a0b-4c3b-8237-c6b206fdd2d2 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:38.929651 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffcfd0-5f68-4cab-b049-fc6430aca634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:38.930278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffcfd0-5f68-4cab-b049-fc6430aca634 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:38.930558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffcfd0-5f68-4cab-b049-fc6430aca634 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:38.930829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffcfd0-5f68-4cab-b049-fc6430aca634 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:38.931642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffcfd0-5f68-4cab-b049-fc6430aca634 None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=0f7f2aea3e494546a04e20d8cedccc9c) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:38.931951 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffcfd0-5f68-4cab-b049-fc6430aca634 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:38.933397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffcfd0-5f68-4cab-b049-fc6430aca634 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:38.939011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 638/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 09:01:38 2022] GET /identity/v3/role_assignments?user.id=0f7f2aea3e494546a04e20d8cedccc9c&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:41.118052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647145-3760-4954-8083-0564132e42de None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:41.118609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647145-3760-4954-8083-0564132e42de None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:41.118609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647145-3760-4954-8083-0564132e42de None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:41.119926 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 623/1261] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:01:41.125646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4aea5-b3ff-4fa1-909e-fd9002229065 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:41.126041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4aea5-b3ff-4fa1-909e-fd9002229065 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:41.126191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4aea5-b3ff-4fa1-909e-fd9002229065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:41.142737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-28e4aea5-b3ff-4fa1-909e-fd9002229065 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:01:41.143888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-28e4aea5-b3ff-4fa1-909e-fd9002229065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:01:41.204860 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 639/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:01:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:01:41.226976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01647145-3760-4954-8083-0564132e42de None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:41.320641 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01647145-3760-4954-8083-0564132e42de None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:41.351920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5391a60-235a-4eae-b927-9bfd070443c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:41.352711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5391a60-235a-4eae-b927-9bfd070443c5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:41.352987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5391a60-235a-4eae-b927-9bfd070443c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:41.353253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5391a60-235a-4eae-b927-9bfd070443c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:41.362702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5391a60-235a-4eae-b927-9bfd070443c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-f5391a60-235a-4eae-b927-9bfd070443c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:01:41.370256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:41.371890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:41.373133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 624/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 09:01:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:41.377741 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4aea5-b3ff-4fa1-909e-fd9002229065 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:41.469154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4aea5-b3ff-4fa1-909e-fd9002229065 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:41.500975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba5760-a7a7-42d6-91ab-f42c48457e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:41.501622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba5760-a7a7-42d6-91ab-f42c48457e4e None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:41.501900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba5760-a7a7-42d6-91ab-f42c48457e4e None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:41.502171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba5760-a7a7-42d6-91ab-f42c48457e4e None admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:41.502902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba5760-a7a7-42d6-91ab-f42c48457e4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:41.503203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba5760-a7a7-42d6-91ab-f42c48457e4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:41.504589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba5760-a7a7-42d6-91ab-f42c48457e4e None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:41.512081 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 640/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 09:01:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:41.518172 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5391a60-235a-4eae-b927-9bfd070443c5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:41.620906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5391a60-235a-4eae-b927-9bfd070443c5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:41.651802 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf594-d733-43af-ac73-949642693a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:41.652632 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf594-d733-43af-ac73-949642693a31 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:41.652946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf594-d733-43af-ac73-949642693a31 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:41.653216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf594-d733-43af-ac73-949642693a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:41.663328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcf594-d733-43af-ac73-949642693a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:41.664808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcf594-d733-43af-ac73-949642693a31 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-60dcf594-d733-43af-ac73-949642693a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:41.681515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:41.682607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:41.684404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:41.684404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:41.684404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:41.684404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:41.684404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 625/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:41.689203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba5760-a7a7-42d6-91ab-f42c48457e4e None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:41.780603 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba5760-a7a7-42d6-91ab-f42c48457e4e None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:41.811484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff8eb9-016e-4ca6-8df6-820367834cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:41.812151 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff8eb9-016e-4ca6-8df6-820367834cb5 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:41.812432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff8eb9-016e-4ca6-8df6-820367834cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:41.812698 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff8eb9-016e-4ca6-8df6-820367834cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:41.813396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff8eb9-016e-4ca6-8df6-820367834cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:41.813694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff8eb9-016e-4ca6-8df6-820367834cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:41.815022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff8eb9-016e-4ca6-8df6-820367834cb5 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:41.826110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 641/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:41.831706 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf594-d733-43af-ac73-949642693a31 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:41.924248 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf594-d733-43af-ac73-949642693a31 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:41.954697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdca29-94e2-4853-93f6-e0c3bf40a594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:41.955463 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdca29-94e2-4853-93f6-e0c3bf40a594 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:41.955742 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdca29-94e2-4853-93f6-e0c3bf40a594 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:41.956012 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdca29-94e2-4853-93f6-e0c3bf40a594 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:41.962997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdca29-94e2-4853-93f6-e0c3bf40a594 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:41.964438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdca29-94e2-4853-93f6-e0c3bf40a594 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-aafdca29-94e2-4853-93f6-e0c3bf40a594 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:01:41.979567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:41.981251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:41.982886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:41.982886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:41.982886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:01:41.982886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:01:41.982886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:01:41.982886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:01:41.982886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:01:41.982886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:01:41.982886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 09:01:41.982886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:41.982886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 626/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:41.986914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff8eb9-016e-4ca6-8df6-820367834cb5 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:42.077443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff8eb9-016e-4ca6-8df6-820367834cb5 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:42.108773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4562d-a468-48d0-923f-ec0875c8958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:42.109412 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4562d-a468-48d0-923f-ec0875c8958c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:42.109690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4562d-a468-48d0-923f-ec0875c8958c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:42.109960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4562d-a468-48d0-923f-ec0875c8958c None admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:42.110773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4562d-a468-48d0-923f-ec0875c8958c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:42.111073 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4562d-a468-48d0-923f-ec0875c8958c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:42.112502 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4562d-a468-48d0-923f-ec0875c8958c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:42.128038 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 642/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 3 09:01:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:42.133381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdca29-94e2-4853-93f6-e0c3bf40a594 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:42.227413 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdca29-94e2-4853-93f6-e0c3bf40a594 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:42.258211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f9dbf-c8bd-4d80-b5f6-a1e4d3531be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:42.258980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f9dbf-c8bd-4d80-b5f6-a1e4d3531be5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:42.259258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f9dbf-c8bd-4d80-b5f6-a1e4d3531be5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:42.259529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f9dbf-c8bd-4d80-b5f6-a1e4d3531be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:42.270031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f9dbf-c8bd-4d80-b5f6-a1e4d3531be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:42.271451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f9dbf-c8bd-4d80-b5f6-a1e4d3531be5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-158f9dbf-c8bd-4d80-b5f6-a1e4d3531be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:42.288189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:42.289275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:42.290446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:42.290446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:42.290446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:42.290446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:42.290446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 627/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:42.295065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4562d-a468-48d0-923f-ec0875c8958c None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:42.400564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4562d-a468-48d0-923f-ec0875c8958c None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:42.434095 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62888531-1126-4b2e-aea5-2c2895676e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:42.434743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62888531-1126-4b2e-aea5-2c2895676e03 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:42.435013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62888531-1126-4b2e-aea5-2c2895676e03 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:42.435276 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62888531-1126-4b2e-aea5-2c2895676e03 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:42.435974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62888531-1126-4b2e-aea5-2c2895676e03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:42.436300 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62888531-1126-4b2e-aea5-2c2895676e03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:42.437630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62888531-1126-4b2e-aea5-2c2895676e03 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:42.448190 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 643/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:42.454365 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f9dbf-c8bd-4d80-b5f6-a1e4d3531be5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:42.549678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f9dbf-c8bd-4d80-b5f6-a1e4d3531be5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:42.581555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bab17-a080-4817-8478-890eb80b93f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:42.582358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bab17-a080-4817-8478-890eb80b93f5 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:42.582632 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bab17-a080-4817-8478-890eb80b93f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:42.582897 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bab17-a080-4817-8478-890eb80b93f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:42.589146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bab17-a080-4817-8478-890eb80b93f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:42.591276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bab17-a080-4817-8478-890eb80b93f5 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-599bab17-a080-4817-8478-890eb80b93f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:01:42.604861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:42.605933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:42.611573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:01:42.611573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:01:42.611573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:01:42.611573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:01:42.611573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:01:42.611573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:01:42.611573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:01:42.611573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:42.611573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 628/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 09:01:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:42.612079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62888531-1126-4b2e-aea5-2c2895676e03 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:42.714535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62888531-1126-4b2e-aea5-2c2895676e03 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:42.745143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e1a14-2cee-4e3b-9d37-4b223eefdac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:42.746316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e1a14-2cee-4e3b-9d37-4b223eefdac8 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:42.746594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e1a14-2cee-4e3b-9d37-4b223eefdac8 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:42.746862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e1a14-2cee-4e3b-9d37-4b223eefdac8 None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:42.747628 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e1a14-2cee-4e3b-9d37-4b223eefdac8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:42.747928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e1a14-2cee-4e3b-9d37-4b223eefdac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:42.749354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e1a14-2cee-4e3b-9d37-4b223eefdac8 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:42.760504 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 644/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 09:01:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:42.767003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bab17-a080-4817-8478-890eb80b93f5 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:42.858795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bab17-a080-4817-8478-890eb80b93f5 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:42.891459 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c1426-f03a-4d62-adad-812411ceaedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:42.892334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c1426-f03a-4d62-adad-812411ceaedf None admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:42.892609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c1426-f03a-4d62-adad-812411ceaedf None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:42.892871 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c1426-f03a-4d62-adad-812411ceaedf None admin] PATH_INFO: `/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/0f7f2aea3e494546a04e20d8cedccc9c/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:42.894760 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c1426-f03a-4d62-adad-812411ceaedf None admin] RBAC: Authorizing `identity:create_grant(project_id=250761bd5a9e48e0b26fedcf65d88a5d, user_id=0f7f2aea3e494546a04e20d8cedccc9c, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:42.896181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c1426-f03a-4d62-adad-812411ceaedf None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:42.908001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 629/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 09:01:42 2022] PUT /identity/v3/projects/250761bd5a9e48e0b26fedcf65d88a5d/users/0f7f2aea3e494546a04e20d8cedccc9c/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:01:45.097164 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ca54c-8597-47aa-8595-3cbfef0dd74a None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:45.097696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ca54c-8597-47aa-8595-3cbfef0dd74a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:45.097696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ca54c-8597-47aa-8595-3cbfef0dd74a None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:45.099058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 645/1274] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:01:45.104001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d011e28-b779-4896-b1e6-51d0e3e1c054 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:45.104389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d011e28-b779-4896-b1e6-51d0e3e1c054 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:45.104573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d011e28-b779-4896-b1e6-51d0e3e1c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:45.121206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5d011e28-b779-4896-b1e6-51d0e3e1c054 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:01:45.122356 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5d011e28-b779-4896-b1e6-51d0e3e1c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:01:45.182947 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 630/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:01:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:01:45.206474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ca54c-8597-47aa-8595-3cbfef0dd74a None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:45.300166 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ca54c-8597-47aa-8595-3cbfef0dd74a None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:45.331374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c3ddc-752b-4075-b3f6-78321fe2edbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:45.332168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c3ddc-752b-4075-b3f6-78321fe2edbe None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:45.332450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c3ddc-752b-4075-b3f6-78321fe2edbe None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:45.332720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c3ddc-752b-4075-b3f6-78321fe2edbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:45.342717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c3ddc-752b-4075-b3f6-78321fe2edbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-750c3ddc-752b-4075-b3f6-78321fe2edbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:01:45.350285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:45.351432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:45.352332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 646/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 09:01:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:45.357305 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d011e28-b779-4896-b1e6-51d0e3e1c054 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:45.446965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d011e28-b779-4896-b1e6-51d0e3e1c054 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:45.478572 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f5f53-5bb7-462d-b8e8-5b905e8b3a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:45.479208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5f53-5bb7-462d-b8e8-5b905e8b3a83 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:45.479481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5f53-5bb7-462d-b8e8-5b905e8b3a83 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:45.479749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5f53-5bb7-462d-b8e8-5b905e8b3a83 None admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:45.480530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f5f53-5bb7-462d-b8e8-5b905e8b3a83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:45.480824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f5f53-5bb7-462d-b8e8-5b905e8b3a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:45.482168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f5f53-5bb7-462d-b8e8-5b905e8b3a83 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:45.489603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 631/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 09:01:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:45.495077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c3ddc-752b-4075-b3f6-78321fe2edbe None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:45.596369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c3ddc-752b-4075-b3f6-78321fe2edbe None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:45.627075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334b185-e5c2-45b4-abd6-86ccdd8aeadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:45.627787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334b185-e5c2-45b4-abd6-86ccdd8aeadc None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:45.628062 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334b185-e5c2-45b4-abd6-86ccdd8aeadc None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:45.628361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334b185-e5c2-45b4-abd6-86ccdd8aeadc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:45.639368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334b185-e5c2-45b4-abd6-86ccdd8aeadc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:45.640814 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334b185-e5c2-45b4-abd6-86ccdd8aeadc None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-c334b185-e5c2-45b4-abd6-86ccdd8aeadc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:45.657050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:45.658120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:45.659467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:45.659467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:45.659467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:45.659467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:45.659467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 647/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:01:45.664006 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f5f53-5bb7-462d-b8e8-5b905e8b3a83 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:45.756730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f5f53-5bb7-462d-b8e8-5b905e8b3a83 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:45.787587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799b8f4-e591-4f93-97e0-e0056e9b225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:45.788252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799b8f4-e591-4f93-97e0-e0056e9b225f None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:45.788528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799b8f4-e591-4f93-97e0-e0056e9b225f None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:45.788795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799b8f4-e591-4f93-97e0-e0056e9b225f None admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:45.789499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799b8f4-e591-4f93-97e0-e0056e9b225f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:45.789796 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799b8f4-e591-4f93-97e0-e0056e9b225f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:45.791132 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799b8f4-e591-4f93-97e0-e0056e9b225f None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:45.802080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 632/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:45.807685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334b185-e5c2-45b4-abd6-86ccdd8aeadc None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:45.900595 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334b185-e5c2-45b4-abd6-86ccdd8aeadc None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:45.930599 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04f773-cf4b-4e2a-aec8-95c1940dd95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:45.931369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f773-cf4b-4e2a-aec8-95c1940dd95d None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:45.931647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f773-cf4b-4e2a-aec8-95c1940dd95d None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:45.931917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f773-cf4b-4e2a-aec8-95c1940dd95d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:45.939778 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04f773-cf4b-4e2a-aec8-95c1940dd95d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:45.941692 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04f773-cf4b-4e2a-aec8-95c1940dd95d None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-dc04f773-cf4b-4e2a-aec8-95c1940dd95d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:01:45.956647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:45.957967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:45.959362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:45.959362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:45.959362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:01:45.959362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:01:45.959362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:01:45.959362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:01:45.959362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:01:45.959362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:01:45.959362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 09:01:45.959362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:45.959362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 648/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:45.963817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799b8f4-e591-4f93-97e0-e0056e9b225f None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:46.057966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799b8f4-e591-4f93-97e0-e0056e9b225f None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:46.089958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f5164-7533-4a59-b762-0cad485386d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:46.090615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f5164-7533-4a59-b762-0cad485386d1 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:46.090894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f5164-7533-4a59-b762-0cad485386d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:46.091163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f5164-7533-4a59-b762-0cad485386d1 None admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:46.091982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f5164-7533-4a59-b762-0cad485386d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:46.092316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f5164-7533-4a59-b762-0cad485386d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:46.093729 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f5164-7533-4a59-b762-0cad485386d1 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:46.110215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 633/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 3 09:01:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:46.115809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04f773-cf4b-4e2a-aec8-95c1940dd95d None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:46.207167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04f773-cf4b-4e2a-aec8-95c1940dd95d None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:46.237993 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df318ca-bf9b-4fa6-92dc-63874f83cd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:46.238623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df318ca-bf9b-4fa6-92dc-63874f83cd8f None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:46.238900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df318ca-bf9b-4fa6-92dc-63874f83cd8f None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:46.239170 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df318ca-bf9b-4fa6-92dc-63874f83cd8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:46.301278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df318ca-bf9b-4fa6-92dc-63874f83cd8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:46.302713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df318ca-bf9b-4fa6-92dc-63874f83cd8f None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:46.393560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 649/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 09:01:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:01:46.399251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f5164-7533-4a59-b762-0cad485386d1 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:46.491210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f5164-7533-4a59-b762-0cad485386d1 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:46.524363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41c551-5d5e-4dd5-8594-9c69c31df8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:46.525190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41c551-5d5e-4dd5-8594-9c69c31df8f4 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:46.525533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41c551-5d5e-4dd5-8594-9c69c31df8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:46.525833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41c551-5d5e-4dd5-8594-9c69c31df8f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:46.537577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41c551-5d5e-4dd5-8594-9c69c31df8f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:46.539002 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41c551-5d5e-4dd5-8594-9c69c31df8f4 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-6f41c551-5d5e-4dd5-8594-9c69c31df8f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:01:46.556924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:46.557997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:46.559297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:01:46.559297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:01:46.559297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:01:46.559297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:46.559297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 634/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:46.563706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df318ca-bf9b-4fa6-92dc-63874f83cd8f None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:46.661495 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df318ca-bf9b-4fa6-92dc-63874f83cd8f None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:46.692878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34eae2-cfc6-4dd4-9391-f12c4ab42108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:46.693523 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34eae2-cfc6-4dd4-9391-f12c4ab42108 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:46.693802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34eae2-cfc6-4dd4-9391-f12c4ab42108 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:46.694074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34eae2-cfc6-4dd4-9391-f12c4ab42108 None admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:46.694785 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34eae2-cfc6-4dd4-9391-f12c4ab42108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:46.695089 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34eae2-cfc6-4dd4-9391-f12c4ab42108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:46.696452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34eae2-cfc6-4dd4-9391-f12c4ab42108 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:46.707290 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 650/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 09:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:46.712900 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41c551-5d5e-4dd5-8594-9c69c31df8f4 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:46.804915 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41c551-5d5e-4dd5-8594-9c69c31df8f4 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:46.836540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbb3f3-c9d7-4d22-a4a1-4e59907eda36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:46.837295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbb3f3-c9d7-4d22-a4a1-4e59907eda36 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:46.837566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbb3f3-c9d7-4d22-a4a1-4e59907eda36 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:46.837826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbb3f3-c9d7-4d22-a4a1-4e59907eda36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:46.844073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbb3f3-c9d7-4d22-a4a1-4e59907eda36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:46.845511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbb3f3-c9d7-4d22-a4a1-4e59907eda36 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application [None req-52fbb3f3-c9d7-4d22-a4a1-4e59907eda36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:01:46.859181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application with Lock( May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:46.860243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:46.861179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:01:46.861179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:01:46.861179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:01:46.861179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:01:46.861179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:01:46.861179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:01:46.861179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:01:46.861179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: ERROR keystone.server.flask.application May 03 09:01:46.861179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 635/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 09:01:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:46.866240 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34eae2-cfc6-4dd4-9391-f12c4ab42108 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:46.962031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34eae2-cfc6-4dd4-9391-f12c4ab42108 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:46.993033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ceb8e-5f8b-4516-972b-5969dd9a0ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:46.993674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ceb8e-5f8b-4516-972b-5969dd9a0ebb None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:46.993952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ceb8e-5f8b-4516-972b-5969dd9a0ebb None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:46.994224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ceb8e-5f8b-4516-972b-5969dd9a0ebb None admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:46.994997 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ceb8e-5f8b-4516-972b-5969dd9a0ebb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:46.995301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ceb8e-5f8b-4516-972b-5969dd9a0ebb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:46.997316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ceb8e-5f8b-4516-972b-5969dd9a0ebb None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:47.008616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 651/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 09:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:47.015534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbb3f3-c9d7-4d22-a4a1-4e59907eda36 None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:47.110628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbb3f3-c9d7-4d22-a4a1-4e59907eda36 None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:47.141500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dfac3-a85d-404d-8c9c-4c48e6e0b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:47.142127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dfac3-a85d-404d-8c9c-4c48e6e0b7f8 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:47.142408 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dfac3-a85d-404d-8c9c-4c48e6e0b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:47.142681 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dfac3-a85d-404d-8c9c-4c48e6e0b7f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:47.143495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dfac3-a85d-404d-8c9c-4c48e6e0b7f8 None admin] RBAC: Adding query filter params (role.id=dfb05bc227d24cfe80ee68af75de7d1e, scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d, user.id=0f7f2aea3e494546a04e20d8cedccc9c) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:47.143802 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dfac3-a85d-404d-8c9c-4c48e6e0b7f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:47.145248 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dfac3-a85d-404d-8c9c-4c48e6e0b7f8 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:47.150786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 636/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 09:01:47 2022] GET /identity/v3/role_assignments?user.id=0f7f2aea3e494546a04e20d8cedccc9c&scope.project.id=250761bd5a9e48e0b26fedcf65d88a5d&role.id=dfb05bc227d24cfe80ee68af75de7d1e => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:49.392812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91b0d6-d5a9-4cce-bb57-4ffbb76f305c None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:49.393350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91b0d6-d5a9-4cce-bb57-4ffbb76f305c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:49.393350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91b0d6-d5a9-4cce-bb57-4ffbb76f305c None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:49.394707 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 652/1288] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:01:49.399653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d2223-ae81-412f-a307-95ddfa1828b1 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:49.400111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d2223-ae81-412f-a307-95ddfa1828b1 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:49.400223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d2223-ae81-412f-a307-95ddfa1828b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:49.416806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-b32d2223-ae81-412f-a307-95ddfa1828b1 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:01:49.418561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b32d2223-ae81-412f-a307-95ddfa1828b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:01:49.480655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 637/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:01:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:01:49.501918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91b0d6-d5a9-4cce-bb57-4ffbb76f305c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:49.616075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91b0d6-d5a9-4cce-bb57-4ffbb76f305c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:49.647226 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10ca69-e7ad-4464-a048-51c13ca295d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:49.648006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10ca69-e7ad-4464-a048-51c13ca295d6 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:49.648311 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10ca69-e7ad-4464-a048-51c13ca295d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:49.648582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10ca69-e7ad-4464-a048-51c13ca295d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:49.649222 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10ca69-e7ad-4464-a048-51c13ca295d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:49.650576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10ca69-e7ad-4464-a048-51c13ca295d6 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-ba10ca69-e7ad-4464-a048-51c13ca295d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:49.662494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:49.663712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:49.664874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 653/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 09:01:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:49.670656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d2223-ae81-412f-a307-95ddfa1828b1 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:49.763486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d2223-ae81-412f-a307-95ddfa1828b1 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:49.794914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d15987-8ccf-4367-8fb7-dc017d2d2628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:49.795552 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d15987-8ccf-4367-8fb7-dc017d2d2628 None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:49.795832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d15987-8ccf-4367-8fb7-dc017d2d2628 None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:49.796112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d15987-8ccf-4367-8fb7-dc017d2d2628 None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:49.796817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d15987-8ccf-4367-8fb7-dc017d2d2628 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:49.797115 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d15987-8ccf-4367-8fb7-dc017d2d2628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:49.798448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d15987-8ccf-4367-8fb7-dc017d2d2628 None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:49.802959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 638/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Tue May 3 09:01:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:49.808693 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10ca69-e7ad-4464-a048-51c13ca295d6 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:49.900111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10ca69-e7ad-4464-a048-51c13ca295d6 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:49.930842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23bd89-1f68-4f13-861a-a1b9ebc31c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:49.931474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23bd89-1f68-4f13-861a-a1b9ebc31c5c None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:49.931754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23bd89-1f68-4f13-861a-a1b9ebc31c5c None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:49.932026 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23bd89-1f68-4f13-861a-a1b9ebc31c5c None admin] PATH_INFO: `/v3/services` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:49.932753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23bd89-1f68-4f13-861a-a1b9ebc31c5c None admin] RBAC: Adding query filter params (type=placement) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:49.933081 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23bd89-1f68-4f13-861a-a1b9ebc31c5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:49.934416 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23bd89-1f68-4f13-861a-a1b9ebc31c5c None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:49.938540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 654/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Tue May 3 09:01:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:52.124319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617996e-1367-4b65-8469-3d46f5c2580d None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:52.124849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617996e-1367-4b65-8469-3d46f5c2580d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:52.124849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617996e-1367-4b65-8469-3d46f5c2580d None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:52.126183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 639/1293] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:01:52.131274 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c579c3-4602-48e4-8123-eafb10bb37f7 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:52.131654 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c579c3-4602-48e4-8123-eafb10bb37f7 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:52.131832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c579c3-4602-48e4-8123-eafb10bb37f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:52.147891 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-77c579c3-4602-48e4-8123-eafb10bb37f7 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:01:52.149094 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-77c579c3-4602-48e4-8123-eafb10bb37f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:01:52.210524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 655/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:01:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:01:52.233473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617996e-1367-4b65-8469-3d46f5c2580d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:52.327832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617996e-1367-4b65-8469-3d46f5c2580d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:52.359428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d153be-49f3-4e0c-8aee-9f84dd45ccbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:52.360055 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d153be-49f3-4e0c-8aee-9f84dd45ccbb None admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:52.360359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d153be-49f3-4e0c-8aee-9f84dd45ccbb None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:52.360628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d153be-49f3-4e0c-8aee-9f84dd45ccbb None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:52.361339 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d153be-49f3-4e0c-8aee-9f84dd45ccbb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:52.362679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d153be-49f3-4e0c-8aee-9f84dd45ccbb None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:52.375025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 640/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 09:01:52 2022] POST /identity/v3/services => generated 246 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:01:54.585922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd8158-2567-4de7-ae53-c03238b44590 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:54.586451 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd8158-2567-4de7-ae53-c03238b44590 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:54.586543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd8158-2567-4de7-ae53-c03238b44590 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:54.587975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 656/1296] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:01:54.595088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa55a22-651e-4132-b6e8-76320d3dd2e7 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:54.595502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa55a22-651e-4132-b6e8-76320d3dd2e7 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:54.595647 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa55a22-651e-4132-b6e8-76320d3dd2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:54.614946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-9fa55a22-651e-4132-b6e8-76320d3dd2e7 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:01:54.616266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9fa55a22-651e-4132-b6e8-76320d3dd2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:01:54.685432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 641/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:01:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:01:54.707500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd8158-2567-4de7-ae53-c03238b44590 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:54.801737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd8158-2567-4de7-ae53-c03238b44590 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:54.832818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853ba71-c533-4621-a6bf-d26624c0e1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:54.833598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ba71-c533-4621-a6bf-d26624c0e1cd None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:54.833877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ba71-c533-4621-a6bf-d26624c0e1cd None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:54.834148 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ba71-c533-4621-a6bf-d26624c0e1cd None admin] PATH_INFO: `/v3/services/placement` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:54.834791 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853ba71-c533-4621-a6bf-d26624c0e1cd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:54.836220 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853ba71-c533-4621-a6bf-d26624c0e1cd None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-4853ba71-c533-4621-a6bf-d26624c0e1cd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:54.848092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:54.849292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:54.850369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 657/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 09:01:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:01:54.855494 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa55a22-651e-4132-b6e8-76320d3dd2e7 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:54.947296 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa55a22-651e-4132-b6e8-76320d3dd2e7 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:54.978609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c39639-7bc8-418b-a825-24bb349d23ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:54.979250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c39639-7bc8-418b-a825-24bb349d23ff None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:54.980070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c39639-7bc8-418b-a825-24bb349d23ff None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:54.980370 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c39639-7bc8-418b-a825-24bb349d23ff None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:54.981064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c39639-7bc8-418b-a825-24bb349d23ff None admin] RBAC: Adding query filter params (name=placement) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:54.981374 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c39639-7bc8-418b-a825-24bb349d23ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:54.982723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c39639-7bc8-418b-a825-24bb349d23ff None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:54.987602 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 642/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Tue May 3 09:01:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:54.993517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853ba71-c533-4621-a6bf-d26624c0e1cd None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:55.085794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853ba71-c533-4621-a6bf-d26624c0e1cd None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:55.116773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae54f0d-80d0-4940-8914-7b1fa116b3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:55.117350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae54f0d-80d0-4940-8914-7b1fa116b3dc None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:55.117629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae54f0d-80d0-4940-8914-7b1fa116b3dc None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:55.117902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae54f0d-80d0-4940-8914-7b1fa116b3dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:55.118671 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae54f0d-80d0-4940-8914-7b1fa116b3dc None admin] RBAC: Adding query filter params (interface=public, service_id=02626dc8c2224732bf03c9e146f52d34, region_id=RegionOne) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:55.118979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae54f0d-80d0-4940-8914-7b1fa116b3dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:55.120924 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae54f0d-80d0-4940-8914-7b1fa116b3dc None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:55.125606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 658/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 09:01:54 2022] GET /identity/v3/endpoints?service_id=02626dc8c2224732bf03c9e146f52d34&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:55.131033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c39639-7bc8-418b-a825-24bb349d23ff None admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:55.222188 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c39639-7bc8-418b-a825-24bb349d23ff None admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:55.254365 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130dd80-9c55-49f0-964f-0fe45f282ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:55.255006 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130dd80-9c55-49f0-964f-0fe45f282ebd None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:55.255287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130dd80-9c55-49f0-964f-0fe45f282ebd None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:55.255558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130dd80-9c55-49f0-964f-0fe45f282ebd None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:55.256265 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130dd80-9c55-49f0-964f-0fe45f282ebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:55.257613 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130dd80-9c55-49f0-964f-0fe45f282ebd None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:55.264155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 643/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 09:01:55 2022] GET /identity/v3/services => generated 2191 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:01:57.458252 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00ac1-dbf2-474b-9e34-7f9fdd01ca41 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:57.458808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00ac1-dbf2-474b-9e34-7f9fdd01ca41 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:57.458808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00ac1-dbf2-474b-9e34-7f9fdd01ca41 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:57.460169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 659/1302] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:01:57.465770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75466046-b404-4fa3-b9d8-ec66cda85804 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:57.466203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75466046-b404-4fa3-b9d8-ec66cda85804 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:57.466310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75466046-b404-4fa3-b9d8-ec66cda85804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:57.482380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-75466046-b404-4fa3-b9d8-ec66cda85804 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:01:57.483485 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-75466046-b404-4fa3-b9d8-ec66cda85804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:01:57.544827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 644/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:01:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:01:57.567221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada00ac1-dbf2-474b-9e34-7f9fdd01ca41 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:57.663156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada00ac1-dbf2-474b-9e34-7f9fdd01ca41 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:57.694508 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b27d45-ec2d-4062-9c02-f31d5197b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:57.695285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b27d45-ec2d-4062-9c02-f31d5197b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:57.695559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b27d45-ec2d-4062-9c02-f31d5197b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:57.695825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b27d45-ec2d-4062-9c02-f31d5197b5b1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:57.696496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b27d45-ec2d-4062-9c02-f31d5197b5b1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:57.697829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b27d45-ec2d-4062-9c02-f31d5197b5b1 None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application [None req-e4b27d45-ec2d-4062-9c02-f31d5197b5b1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:01:57.709630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:01:57.710806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application with Lock( May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self._enter() May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application return self.creator() May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application created_value = creator( May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: ERROR keystone.server.flask.application May 03 09:01:57.711933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 660/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 09:01:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:01:57.716768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75466046-b404-4fa3-b9d8-ec66cda85804 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:57.807144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75466046-b404-4fa3-b9d8-ec66cda85804 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:57.839347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01cbfa-9f55-41ee-8784-bbc5d3595abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:57.839982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01cbfa-9f55-41ee-8784-bbc5d3595abd None admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:57.840288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01cbfa-9f55-41ee-8784-bbc5d3595abd None admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:57.840566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01cbfa-9f55-41ee-8784-bbc5d3595abd None admin] PATH_INFO: `/v3/services` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:57.841258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01cbfa-9f55-41ee-8784-bbc5d3595abd None admin] RBAC: Adding query filter params (name=placement) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:01:57.841558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01cbfa-9f55-41ee-8784-bbc5d3595abd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:57.842902 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01cbfa-9f55-41ee-8784-bbc5d3595abd None admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:57.847723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 645/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Tue May 3 09:01:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:01:57.853279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b27d45-ec2d-4062-9c02-f31d5197b5b1 None admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:01:57.945850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b27d45-ec2d-4062-9c02-f31d5197b5b1 None admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:01:57.980422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce9c04-3a13-4ed5-84fc-3018afbc9daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:01:57.981712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce9c04-3a13-4ed5-84fc-3018afbc9daf None admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:01:57.982124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce9c04-3a13-4ed5-84fc-3018afbc9daf None admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:01:57.982522 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce9c04-3a13-4ed5-84fc-3018afbc9daf None admin] PATH_INFO: `/v3/endpoints` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:01:57.983632 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce9c04-3a13-4ed5-84fc-3018afbc9daf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:01:57.985725 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce9c04-3a13-4ed5-84fc-3018afbc9daf None admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:01:58.008712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 661/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 09:01:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:03:00.958947 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60cb82-2a57-4860-a507-0ea5bae16b83 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:00.960552 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60cb82-2a57-4860-a507-0ea5bae16b83 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:00.961041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60cb82-2a57-4860-a507-0ea5bae16b83 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:00.968047 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ccc70-181c-40a8-ad93-e487771994eb None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:00.968994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ccc70-181c-40a8-ad93-e487771994eb None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:00.969497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ccc70-181c-40a8-ad93-e487771994eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:00.974595 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 646/1307] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:00 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:01.124715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-059ccc70-181c-40a8-ad93-e487771994eb None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:01.127856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-059ccc70-181c-40a8-ad93-e487771994eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:01.327320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 662/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:03:01.377791 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d549-980a-4f53-9f67-2cd15c37c39f None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:01.378251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d549-980a-4f53-9f67-2cd15c37c39f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:01.378634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d549-980a-4f53-9f67-2cd15c37c39f None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:01.380230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 647/1309] 10.222.0.23 () {54 vars in 964 bytes} [Tue May 3 09:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:01.386571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978fc58-7d6c-49ab-801b-82e1a6a85125 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:01.386865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978fc58-7d6c-49ab-801b-82e1a6a85125 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:01.387143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978fc58-7d6c-49ab-801b-82e1a6a85125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:01.462030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-c978fc58-7d6c-49ab-801b-82e1a6a85125 None None] MFA Rules not processed for user `418178b7e70f47d291e239a1297ccf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:01.463140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c978fc58-7d6c-49ab-801b-82e1a6a85125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:01.543178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 663/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Tue May 3 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:01.552659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50d549-980a-4f53-9f67-2cd15c37c39f None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:01.555164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1f50d549-980a-4f53-9f67-2cd15c37c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:01.660020 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50d549-980a-4f53-9f67-2cd15c37c39f None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:01.731758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e07892-87c6-40f8-97b7-beb266c4b04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:01.732358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e07892-87c6-40f8-97b7-beb266c4b04f service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:01.732638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e07892-87c6-40f8-97b7-beb266c4b04f service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:01.732909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e07892-87c6-40f8-97b7-beb266c4b04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:01.734520 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-07e07892-87c6-40f8-97b7-beb266c4b04f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:01.845685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e07892-87c6-40f8-97b7-beb266c4b04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:01.847365 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e07892-87c6-40f8-97b7-beb266c4b04f service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:01.866615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 648/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:04.456874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1332f-3110-402f-99d8-8e28f297215e None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:04.457416 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1332f-3110-402f-99d8-8e28f297215e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:04.457416 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1332f-3110-402f-99d8-8e28f297215e None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:04.460206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 664/1312] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:04.465275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded774-72a8-4595-947a-c04034b0daa0 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:04.465741 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded774-72a8-4595-947a-c04034b0daa0 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:04.465941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded774-72a8-4595-947a-c04034b0daa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:04.545441 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-04ded774-72a8-4595-947a-c04034b0daa0 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:04.546890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-04ded774-72a8-4595-947a-c04034b0daa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:04.655940 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 649/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:04.691358 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1332f-3110-402f-99d8-8e28f297215e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:04.692984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6af1332f-3110-402f-99d8-8e28f297215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:04.795257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1332f-3110-402f-99d8-8e28f297215e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:04.866587 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219154e-5395-45b9-9729-584a33b604fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:04.867592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219154e-5395-45b9-9729-584a33b604fa service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:04.867871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219154e-5395-45b9-9729-584a33b604fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:04.868174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219154e-5395-45b9-9729-584a33b604fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:04.869935 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9219154e-5395-45b9-9729-584a33b604fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:04.977119 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219154e-5395-45b9-9729-584a33b604fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:04.978826 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219154e-5395-45b9-9729-584a33b604fa service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:04.997444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 665/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:07.570554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb282ee-b76e-4aff-ae08-e6e61dddb82e None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:07.571088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb282ee-b76e-4aff-ae08-e6e61dddb82e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:07.571088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb282ee-b76e-4aff-ae08-e6e61dddb82e None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:07.572501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 650/1315] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:07.577469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d68ede-3f87-4f9c-b163-0dd8918736c7 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:07.577854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d68ede-3f87-4f9c-b163-0dd8918736c7 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:07.578015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d68ede-3f87-4f9c-b163-0dd8918736c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:07.639862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-56d68ede-3f87-4f9c-b163-0dd8918736c7 None None] MFA Rules not processed for user `20992ce0ed594e3f92a948a56437a7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:07.641085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-56d68ede-3f87-4f9c-b163-0dd8918736c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:07.730231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 666/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:07.769444 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb282ee-b76e-4aff-ae08-e6e61dddb82e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:07.770985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7fb282ee-b76e-4aff-ae08-e6e61dddb82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:07.877077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb282ee-b76e-4aff-ae08-e6e61dddb82e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:07.946041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79005b64-e8a4-4f71-af73-c5f980941617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:07.946678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005b64-e8a4-4f71-af73-c5f980941617 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:07.946956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005b64-e8a4-4f71-af73-c5f980941617 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:07.947223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005b64-e8a4-4f71-af73-c5f980941617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:07.948886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-79005b64-e8a4-4f71-af73-c5f980941617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:08.051054 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79005b64-e8a4-4f71-af73-c5f980941617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:08.052506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79005b64-e8a4-4f71-af73-c5f980941617 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:08.070093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 651/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:10.843282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ac62b-a4b5-4909-baa5-2c4e410e2065 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:10.843889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ac62b-a4b5-4909-baa5-2c4e410e2065 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:10.843889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ac62b-a4b5-4909-baa5-2c4e410e2065 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:10.845225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 667/1318] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:10.850426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f15f5-0b91-496d-b0b7-ea86a90b858a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:10.850868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f15f5-0b91-496d-b0b7-ea86a90b858a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:10.850979 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f15f5-0b91-496d-b0b7-ea86a90b858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:10.912581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-830f15f5-0b91-496d-b0b7-ea86a90b858a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:10.913775 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-830f15f5-0b91-496d-b0b7-ea86a90b858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:11.008642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 652/1319] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:11.062997 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cf310-de5e-46e3-bc92-c9dbe3525abe None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:11.063823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cf310-de5e-46e3-bc92-c9dbe3525abe None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:11.064130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cf310-de5e-46e3-bc92-c9dbe3525abe None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:11.065490 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 668/1320] 10.222.0.23 () {54 vars in 964 bytes} [Tue May 3 09:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:11.072013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca45a-1828-45e4-9d83-d0950f96e7d0 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:11.072337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca45a-1828-45e4-9d83-d0950f96e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:11.072614 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca45a-1828-45e4-9d83-d0950f96e7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:11.143547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-4b8ca45a-1828-45e4-9d83-d0950f96e7d0 None None] MFA Rules not processed for user `418178b7e70f47d291e239a1297ccf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:11.144693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4b8ca45a-1828-45e4-9d83-d0950f96e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:11.215194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 653/1321] 10.222.0.23 () {58 vars in 1061 bytes} [Tue May 3 09:03:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:11.224032 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cf310-de5e-46e3-bc92-c9dbe3525abe None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:11.225646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-678cf310-de5e-46e3-bc92-c9dbe3525abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:11.322238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cf310-de5e-46e3-bc92-c9dbe3525abe None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:11.390157 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbf39a-0555-4fbc-9858-bf6647509356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:11.390780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbf39a-0555-4fbc-9858-bf6647509356 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:11.391056 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbf39a-0555-4fbc-9858-bf6647509356 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:11.391324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbf39a-0555-4fbc-9858-bf6647509356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:11.392953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-eacbf39a-0555-4fbc-9858-bf6647509356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:11.493891 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbf39a-0555-4fbc-9858-bf6647509356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:11.495207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbf39a-0555-4fbc-9858-bf6647509356 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:11.511894 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 669/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:14.835250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff96d4-88b8-4e72-aacc-f27ba535d879 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:14.835838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff96d4-88b8-4e72-aacc-f27ba535d879 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:14.835838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff96d4-88b8-4e72-aacc-f27ba535d879 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:14.837183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 654/1323] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:14.842373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b8d7d-8b22-435c-9ddc-b9861d0e6eb0 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:14.842814 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b8d7d-8b22-435c-9ddc-b9861d0e6eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:14.842909 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b8d7d-8b22-435c-9ddc-b9861d0e6eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:14.905030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-c88b8d7d-8b22-435c-9ddc-b9861d0e6eb0 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:14.906481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c88b8d7d-8b22-435c-9ddc-b9861d0e6eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:15.002967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 670/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:03:15.039077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff96d4-88b8-4e72-aacc-f27ba535d879 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:15.040626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-94ff96d4-88b8-4e72-aacc-f27ba535d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:15.142835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff96d4-88b8-4e72-aacc-f27ba535d879 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:15.218407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976bd2-16e2-4410-b0c1-6b8e6b27a45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:15.219329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976bd2-16e2-4410-b0c1-6b8e6b27a45a service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:15.219734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976bd2-16e2-4410-b0c1-6b8e6b27a45a service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:15.220016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976bd2-16e2-4410-b0c1-6b8e6b27a45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:15.221744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d2976bd2-16e2-4410-b0c1-6b8e6b27a45a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:15.329510 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976bd2-16e2-4410-b0c1-6b8e6b27a45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:15.330934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976bd2-16e2-4410-b0c1-6b8e6b27a45a service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:15.349070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 655/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:17.618076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf51634-0cd6-484b-9bc2-1484f986df9f None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:17.618640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf51634-0cd6-484b-9bc2-1484f986df9f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:17.618640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf51634-0cd6-484b-9bc2-1484f986df9f None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:17.619957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 671/1326] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:17.625084 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e778aa-899a-4471-a2e6-36af71ae4d54 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:17.625472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e778aa-899a-4471-a2e6-36af71ae4d54 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:17.625782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e778aa-899a-4471-a2e6-36af71ae4d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:17.688734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-83e778aa-899a-4471-a2e6-36af71ae4d54 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:17.689950 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-83e778aa-899a-4471-a2e6-36af71ae4d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:17.781117 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 656/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:17.817847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf51634-0cd6-484b-9bc2-1484f986df9f None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:17.819368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3cf51634-0cd6-484b-9bc2-1484f986df9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:17.916564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf51634-0cd6-484b-9bc2-1484f986df9f None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:17.985760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260553e4-2e2b-4165-8cba-bf33f050fa01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:17.986383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260553e4-2e2b-4165-8cba-bf33f050fa01 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:17.986666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260553e4-2e2b-4165-8cba-bf33f050fa01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:17.986937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260553e4-2e2b-4165-8cba-bf33f050fa01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:17.988571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-260553e4-2e2b-4165-8cba-bf33f050fa01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:18.090110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260553e4-2e2b-4165-8cba-bf33f050fa01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:18.091521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260553e4-2e2b-4165-8cba-bf33f050fa01 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:18.109544 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 672/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:20.393499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844b78-ab1b-4c7a-acfe-cf4b2880044f None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:20.394049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844b78-ab1b-4c7a-acfe-cf4b2880044f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:20.394049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844b78-ab1b-4c7a-acfe-cf4b2880044f None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:20.395417 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 657/1329] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:20.400871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfb620-4edb-4b56-8e2a-e1f2d86a38d3 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:20.401310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfb620-4edb-4b56-8e2a-e1f2d86a38d3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:20.401518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfb620-4edb-4b56-8e2a-e1f2d86a38d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:20.464353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-d8dfb620-4edb-4b56-8e2a-e1f2d86a38d3 None None] MFA Rules not processed for user `20992ce0ed594e3f92a948a56437a7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:20.465579 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d8dfb620-4edb-4b56-8e2a-e1f2d86a38d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:20.556984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 673/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:20.593260 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d844b78-ab1b-4c7a-acfe-cf4b2880044f None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:20.594835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5d844b78-ab1b-4c7a-acfe-cf4b2880044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:20.695889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d844b78-ab1b-4c7a-acfe-cf4b2880044f None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:20.767831 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822496a-ed0c-41e6-b397-af4ba521fda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:20.768498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822496a-ed0c-41e6-b397-af4ba521fda7 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:20.768781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822496a-ed0c-41e6-b397-af4ba521fda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:20.769052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822496a-ed0c-41e6-b397-af4ba521fda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:20.770697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c822496a-ed0c-41e6-b397-af4ba521fda7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:20.876497 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822496a-ed0c-41e6-b397-af4ba521fda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:20.877854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822496a-ed0c-41e6-b397-af4ba521fda7 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:20.895200 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 658/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:23.389342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938ed21-726b-4424-abe9-9e8eaa1a7e44 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:23.389870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938ed21-726b-4424-abe9-9e8eaa1a7e44 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:23.389870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938ed21-726b-4424-abe9-9e8eaa1a7e44 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:23.391260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 674/1332] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:03:23.396692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46777c30-a6fd-4237-beeb-b0897745b6ff None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:23.397161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46777c30-a6fd-4237-beeb-b0897745b6ff None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:23.397267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46777c30-a6fd-4237-beeb-b0897745b6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:23.462011 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-46777c30-a6fd-4237-beeb-b0897745b6ff None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:23.463131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-46777c30-a6fd-4237-beeb-b0897745b6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:23.561750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 659/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:23.597327 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938ed21-726b-4424-abe9-9e8eaa1a7e44 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:23.599339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3938ed21-726b-4424-abe9-9e8eaa1a7e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:23.708519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938ed21-726b-4424-abe9-9e8eaa1a7e44 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:23.778143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f043-eb17-4de4-9db1-76cba5a5a7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:23.778789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f043-eb17-4de4-9db1-76cba5a5a7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:23.779069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f043-eb17-4de4-9db1-76cba5a5a7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:23.779346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f043-eb17-4de4-9db1-76cba5a5a7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:23.780982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-def5f043-eb17-4de4-9db1-76cba5a5a7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:23.884007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5f043-eb17-4de4-9db1-76cba5a5a7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:23.885487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5f043-eb17-4de4-9db1-76cba5a5a7a0 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:23.903191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 675/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:26.183348 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101af48-4d5b-4b4e-879c-9f77a68a6099 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:26.183876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101af48-4d5b-4b4e-879c-9f77a68a6099 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:26.183876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101af48-4d5b-4b4e-879c-9f77a68a6099 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:26.185268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 660/1335] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:26.190680 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609707-65fb-49a8-99a7-6ab82c63bb0e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:26.191093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609707-65fb-49a8-99a7-6ab82c63bb0e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:26.191224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609707-65fb-49a8-99a7-6ab82c63bb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:26.254289 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-43609707-65fb-49a8-99a7-6ab82c63bb0e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:26.256131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-43609707-65fb-49a8-99a7-6ab82c63bb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:26.346013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 676/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:03:26.385805 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101af48-4d5b-4b4e-879c-9f77a68a6099 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:26.387307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a101af48-4d5b-4b4e-879c-9f77a68a6099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:26.485540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101af48-4d5b-4b4e-879c-9f77a68a6099 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:26.555458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ec1a2-3978-4d39-bdfa-383acc2476db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:26.556108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ec1a2-3978-4d39-bdfa-383acc2476db service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:26.556405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ec1a2-3978-4d39-bdfa-383acc2476db service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:26.556679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ec1a2-3978-4d39-bdfa-383acc2476db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:26.558289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-936ec1a2-3978-4d39-bdfa-383acc2476db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:26.661966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ec1a2-3978-4d39-bdfa-383acc2476db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:26.663325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ec1a2-3978-4d39-bdfa-383acc2476db service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:26.681487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 661/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:29.245560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a21290-14d8-4852-b65d-e8bb3d8cd2b8 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:29.246002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a21290-14d8-4852-b65d-e8bb3d8cd2b8 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:29.246117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a21290-14d8-4852-b65d-e8bb3d8cd2b8 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:29.247491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 677/1338] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:29.252652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6792e8-5eb3-440b-bacc-4f7389fbedf4 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:29.253077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6792e8-5eb3-440b-bacc-4f7389fbedf4 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:29.253199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6792e8-5eb3-440b-bacc-4f7389fbedf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:29.315840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8d6792e8-5eb3-440b-bacc-4f7389fbedf4 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:29.317401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8d6792e8-5eb3-440b-bacc-4f7389fbedf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:29.418351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 662/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:29.458366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a21290-14d8-4852-b65d-e8bb3d8cd2b8 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:29.459854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-18a21290-14d8-4852-b65d-e8bb3d8cd2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:29.558499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a21290-14d8-4852-b65d-e8bb3d8cd2b8 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:29.627800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db925f-e241-4755-909d-cd9336c484d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:29.628467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db925f-e241-4755-909d-cd9336c484d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:29.628749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db925f-e241-4755-909d-cd9336c484d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:29.629023 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db925f-e241-4755-909d-cd9336c484d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:29.631134 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d5db925f-e241-4755-909d-cd9336c484d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:29.732482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db925f-e241-4755-909d-cd9336c484d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:29.733889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db925f-e241-4755-909d-cd9336c484d0 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:29.750653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 678/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:34.101289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d980c-d511-4232-85bd-0567dfcfefb5 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:34.101819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d980c-d511-4232-85bd-0567dfcfefb5 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:34.101819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d980c-d511-4232-85bd-0567dfcfefb5 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:34.103114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 663/1341] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:34.108112 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589326-7de2-4e6a-b1e1-54f5349db955 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:34.108528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589326-7de2-4e6a-b1e1-54f5349db955 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:34.108692 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589326-7de2-4e6a-b1e1-54f5349db955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:34.175139 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-60589326-7de2-4e6a-b1e1-54f5349db955 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:34.176983 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-60589326-7de2-4e6a-b1e1-54f5349db955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:34.276101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 679/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:34.321982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d980c-d511-4232-85bd-0567dfcfefb5 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:34.324104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-825d980c-d511-4232-85bd-0567dfcfefb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:34.417504 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d980c-d511-4232-85bd-0567dfcfefb5 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:34.420969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9de0e-6b8f-4178-80b2-1e7442ca956b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:34.421603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9de0e-6b8f-4178-80b2-1e7442ca956b service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:34.421880 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9de0e-6b8f-4178-80b2-1e7442ca956b service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:34.422148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9de0e-6b8f-4178-80b2-1e7442ca956b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:34.430992 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9de0e-6b8f-4178-80b2-1e7442ca956b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:34.432445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9de0e-6b8f-4178-80b2-1e7442ca956b service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:34.441910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 664/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:37.244134 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7005cec-1c4b-4561-aaf2-6131709ec17c None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:37.244574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7005cec-1c4b-4561-aaf2-6131709ec17c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:37.244686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7005cec-1c4b-4561-aaf2-6131709ec17c None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:37.246078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 680/1344] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:37.251279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a79b-1a34-4dbb-b8be-0eb4627c40f7 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:37.251707 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a79b-1a34-4dbb-b8be-0eb4627c40f7 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:37.251835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a79b-1a34-4dbb-b8be-0eb4627c40f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:37.279487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-4156a79b-1a34-4dbb-b8be-0eb4627c40f7 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:37.280695 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4156a79b-1a34-4dbb-b8be-0eb4627c40f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:37.353436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 665/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:37.390495 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7005cec-1c4b-4561-aaf2-6131709ec17c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:37.392317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c7005cec-1c4b-4561-aaf2-6131709ec17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:37.404733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7005cec-1c4b-4561-aaf2-6131709ec17c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:37.408112 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0179a4e-8e41-4ee4-921a-f031847c7182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:37.408742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179a4e-8e41-4ee4-921a-f031847c7182 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:37.409017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179a4e-8e41-4ee4-921a-f031847c7182 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:37.409285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179a4e-8e41-4ee4-921a-f031847c7182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:37.417851 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0179a4e-8e41-4ee4-921a-f031847c7182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:37.419244 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0179a4e-8e41-4ee4-921a-f031847c7182 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:37.429212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 681/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:41.901587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121ebfe-5f8f-4bb6-851b-f7741272b33d None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:41.902193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121ebfe-5f8f-4bb6-851b-f7741272b33d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:41.902193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121ebfe-5f8f-4bb6-851b-f7741272b33d None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:41.903484 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 666/1347] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:41.908698 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e1d7d-b7bc-448f-aec9-97575c1b376f None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:41.909110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e1d7d-b7bc-448f-aec9-97575c1b376f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:41.909238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e1d7d-b7bc-448f-aec9-97575c1b376f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:41.927453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-c48e1d7d-b7bc-448f-aec9-97575c1b376f None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:41.928693 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c48e1d7d-b7bc-448f-aec9-97575c1b376f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:41.936635 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 682/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:03:41.974504 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121ebfe-5f8f-4bb6-851b-f7741272b33d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:41.984961 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121ebfe-5f8f-4bb6-851b-f7741272b33d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:41.988983 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b6647-3fe8-4a69-9e7d-05ba5fb7282b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:41.989608 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6647-3fe8-4a69-9e7d-05ba5fb7282b service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:41.989891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6647-3fe8-4a69-9e7d-05ba5fb7282b service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:41.990166 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6647-3fe8-4a69-9e7d-05ba5fb7282b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:41.998817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b6647-3fe8-4a69-9e7d-05ba5fb7282b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:42.000269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b6647-3fe8-4a69-9e7d-05ba5fb7282b service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:42.009962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 667/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:47.237434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e0362-941d-40c9-8a51-3b64fe0ef45a None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:47.238466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e0362-941d-40c9-8a51-3b64fe0ef45a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:47.238570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e0362-941d-40c9-8a51-3b64fe0ef45a None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:47.240169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 683/1350] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 09:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:47.256042 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d2dcf-4d5e-4288-99f7-e87294811b5f None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:47.257142 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d2dcf-4d5e-4288-99f7-e87294811b5f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:47.257881 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d2dcf-4d5e-4288-99f7-e87294811b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:47.373895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-b66d2dcf-4d5e-4288-99f7-e87294811b5f None None] MFA Rules not processed for user `0f7f2aea3e494546a04e20d8cedccc9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:47.375715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b66d2dcf-4d5e-4288-99f7-e87294811b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:47.509113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 668/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 09:03:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:51.655352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079ccc-b386-4aa7-b15f-1fb5fdcdebd8 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:51.655879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079ccc-b386-4aa7-b15f-1fb5fdcdebd8 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:51.656203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079ccc-b386-4aa7-b15f-1fb5fdcdebd8 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:51.657826 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 684/1352] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 09:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:51.662907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505c33-7226-49c5-af38-8c091bc0da20 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:51.663355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505c33-7226-49c5-af38-8c091bc0da20 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:51.663468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505c33-7226-49c5-af38-8c091bc0da20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:51.681999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-57505c33-7226-49c5-af38-8c091bc0da20 None None] MFA Rules not processed for user `0f7f2aea3e494546a04e20d8cedccc9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:51.683355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-57505c33-7226-49c5-af38-8c091bc0da20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:51.693000 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 669/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 09:03:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:53.234365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9eb8b-0cd0-49a6-ba30-e2c4b1f60709 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:53.234880 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9eb8b-0cd0-49a6-ba30-e2c4b1f60709 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:53.234973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9eb8b-0cd0-49a6-ba30-e2c4b1f60709 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:53.236629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 685/1354] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 09:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:53.241699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed524dfd-d423-4754-a334-2a27dad6d1a1 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:53.242133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed524dfd-d423-4754-a334-2a27dad6d1a1 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:53.242229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed524dfd-d423-4754-a334-2a27dad6d1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:53.260886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-ed524dfd-d423-4754-a334-2a27dad6d1a1 None None] MFA Rules not processed for user `0f7f2aea3e494546a04e20d8cedccc9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:53.262081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ed524dfd-d423-4754-a334-2a27dad6d1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:53.270917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 670/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 09:03:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:03:57.030808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48983e8e-0628-4837-a31f-c73be96e4517 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:57.031343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48983e8e-0628-4837-a31f-c73be96e4517 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:57.031343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48983e8e-0628-4837-a31f-c73be96e4517 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:57.033033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 686/1356] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:57.038441 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0278695-00f3-4569-a8d9-c1ac329004e4 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:57.038860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0278695-00f3-4569-a8d9-c1ac329004e4 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:57.039011 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0278695-00f3-4569-a8d9-c1ac329004e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:57.057720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-e0278695-00f3-4569-a8d9-c1ac329004e4 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:57.059801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e0278695-00f3-4569-a8d9-c1ac329004e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:57.068788 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 671/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:57.115910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caa160-e31f-4d1e-93c9-3157384314d7 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:57.116251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caa160-e31f-4d1e-93c9-3157384314d7 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:57.116503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caa160-e31f-4d1e-93c9-3157384314d7 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:57.118010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 687/1358] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 3 09:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:57.124033 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3a217-5015-494a-9f23-8d3f9cbdf7ac None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:57.124351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3a217-5015-494a-9f23-8d3f9cbdf7ac None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:57.124626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3a217-5015-494a-9f23-8d3f9cbdf7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:57.170608 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-10e3a217-5015-494a-9f23-8d3f9cbdf7ac None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:57.171782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-10e3a217-5015-494a-9f23-8d3f9cbdf7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:57.261403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 672/1359] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 3 09:03:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:03:57.271481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caa160-e31f-4d1e-93c9-3157384314d7 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:57.286175 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caa160-e31f-4d1e-93c9-3157384314d7 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:57.292563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a615a5f-13a2-4e79-9aaa-15b3bc49be08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:57.293500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a615a5f-13a2-4e79-9aaa-15b3bc49be08 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:57.293981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a615a5f-13a2-4e79-9aaa-15b3bc49be08 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:57.294519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a615a5f-13a2-4e79-9aaa-15b3bc49be08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:57.303259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a615a5f-13a2-4e79-9aaa-15b3bc49be08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:57.304932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a615a5f-13a2-4e79-9aaa-15b3bc49be08 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:57.316174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 688/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:03:59.771646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68304751-7b03-4177-a5f4-5cdd6888556d None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:59.772199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68304751-7b03-4177-a5f4-5cdd6888556d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:59.772328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68304751-7b03-4177-a5f4-5cdd6888556d None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:59.773964 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 673/1361] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:03:59.780640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb531a-5809-468a-a130-ff831315a758 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:59.781116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb531a-5809-468a-a130-ff831315a758 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:59.781239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb531a-5809-468a-a130-ff831315a758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:59.807213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-dcbb531a-5809-468a-a130-ff831315a758 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:03:59.808435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-dcbb531a-5809-468a-a130-ff831315a758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:03:59.817129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 689/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:03:59.861534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68304751-7b03-4177-a5f4-5cdd6888556d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:03:59.876366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68304751-7b03-4177-a5f4-5cdd6888556d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:03:59.882147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0eee2-bcdb-4257-9506-47fe58fa33c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:03:59.882776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0eee2-bcdb-4257-9506-47fe58fa33c1 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:03:59.883053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0eee2-bcdb-4257-9506-47fe58fa33c1 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:03:59.883492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0eee2-bcdb-4257-9506-47fe58fa33c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:03:59.892016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0eee2-bcdb-4257-9506-47fe58fa33c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:03:59.894372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0eee2-bcdb-4257-9506-47fe58fa33c1 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:03:59.903903 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 674/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:04:02.471440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf434af-2c3c-4e25-ae21-63b535a2e911 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:02.471953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf434af-2c3c-4e25-ae21-63b535a2e911 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:02.471953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf434af-2c3c-4e25-ae21-63b535a2e911 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:02.473356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 690/1364] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:02.478601 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fbfb5-24f1-4ca9-8d23-26aa1d66a5e8 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:02.479007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fbfb5-24f1-4ca9-8d23-26aa1d66a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:02.479222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fbfb5-24f1-4ca9-8d23-26aa1d66a5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:02.496589 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-d45fbfb5-24f1-4ca9-8d23-26aa1d66a5e8 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:02.497758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d45fbfb5-24f1-4ca9-8d23-26aa1d66a5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:02.506256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 675/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:02.551058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06251516-436a-4518-b97d-708b8c51a134 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:02.551346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06251516-436a-4518-b97d-708b8c51a134 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:02.551621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06251516-436a-4518-b97d-708b8c51a134 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:02.553000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 691/1366] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 3 09:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:02.558348 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4334b-61f7-4e4f-a306-548a41cd066f None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:02.558711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4334b-61f7-4e4f-a306-548a41cd066f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:02.559056 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4334b-61f7-4e4f-a306-548a41cd066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:02.577666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0cd4334b-61f7-4e4f-a306-548a41cd066f None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:02.578869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0cd4334b-61f7-4e4f-a306-548a41cd066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:02.588823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 676/1367] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 3 09:04:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:02.596188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06251516-436a-4518-b97d-708b8c51a134 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:02.610208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06251516-436a-4518-b97d-708b8c51a134 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:02.615558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f1fbd-784d-4e10-a4ec-b670173618c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:02.616200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f1fbd-784d-4e10-a4ec-b670173618c3 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:02.616483 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f1fbd-784d-4e10-a4ec-b670173618c3 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:02.616766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f1fbd-784d-4e10-a4ec-b670173618c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:02.624625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f1fbd-784d-4e10-a4ec-b670173618c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:02.626177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f1fbd-784d-4e10-a4ec-b670173618c3 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:02.639878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 692/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:04.990769 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197abf-9444-4f14-b8bf-232a99c0a47d None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:04.991286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197abf-9444-4f14-b8bf-232a99c0a47d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:04.991366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197abf-9444-4f14-b8bf-232a99c0a47d None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:04.992729 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 677/1369] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:04.998261 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625dfed-80cb-4723-83dd-b3ac0b1315fb None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:04.999004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625dfed-80cb-4723-83dd-b3ac0b1315fb None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:04.999421 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625dfed-80cb-4723-83dd-b3ac0b1315fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:05.017879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-1625dfed-80cb-4723-83dd-b3ac0b1315fb None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:05.019304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-1625dfed-80cb-4723-83dd-b3ac0b1315fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:05.027793 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 693/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:05.077659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197abf-9444-4f14-b8bf-232a99c0a47d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:05.092640 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197abf-9444-4f14-b8bf-232a99c0a47d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:05.098757 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b757a1f-01de-4a75-8c95-3f31f7eacab4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:05.099486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b757a1f-01de-4a75-8c95-3f31f7eacab4 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:05.099838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b757a1f-01de-4a75-8c95-3f31f7eacab4 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:05.100227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b757a1f-01de-4a75-8c95-3f31f7eacab4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:05.109447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b757a1f-01de-4a75-8c95-3f31f7eacab4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:05.112111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b757a1f-01de-4a75-8c95-3f31f7eacab4 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:05.121956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 678/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:05.148332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8ff95-2540-46aa-8b03-faa185de15e4 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:05.148663 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8ff95-2540-46aa-8b03-faa185de15e4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:05.148937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8ff95-2540-46aa-8b03-faa185de15e4 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:05.154847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 694/1372] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:04:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:05.165870 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb27b8-692c-49fc-b328-bc5c9262e278 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:05.166163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb27b8-692c-49fc-b328-bc5c9262e278 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:05.166532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb27b8-692c-49fc-b328-bc5c9262e278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:05.184789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-56bb27b8-692c-49fc-b328-bc5c9262e278 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:05.186573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-56bb27b8-692c-49fc-b328-bc5c9262e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:05.194830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 679/1373] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:04:05.516573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6f2d9-1887-44ff-8158-1389699d1ca0 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:05.516573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6f2d9-1887-44ff-8158-1389699d1ca0 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:05.516573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6f2d9-1887-44ff-8158-1389699d1ca0 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:05.517016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 695/1374] 10.222.0.23 () {54 vars in 963 bytes} [Tue May 3 09:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:05.522395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb56d4f-386f-4e31-81bc-d186e8e24ce7 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:05.522683 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb56d4f-386f-4e31-81bc-d186e8e24ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:05.522958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb56d4f-386f-4e31-81bc-d186e8e24ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:05.571155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-4fb56d4f-386f-4e31-81bc-d186e8e24ce7 None None] MFA Rules not processed for user `17e1e2dc0a0a45f4a36d1369edcc6e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:05.572372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4fb56d4f-386f-4e31-81bc-d186e8e24ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:05.631460 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 680/1375] 10.222.0.23 () {58 vars in 1060 bytes} [Tue May 3 09:04:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:05.639250 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6f2d9-1887-44ff-8158-1389699d1ca0 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:05.650546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6f2d9-1887-44ff-8158-1389699d1ca0 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:05.654093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce131d5f-fba9-4b6c-a513-399654454609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:05.654821 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce131d5f-fba9-4b6c-a513-399654454609 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:05.655199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce131d5f-fba9-4b6c-a513-399654454609 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:05.655571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce131d5f-fba9-4b6c-a513-399654454609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:05.664470 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce131d5f-fba9-4b6c-a513-399654454609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:05.665991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce131d5f-fba9-4b6c-a513-399654454609 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:05.675354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 696/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:07.444754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b9c14-67db-40cf-8b0c-0d41d123219f None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:07.445318 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b9c14-67db-40cf-8b0c-0d41d123219f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:07.445318 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b9c14-67db-40cf-8b0c-0d41d123219f None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:07.446643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 681/1377] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:07.452067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149090e4-6e5c-4ea5-9e7c-c601054ee75f None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:07.452537 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149090e4-6e5c-4ea5-9e7c-c601054ee75f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:07.452662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149090e4-6e5c-4ea5-9e7c-c601054ee75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:07.470426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-149090e4-6e5c-4ea5-9e7c-c601054ee75f None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:07.471744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-149090e4-6e5c-4ea5-9e7c-c601054ee75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:07.481234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 697/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:07.525707 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b9c14-67db-40cf-8b0c-0d41d123219f None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:07.541133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b9c14-67db-40cf-8b0c-0d41d123219f None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:07.546538 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d5090-a327-4960-8846-09283ead9883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:07.547170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d5090-a327-4960-8846-09283ead9883 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:07.547447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d5090-a327-4960-8846-09283ead9883 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:07.547719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d5090-a327-4960-8846-09283ead9883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:07.556424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d5090-a327-4960-8846-09283ead9883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:07.558037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d5090-a327-4960-8846-09283ead9883 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:07.568379 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 682/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:09.871366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab20d8-6f38-41ad-89c4-4ef10a7e5ebb None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:09.871920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab20d8-6f38-41ad-89c4-4ef10a7e5ebb None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:09.871920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab20d8-6f38-41ad-89c4-4ef10a7e5ebb None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:09.873377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 698/1380] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:09.879004 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326dc41-baff-45f6-a8b3-6b2f42f5d4fc None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:09.879505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326dc41-baff-45f6-a8b3-6b2f42f5d4fc None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:09.879617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326dc41-baff-45f6-a8b3-6b2f42f5d4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:09.898790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-c326dc41-baff-45f6-a8b3-6b2f42f5d4fc None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:09.899965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c326dc41-baff-45f6-a8b3-6b2f42f5d4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:09.907862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 683/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:09.952470 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab20d8-6f38-41ad-89c4-4ef10a7e5ebb None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:09.967285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab20d8-6f38-41ad-89c4-4ef10a7e5ebb None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:09.972893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a0d79-765a-4614-a594-72210943ec38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:09.973519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0d79-765a-4614-a594-72210943ec38 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:09.973801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0d79-765a-4614-a594-72210943ec38 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:09.974076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0d79-765a-4614-a594-72210943ec38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:09.982244 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a0d79-765a-4614-a594-72210943ec38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:09.983801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a0d79-765a-4614-a594-72210943ec38 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:09.993307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 699/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:12.293673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64204f-1558-4c3f-9977-9875bc25149b None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:12.294242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64204f-1558-4c3f-9977-9875bc25149b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:12.294242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64204f-1558-4c3f-9977-9875bc25149b None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:12.295562 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 684/1383] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:12.300920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8df294-99f7-41a9-8bb2-d4e4c062fc0e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:12.301379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8df294-99f7-41a9-8bb2-d4e4c062fc0e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:12.301473 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8df294-99f7-41a9-8bb2-d4e4c062fc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:12.319436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-4a8df294-99f7-41a9-8bb2-d4e4c062fc0e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:12.320645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4a8df294-99f7-41a9-8bb2-d4e4c062fc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:12.328710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 700/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:12.370223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64204f-1558-4c3f-9977-9875bc25149b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:12.385496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64204f-1558-4c3f-9977-9875bc25149b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:12.391024 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0da91-86dd-4260-84e3-ae28035fb1ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:12.391729 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0da91-86dd-4260-84e3-ae28035fb1ef service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:12.392079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0da91-86dd-4260-84e3-ae28035fb1ef service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:12.393086 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0da91-86dd-4260-84e3-ae28035fb1ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:12.401343 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0da91-86dd-4260-84e3-ae28035fb1ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:12.402980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0da91-86dd-4260-84e3-ae28035fb1ef service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:12.412724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 685/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:15.143612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d814a-1ec0-4857-a709-4d1b7ecd1c76 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:15.144202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d814a-1ec0-4857-a709-4d1b7ecd1c76 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:15.144313 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d814a-1ec0-4857-a709-4d1b7ecd1c76 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:15.145765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 701/1386] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:15.152363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28259a-c212-465e-b204-0eb857c249f1 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:15.152821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28259a-c212-465e-b204-0eb857c249f1 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:15.152923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28259a-c212-465e-b204-0eb857c249f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:15.170875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-2b28259a-c212-465e-b204-0eb857c249f1 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:15.172064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2b28259a-c212-465e-b204-0eb857c249f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:15.179870 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 686/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:15.238509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d814a-1ec0-4857-a709-4d1b7ecd1c76 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:15.253160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d814a-1ec0-4857-a709-4d1b7ecd1c76 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:15.258605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e50014-c2bf-49b0-b92d-eb50306b9813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:15.259234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e50014-c2bf-49b0-b92d-eb50306b9813 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:15.259563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e50014-c2bf-49b0-b92d-eb50306b9813 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:15.259790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e50014-c2bf-49b0-b92d-eb50306b9813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:15.269006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e50014-c2bf-49b0-b92d-eb50306b9813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:15.271778 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e50014-c2bf-49b0-b92d-eb50306b9813 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:15.288583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 702/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:17.592358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bc1e-7cd6-414d-9148-e271eda963e5 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:17.592995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bc1e-7cd6-414d-9148-e271eda963e5 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:17.592995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bc1e-7cd6-414d-9148-e271eda963e5 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:17.594248 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 687/1389] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:17.599924 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32771f-65eb-438f-9de0-236e029f60d9 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:17.600467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32771f-65eb-438f-9de0-236e029f60d9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:17.600563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32771f-65eb-438f-9de0-236e029f60d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:17.619342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-bd32771f-65eb-438f-9de0-236e029f60d9 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:17.620577 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-bd32771f-65eb-438f-9de0-236e029f60d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:17.630627 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 703/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:17.683793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13bc1e-7cd6-414d-9148-e271eda963e5 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:17.699716 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13bc1e-7cd6-414d-9148-e271eda963e5 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:17.705414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75561f-b32d-4f4d-81f5-5844788704d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:17.706039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75561f-b32d-4f4d-81f5-5844788704d8 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:17.706321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75561f-b32d-4f4d-81f5-5844788704d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:17.706593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75561f-b32d-4f4d-81f5-5844788704d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:17.715174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75561f-b32d-4f4d-81f5-5844788704d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:17.717609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75561f-b32d-4f4d-81f5-5844788704d8 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:17.732522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 688/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:20.354546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b986001-ff07-45ce-95e5-b8863287782a None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:20.355262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b986001-ff07-45ce-95e5-b8863287782a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:20.355262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b986001-ff07-45ce-95e5-b8863287782a None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:20.356468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 704/1392] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:20.361787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ce17b-a80a-47d2-86b4-d7b6aed5db37 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:20.362241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ce17b-a80a-47d2-86b4-d7b6aed5db37 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:20.362390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ce17b-a80a-47d2-86b4-d7b6aed5db37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:20.380286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-9b6ce17b-a80a-47d2-86b4-d7b6aed5db37 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:20.381471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9b6ce17b-a80a-47d2-86b4-d7b6aed5db37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:20.389174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 689/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:04:20.432298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b986001-ff07-45ce-95e5-b8863287782a None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:20.446673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b986001-ff07-45ce-95e5-b8863287782a None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:20.451881 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41868a4-29cb-4b25-a794-0152437a10db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:20.452531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41868a4-29cb-4b25-a794-0152437a10db service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:20.452808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41868a4-29cb-4b25-a794-0152437a10db service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:20.453072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41868a4-29cb-4b25-a794-0152437a10db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:20.461458 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41868a4-29cb-4b25-a794-0152437a10db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:20.462994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41868a4-29cb-4b25-a794-0152437a10db service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:20.471924 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 705/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:21.433496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf8bd-5544-4526-b5cf-5dc70fdc03cd None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:21.434061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf8bd-5544-4526-b5cf-5dc70fdc03cd None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:21.434061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf8bd-5544-4526-b5cf-5dc70fdc03cd None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:21.435420 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 690/1395] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:21.441089 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4ceca-ab04-4a29-9599-81d1ea638f4c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:21.441533 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4ceca-ab04-4a29-9599-81d1ea638f4c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:21.441672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4ceca-ab04-4a29-9599-81d1ea638f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:21.458810 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-cef4ceca-ab04-4a29-9599-81d1ea638f4c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:21.459983 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-cef4ceca-ab04-4a29-9599-81d1ea638f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:21.467943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 706/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:21.523277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14243a0-3817-48bc-b351-c5e369d4f2d0 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:21.523564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14243a0-3817-48bc-b351-c5e369d4f2d0 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:21.523838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14243a0-3817-48bc-b351-c5e369d4f2d0 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:21.525211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 691/1397] 10.222.0.23 () {54 vars in 962 bytes} [Tue May 3 09:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:21.530479 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9baed-2a9f-4996-b5a3-6f9ab515a660 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:21.530792 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9baed-2a9f-4996-b5a3-6f9ab515a660 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:21.531070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9baed-2a9f-4996-b5a3-6f9ab515a660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:21.579880 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-aad9baed-2a9f-4996-b5a3-6f9ab515a660 None None] MFA Rules not processed for user `1848679bce324613b4a92de808165ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:21.581591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-aad9baed-2a9f-4996-b5a3-6f9ab515a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:21.641619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 707/1398] 10.222.0.23 () {58 vars in 1059 bytes} [Tue May 3 09:04:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:21.649671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14243a0-3817-48bc-b351-c5e369d4f2d0 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:21.660604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14243a0-3817-48bc-b351-c5e369d4f2d0 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:21.664114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e41f7e-83e9-494e-8b88-3476ef65e411 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1848679bce324613b4a92de808165ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:21.664735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e41f7e-83e9-494e-8b88-3476ef65e411 service glance] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:21.665014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e41f7e-83e9-494e-8b88-3476ef65e411 service glance] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:21.665282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e41f7e-83e9-494e-8b88-3476ef65e411 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:21.673832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e41f7e-83e9-494e-8b88-3476ef65e411 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:21.675266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e41f7e-83e9-494e-8b88-3476ef65e411 service glance] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:21.684404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 692/1399] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:22.093123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5927e6-44b9-4223-bd80-f5133aeddeef None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:22.093416 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5927e6-44b9-4223-bd80-f5133aeddeef None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:22.093690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5927e6-44b9-4223-bd80-f5133aeddeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:22.139628 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-2e5927e6-44b9-4223-bd80-f5133aeddeef None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:22.140840 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-2e5927e6-44b9-4223-bd80-f5133aeddeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:22.201557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 708/1400] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:04:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:22.242966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58464133-30d0-47e5-b2f1-b310e32e7b5b None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:22.243360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58464133-30d0-47e5-b2f1-b310e32e7b5b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:22.243698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58464133-30d0-47e5-b2f1-b310e32e7b5b None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:22.245193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 693/1401] 10.222.0.23 () {54 vars in 942 bytes} [Tue May 3 09:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:22.251456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c4dae-da45-4391-a0f8-1aaca02c58ac None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:22.251744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c4dae-da45-4391-a0f8-1aaca02c58ac None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:22.252534 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c4dae-da45-4391-a0f8-1aaca02c58ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:22.298412 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-003c4dae-da45-4391-a0f8-1aaca02c58ac None None] MFA Rules not processed for user `2360e3a110b042a8839c45aa50a39724`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:22.299586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-003c4dae-da45-4391-a0f8-1aaca02c58ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:22.372903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 709/1402] 10.222.0.23 () {58 vars in 1039 bytes} [Tue May 3 09:04:22 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:22.382963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58464133-30d0-47e5-b2f1-b310e32e7b5b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:22.396184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58464133-30d0-47e5-b2f1-b310e32e7b5b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:22.401039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ee8a8-831a-4677-947e-95706f323ea3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:22.401661 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ee8a8-831a-4677-947e-95706f323ea3 service swift] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:22.401944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ee8a8-831a-4677-947e-95706f323ea3 service swift] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:22.402218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ee8a8-831a-4677-947e-95706f323ea3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:22.409983 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ee8a8-831a-4677-947e-95706f323ea3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:22.411542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ee8a8-831a-4677-947e-95706f323ea3 service swift] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:22.419333 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 694/1403] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:04:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 09:04:22.735643 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c0e1-4e38-42ed-ab9b-1a4320fde8f6 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:22.736200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c0e1-4e38-42ed-ab9b-1a4320fde8f6 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:22.736200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c0e1-4e38-42ed-ab9b-1a4320fde8f6 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:22.738031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 710/1404] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:22.743201 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba7a3b-b374-46a8-8ea7-65a25da98ea4 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:22.743676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba7a3b-b374-46a8-8ea7-65a25da98ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:22.743755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba7a3b-b374-46a8-8ea7-65a25da98ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:22.761877 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-c7ba7a3b-b374-46a8-8ea7-65a25da98ea4 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:22.763069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c7ba7a3b-b374-46a8-8ea7-65a25da98ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:22.771474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 695/1405] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:22.818016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c0e1-4e38-42ed-ab9b-1a4320fde8f6 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:22.832668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c0e1-4e38-42ed-ab9b-1a4320fde8f6 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:22.838098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fe22c-bee5-4cab-b39b-17b7268fbd63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:22.838724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fe22c-bee5-4cab-b39b-17b7268fbd63 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:22.839004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fe22c-bee5-4cab-b39b-17b7268fbd63 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:22.839283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fe22c-bee5-4cab-b39b-17b7268fbd63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:22.850099 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fe22c-bee5-4cab-b39b-17b7268fbd63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:22.851662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fe22c-bee5-4cab-b39b-17b7268fbd63 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:22.862491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 711/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:25.180916 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9aaa-078f-48fa-8aa8-af5eb4d0174e None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:25.181773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9aaa-078f-48fa-8aa8-af5eb4d0174e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:25.182047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9aaa-078f-48fa-8aa8-af5eb4d0174e None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:25.183552 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 696/1407] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:25.188991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4f3ca-c95f-4f67-b8d8-d2e0c91b8979 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:25.189426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4f3ca-c95f-4f67-b8d8-d2e0c91b8979 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:25.189811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4f3ca-c95f-4f67-b8d8-d2e0c91b8979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:25.207855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e2b4f3ca-c95f-4f67-b8d8-d2e0c91b8979 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:25.209387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e2b4f3ca-c95f-4f67-b8d8-d2e0c91b8979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:25.220721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 712/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:04:25.265957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d9aaa-078f-48fa-8aa8-af5eb4d0174e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:25.285498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d9aaa-078f-48fa-8aa8-af5eb4d0174e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:25.292134 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdef32f-2c49-4672-bcf5-3d12b6e7604a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:25.293046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdef32f-2c49-4672-bcf5-3d12b6e7604a service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:25.293541 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdef32f-2c49-4672-bcf5-3d12b6e7604a service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:25.294012 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdef32f-2c49-4672-bcf5-3d12b6e7604a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:25.303777 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdef32f-2c49-4672-bcf5-3d12b6e7604a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:25.305386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdef32f-2c49-4672-bcf5-3d12b6e7604a service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:25.315077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 697/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:45.744651 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80215-f9a8-401a-b171-f2d799875b7e None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:45.745284 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80215-f9a8-401a-b171-f2d799875b7e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:45.745284 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80215-f9a8-401a-b171-f2d799875b7e None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:45.746559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 713/1410] 10.222.0.23 () {54 vars in 918 bytes} [Tue May 3 09:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:45.751557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58c06-20bd-4a53-b683-15179b6a36cc None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:45.752014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58c06-20bd-4a53-b683-15179b6a36cc None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:45.752147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58c06-20bd-4a53-b683-15179b6a36cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:45.770138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0cc58c06-20bd-4a53-b683-15179b6a36cc None None] MFA Rules not processed for user `0f7f2aea3e494546a04e20d8cedccc9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:45.771310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0cc58c06-20bd-4a53-b683-15179b6a36cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:45.779644 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 698/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Tue May 3 09:04:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:45.794007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d175bfa-2fdb-4f3d-9112-2d1d11173a1d None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:45.794292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d175bfa-2fdb-4f3d-9112-2d1d11173a1d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:45.794606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d175bfa-2fdb-4f3d-9112-2d1d11173a1d None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:45.795959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 714/1412] 10.222.0.23 () {54 vars in 918 bytes} [Tue May 3 09:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:45.800368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d77c8-cd33-4845-bfa0-21f35f45bda2 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:45.800648 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d77c8-cd33-4845-bfa0-21f35f45bda2 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:45.800928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d77c8-cd33-4845-bfa0-21f35f45bda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:45.818233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-c54d77c8-cd33-4845-bfa0-21f35f45bda2 None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:45.819401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c54d77c8-cd33-4845-bfa0-21f35f45bda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:45.828462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 699/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Tue May 3 09:04:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:48.495760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b18d3c-d5d7-446d-8b12-2d3134c9aed8 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:48.496380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b18d3c-d5d7-446d-8b12-2d3134c9aed8 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:48.496380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b18d3c-d5d7-446d-8b12-2d3134c9aed8 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:48.497593 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:48.502845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37017dfa-7ffc-4008-bf30-99e5612c6890 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:48.503251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37017dfa-7ffc-4008-bf30-99e5612c6890 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:48.503390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37017dfa-7ffc-4008-bf30-99e5612c6890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:48.520886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-37017dfa-7ffc-4008-bf30-99e5612c6890 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:48.522075 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-37017dfa-7ffc-4008-bf30-99e5612c6890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:48.529770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:48.571594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b18d3c-d5d7-446d-8b12-2d3134c9aed8 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:48.585714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b18d3c-d5d7-446d-8b12-2d3134c9aed8 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:48.590907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972f57d-e886-4470-a793-d9dff1457e39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:48.591521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972f57d-e886-4470-a793-d9dff1457e39 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:48.591796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972f57d-e886-4470-a793-d9dff1457e39 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:48.592064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972f57d-e886-4470-a793-d9dff1457e39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:48.600373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972f57d-e886-4470-a793-d9dff1457e39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:48.601903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972f57d-e886-4470-a793-d9dff1457e39 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:48.610821 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 716/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:49.893905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fd2ad-d41b-4c86-b895-37a4cda17dfb None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:49.894477 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fd2ad-d41b-4c86-b895-37a4cda17dfb None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:49.894477 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fd2ad-d41b-4c86-b895-37a4cda17dfb None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:49.895825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:49.900554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671af78-87c1-47fd-98ba-d53b8cd36cf6 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:49.900960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671af78-87c1-47fd-98ba-d53b8cd36cf6 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:49.901097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671af78-87c1-47fd-98ba-d53b8cd36cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:49.920051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-a671af78-87c1-47fd-98ba-d53b8cd36cf6 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:49.921251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a671af78-87c1-47fd-98ba-d53b8cd36cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:49.929605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:50.085859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fd2ad-d41b-4c86-b895-37a4cda17dfb None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:50.100218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fd2ad-d41b-4c86-b895-37a4cda17dfb None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:50.105422 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f25e7-038d-4a1b-9b74-6c1773608774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:50.106055 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f25e7-038d-4a1b-9b74-6c1773608774 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:50.106331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f25e7-038d-4a1b-9b74-6c1773608774 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:50.106598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f25e7-038d-4a1b-9b74-6c1773608774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:50.114377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f25e7-038d-4a1b-9b74-6c1773608774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:50.115924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f25e7-038d-4a1b-9b74-6c1773608774 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:50.124863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 702/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:51.365982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a7284-3e2e-419c-b75c-489d38dd69c7 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:51.366561 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a7284-3e2e-419c-b75c-489d38dd69c7 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:51.366561 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a7284-3e2e-419c-b75c-489d38dd69c7 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:51.367886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:51.372795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ef6a-0429-49be-8909-dbb84530e4b3 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:51.373241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ef6a-0429-49be-8909-dbb84530e4b3 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:51.373350 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ef6a-0429-49be-8909-dbb84530e4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:51.390618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-bd55ef6a-0429-49be-8909-dbb84530e4b3 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:51.391782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-bd55ef6a-0429-49be-8909-dbb84530e4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:51.399396 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:51.547664 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a7284-3e2e-419c-b75c-489d38dd69c7 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:51.562407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a7284-3e2e-419c-b75c-489d38dd69c7 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:51.567864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225a50-b26b-4d46-b3fb-dd0e15a7994a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:51.568526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225a50-b26b-4d46-b3fb-dd0e15a7994a service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:51.568812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225a50-b26b-4d46-b3fb-dd0e15a7994a service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:51.569089 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225a50-b26b-4d46-b3fb-dd0e15a7994a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:51.577011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12225a50-b26b-4d46-b3fb-dd0e15a7994a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:51.578573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12225a50-b26b-4d46-b3fb-dd0e15a7994a service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:51.588121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 719/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:52.827602 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf93cf-9032-4e5f-9523-cd4ba68a7c3e None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:52.828179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf93cf-9032-4e5f-9523-cd4ba68a7c3e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:52.828179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf93cf-9032-4e5f-9523-cd4ba68a7c3e None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:52.829507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:52.834602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7aa4-8ffc-4a1b-950b-97e9de49c026 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:52.835040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7aa4-8ffc-4a1b-950b-97e9de49c026 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:52.835188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7aa4-8ffc-4a1b-950b-97e9de49c026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:52.853134 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-0b7b7aa4-8ffc-4a1b-950b-97e9de49c026 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:52.854300 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0b7b7aa4-8ffc-4a1b-950b-97e9de49c026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:52.861874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:53.009334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf93cf-9032-4e5f-9523-cd4ba68a7c3e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:53.024071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf93cf-9032-4e5f-9523-cd4ba68a7c3e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:53.029981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fbec1-fd4e-4dec-bac2-91c24149995a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:53.030609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fbec1-fd4e-4dec-bac2-91c24149995a service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:53.030893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fbec1-fd4e-4dec-bac2-91c24149995a service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:53.031162 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fbec1-fd4e-4dec-bac2-91c24149995a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:53.040147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fbec1-fd4e-4dec-bac2-91c24149995a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:53.041780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fbec1-fd4e-4dec-bac2-91c24149995a service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:53.051665 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 705/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:54.279319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bea3f-9018-413f-bd07-1d5fd326a19c None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:54.279884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bea3f-9018-413f-bd07-1d5fd326a19c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:54.279884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bea3f-9018-413f-bd07-1d5fd326a19c None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:54.281295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:54.286199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a3de9-e91d-4324-865a-c8a1ff923a7b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:54.286650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a3de9-e91d-4324-865a-c8a1ff923a7b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:54.286761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a3de9-e91d-4324-865a-c8a1ff923a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:54.304007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-b20a3de9-e91d-4324-865a-c8a1ff923a7b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:54.305213 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b20a3de9-e91d-4324-865a-c8a1ff923a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:54.313061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:54.461193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bea3f-9018-413f-bd07-1d5fd326a19c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:54.475226 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bea3f-9018-413f-bd07-1d5fd326a19c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:54.480403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14ea3e-ea01-44b2-8421-e4567c80a3d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:54.481026 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14ea3e-ea01-44b2-8421-e4567c80a3d9 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:54.481304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14ea3e-ea01-44b2-8421-e4567c80a3d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:54.481577 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14ea3e-ea01-44b2-8421-e4567c80a3d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:54.489338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14ea3e-ea01-44b2-8421-e4567c80a3d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:54.490886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14ea3e-ea01-44b2-8421-e4567c80a3d9 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:54.499830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 722/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:55.686890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0632f3-560b-4e90-8f75-b693e7b99d71 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:55.687685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0632f3-560b-4e90-8f75-b693e7b99d71 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:55.687685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0632f3-560b-4e90-8f75-b693e7b99d71 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:55.689069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:55.694578 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d05768-91c6-47e9-9f71-ba04dcb7d7e3 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:55.694978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d05768-91c6-47e9-9f71-ba04dcb7d7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:55.695131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d05768-91c6-47e9-9f71-ba04dcb7d7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:55.713078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f4d05768-91c6-47e9-9f71-ba04dcb7d7e3 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:55.714260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f4d05768-91c6-47e9-9f71-ba04dcb7d7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:55.721908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:55.869716 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0632f3-560b-4e90-8f75-b693e7b99d71 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:55.883934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0632f3-560b-4e90-8f75-b693e7b99d71 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:55.889367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18047c-fb4d-415d-a9c3-75295598c59e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:55.889986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18047c-fb4d-415d-a9c3-75295598c59e service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:55.890264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18047c-fb4d-415d-a9c3-75295598c59e service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:55.890536 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18047c-fb4d-415d-a9c3-75295598c59e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:55.899062 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18047c-fb4d-415d-a9c3-75295598c59e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:55.900664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18047c-fb4d-415d-a9c3-75295598c59e service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:55.909684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 708/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:57.100118 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e3149-25c6-481d-9b20-11dc6e93e6e9 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:57.100656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e3149-25c6-481d-9b20-11dc6e93e6e9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:57.100656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e3149-25c6-481d-9b20-11dc6e93e6e9 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:57.102096 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:57.107242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d157b-6fac-42c2-900d-8ce43a11a111 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:57.107648 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d157b-6fac-42c2-900d-8ce43a11a111 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:57.107794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d157b-6fac-42c2-900d-8ce43a11a111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:57.125355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-649d157b-6fac-42c2-900d-8ce43a11a111 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:57.126548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-649d157b-6fac-42c2-900d-8ce43a11a111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:57.134553 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:57.284847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e3149-25c6-481d-9b20-11dc6e93e6e9 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:57.298791 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e3149-25c6-481d-9b20-11dc6e93e6e9 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:57.304950 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b753caa-9324-4f6d-9699-0c3e8dac3afb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:57.305570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b753caa-9324-4f6d-9699-0c3e8dac3afb service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:57.305848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b753caa-9324-4f6d-9699-0c3e8dac3afb service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:57.306119 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b753caa-9324-4f6d-9699-0c3e8dac3afb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:57.314206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b753caa-9324-4f6d-9699-0c3e8dac3afb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:57.315751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b753caa-9324-4f6d-9699-0c3e8dac3afb service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:57.324944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 725/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:58.504948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282ab2d-cf57-43fc-8080-dab9bd119f78 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:58.505467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282ab2d-cf57-43fc-8080-dab9bd119f78 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:58.505467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282ab2d-cf57-43fc-8080-dab9bd119f78 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:58.506768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:04:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:58.511576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7baafa-c365-4474-8e7b-24d5490b79b3 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:58.512003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7baafa-c365-4474-8e7b-24d5490b79b3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:58.512140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7baafa-c365-4474-8e7b-24d5490b79b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:58.529634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-1f7baafa-c365-4474-8e7b-24d5490b79b3 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:58.530851 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-1f7baafa-c365-4474-8e7b-24d5490b79b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:58.538704 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:04:58.686212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282ab2d-cf57-43fc-8080-dab9bd119f78 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:04:58.701021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282ab2d-cf57-43fc-8080-dab9bd119f78 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:04:58.706275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05074ef-58cb-44f3-83d7-530ce02fa2a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:04:58.706889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05074ef-58cb-44f3-83d7-530ce02fa2a5 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:58.707166 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05074ef-58cb-44f3-83d7-530ce02fa2a5 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:58.707438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05074ef-58cb-44f3-83d7-530ce02fa2a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:58.715091 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05074ef-58cb-44f3-83d7-530ce02fa2a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:04:58.716670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05074ef-58cb-44f3-83d7-530ce02fa2a5 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:04:58.726017 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 711/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:04:59.905493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5c5d-f9bf-40c5-b49f-452db769991b None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:59.906013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5c5d-f9bf-40c5-b49f-452db769991b None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:59.906013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5c5d-f9bf-40c5-b49f-452db769991b None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:59.907310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:04:59.915792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df71cd-f0e0-4635-bbf8-4ea9ed7d7b88 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:04:59.916237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df71cd-f0e0-4635-bbf8-4ea9ed7d7b88 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:04:59.916409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df71cd-f0e0-4635-bbf8-4ea9ed7d7b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:04:59.934499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a9df71cd-f0e0-4635-bbf8-4ea9ed7d7b88 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:04:59.935684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a9df71cd-f0e0-4635-bbf8-4ea9ed7d7b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:04:59.944262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:05:00.090625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a5c5d-f9bf-40c5-b49f-452db769991b None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:05:00.104443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a5c5d-f9bf-40c5-b49f-452db769991b None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:05:00.109709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f94aa3-01d0-4338-a03a-26af9a0b6c7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:05:00.110351 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f94aa3-01d0-4338-a03a-26af9a0b6c7f service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:00.110628 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f94aa3-01d0-4338-a03a-26af9a0b6c7f service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:00.110899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f94aa3-01d0-4338-a03a-26af9a0b6c7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:00.119184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f94aa3-01d0-4338-a03a-26af9a0b6c7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:05:00.120789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f94aa3-01d0-4338-a03a-26af9a0b6c7f service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:05:00.130393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 728/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:05:02.245742 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50016d65-4195-4ecc-904b-2b6b57ca82a9 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:02.246176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50016d65-4195-4ecc-904b-2b6b57ca82a9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:02.246301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50016d65-4195-4ecc-904b-2b6b57ca82a9 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:02.247664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:05:02.253393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e045c5-003e-4b40-b37f-0624af1d9b6b None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:02.253806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e045c5-003e-4b40-b37f-0624af1d9b6b None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:02.253944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e045c5-003e-4b40-b37f-0624af1d9b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:02.270811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b1e045c5-003e-4b40-b37f-0624af1d9b6b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:05:02.271982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b1e045c5-003e-4b40-b37f-0624af1d9b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:05:02.279500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:05:02.319097 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50016d65-4195-4ecc-904b-2b6b57ca82a9 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:05:02.329566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50016d65-4195-4ecc-904b-2b6b57ca82a9 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:05:02.333034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b51c40-8639-4262-919b-5cf652056fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:05:02.333648 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b51c40-8639-4262-919b-5cf652056fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:02.333926 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b51c40-8639-4262-919b-5cf652056fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:02.334197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b51c40-8639-4262-919b-5cf652056fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:02.342751 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b51c40-8639-4262-919b-5cf652056fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:05:02.344200 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b51c40-8639-4262-919b-5cf652056fd9 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:05:02.353189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 714/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:05:04.722494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57c8b6-a63b-4a00-badc-ceb332fda6e4 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:04.723033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57c8b6-a63b-4a00-badc-ceb332fda6e4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:04.723033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57c8b6-a63b-4a00-badc-ceb332fda6e4 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:04.724445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:05:04.729597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b7e7d-7329-422a-b00d-aa721551e243 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:04.730026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b7e7d-7329-422a-b00d-aa721551e243 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:04.730135 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b7e7d-7329-422a-b00d-aa721551e243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:04.747938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-7c7b7e7d-7329-422a-b00d-aa721551e243 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:05:04.749155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7c7b7e7d-7329-422a-b00d-aa721551e243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:05:04.757347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:05:04.794419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57c8b6-a63b-4a00-badc-ceb332fda6e4 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:05:04.804642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57c8b6-a63b-4a00-badc-ceb332fda6e4 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:05:04.807991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b893eb3-1957-4ec2-8ccc-39ae72cb8c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:05:04.808644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b893eb3-1957-4ec2-8ccc-39ae72cb8c0e service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:04.808919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b893eb3-1957-4ec2-8ccc-39ae72cb8c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:04.809186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b893eb3-1957-4ec2-8ccc-39ae72cb8c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:04.818327 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b893eb3-1957-4ec2-8ccc-39ae72cb8c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:05:04.819725 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b893eb3-1957-4ec2-8ccc-39ae72cb8c0e service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:05:04.828573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 731/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:05:07.434712 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742428e-9dd6-4f75-b826-65254a5756fa None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:07.435306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742428e-9dd6-4f75-b826-65254a5756fa None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:07.435306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742428e-9dd6-4f75-b826-65254a5756fa None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:07.436615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:05:07.442564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4761e-599a-44ba-8b4d-649a7d97b139 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:07.442987 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4761e-599a-44ba-8b4d-649a7d97b139 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:07.443093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4761e-599a-44ba-8b4d-649a7d97b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:07.460098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-8da4761e-599a-44ba-8b4d-649a7d97b139 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:05:07.461279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8da4761e-599a-44ba-8b4d-649a7d97b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:05:07.468849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:05:07.507629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742428e-9dd6-4f75-b826-65254a5756fa None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:05:07.517893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742428e-9dd6-4f75-b826-65254a5756fa None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:05:07.521366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a549422-dfa2-4c17-a5cf-004a3540b8fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:05:07.521980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a549422-dfa2-4c17-a5cf-004a3540b8fb service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:07.522259 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a549422-dfa2-4c17-a5cf-004a3540b8fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:07.522534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a549422-dfa2-4c17-a5cf-004a3540b8fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:07.531113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a549422-dfa2-4c17-a5cf-004a3540b8fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:05:07.532617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a549422-dfa2-4c17-a5cf-004a3540b8fb service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:05:07.542065 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 717/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:05:09.953722 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb082e3-e7a5-4821-875d-4b5566aa77de None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:09.954279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb082e3-e7a5-4821-875d-4b5566aa77de None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:09.954279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb082e3-e7a5-4821-875d-4b5566aa77de None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:09.955641 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:05:09.961262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec943ab4-6dde-4e54-8f5e-d7d061c92c4a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:09.961665 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec943ab4-6dde-4e54-8f5e-d7d061c92c4a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:09.961807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec943ab4-6dde-4e54-8f5e-d7d061c92c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:09.978883 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-ec943ab4-6dde-4e54-8f5e-d7d061c92c4a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:05:09.980044 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ec943ab4-6dde-4e54-8f5e-d7d061c92c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:05:09.987680 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:05:10.025677 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb082e3-e7a5-4821-875d-4b5566aa77de None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:05:10.036116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb082e3-e7a5-4821-875d-4b5566aa77de None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:05:10.039839 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2dbb1-534d-4ce2-bf42-0d6160e69edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:05:10.040501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2dbb1-534d-4ce2-bf42-0d6160e69edf service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:10.040777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2dbb1-534d-4ce2-bf42-0d6160e69edf service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:10.041043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2dbb1-534d-4ce2-bf42-0d6160e69edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:10.049706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2dbb1-534d-4ce2-bf42-0d6160e69edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:05:10.051105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2dbb1-534d-4ce2-bf42-0d6160e69edf service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:05:10.060037 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 734/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:05:12.348654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3e076-94c2-46fe-b915-ff3f5d724993 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:12.349186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3e076-94c2-46fe-b915-ff3f5d724993 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:12.349186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3e076-94c2-46fe-b915-ff3f5d724993 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:12.350546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:05:12.355792 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c4df-2794-4bf7-9ebf-935c6c63ed91 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:12.356259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c4df-2794-4bf7-9ebf-935c6c63ed91 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:12.356365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c4df-2794-4bf7-9ebf-935c6c63ed91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:12.373839 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ebe9c4df-2794-4bf7-9ebf-935c6c63ed91 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:05:12.375032 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ebe9c4df-2794-4bf7-9ebf-935c6c63ed91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:05:12.382619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:05:12.420663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3e076-94c2-46fe-b915-ff3f5d724993 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:05:12.431526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3e076-94c2-46fe-b915-ff3f5d724993 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:05:12.435032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227d968-3ccc-4dc0-899c-ba6c26c7b33e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:05:12.435646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227d968-3ccc-4dc0-899c-ba6c26c7b33e service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:12.435924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227d968-3ccc-4dc0-899c-ba6c26c7b33e service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:12.436222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227d968-3ccc-4dc0-899c-ba6c26c7b33e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:12.444996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227d968-3ccc-4dc0-899c-ba6c26c7b33e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:05:12.446402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227d968-3ccc-4dc0-899c-ba6c26c7b33e service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:05:12.455311 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 720/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:05:14.735411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed6f38-6908-49c4-9af1-ed27158d54e9 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:14.735984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed6f38-6908-49c4-9af1-ed27158d54e9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:14.735984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed6f38-6908-49c4-9af1-ed27158d54e9 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:14.737430 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:05:14.742576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa25d14-59c9-4a69-91cd-62913846406e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:14.742985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa25d14-59c9-4a69-91cd-62913846406e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:14.743119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa25d14-59c9-4a69-91cd-62913846406e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:14.760758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-3aa25d14-59c9-4a69-91cd-62913846406e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:05:14.761933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3aa25d14-59c9-4a69-91cd-62913846406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:05:14.770065 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:05:14.807252 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed6f38-6908-49c4-9af1-ed27158d54e9 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:05:14.819147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed6f38-6908-49c4-9af1-ed27158d54e9 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:05:14.822604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1134d25-96ba-40be-bbbb-ae90a89b3de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:05:14.823220 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1134d25-96ba-40be-bbbb-ae90a89b3de2 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:14.823498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1134d25-96ba-40be-bbbb-ae90a89b3de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:14.823770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1134d25-96ba-40be-bbbb-ae90a89b3de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:14.832890 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1134d25-96ba-40be-bbbb-ae90a89b3de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:05:14.834286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1134d25-96ba-40be-bbbb-ae90a89b3de2 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:05:14.843184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 737/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:05:17.116674 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626aa46-1225-48ab-b1f4-b01d224a483f None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:17.117220 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626aa46-1225-48ab-b1f4-b01d224a483f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:17.117220 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626aa46-1225-48ab-b1f4-b01d224a483f None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:17.118567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:05:17.123960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d02e-ad2d-4e53-aeaa-78a068158b91 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:17.124404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d02e-ad2d-4e53-aeaa-78a068158b91 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:17.124548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d02e-ad2d-4e53-aeaa-78a068158b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:17.145895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b868d02e-ad2d-4e53-aeaa-78a068158b91 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:05:17.147060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b868d02e-ad2d-4e53-aeaa-78a068158b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:05:17.154749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:05:17.192461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626aa46-1225-48ab-b1f4-b01d224a483f None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:05:17.202877 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626aa46-1225-48ab-b1f4-b01d224a483f None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:05:17.208195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2646e5f-7ff6-486b-93d7-f15898886515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:05:17.209285 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2646e5f-7ff6-486b-93d7-f15898886515 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:17.209793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2646e5f-7ff6-486b-93d7-f15898886515 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:17.210244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2646e5f-7ff6-486b-93d7-f15898886515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:17.221019 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2646e5f-7ff6-486b-93d7-f15898886515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:05:17.223133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2646e5f-7ff6-486b-93d7-f15898886515 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:05:17.232659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 723/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:05:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:05:19.502768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b1c2f-86ec-4dcf-a342-d9cecf23ad89 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:19.503293 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b1c2f-86ec-4dcf-a342-d9cecf23ad89 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:19.503293 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b1c2f-86ec-4dcf-a342-d9cecf23ad89 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:19.504607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:05:19.509615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4a6a5-1e78-4104-b95e-38e553bf2d85 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:19.510051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4a6a5-1e78-4104-b95e-38e553bf2d85 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:19.510161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4a6a5-1e78-4104-b95e-38e553bf2d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:19.527834 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-d1b4a6a5-1e78-4104-b95e-38e553bf2d85 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:05:19.529028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d1b4a6a5-1e78-4104-b95e-38e553bf2d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:05:19.538622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:05:19.574777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b1c2f-86ec-4dcf-a342-d9cecf23ad89 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:05:19.585591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b1c2f-86ec-4dcf-a342-d9cecf23ad89 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:05:19.589000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeccf76-b416-4736-8436-83ea08c399ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:05:19.589617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeccf76-b416-4736-8436-83ea08c399ad service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:19.589896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeccf76-b416-4736-8436-83ea08c399ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:19.590170 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeccf76-b416-4736-8436-83ea08c399ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:19.599234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeccf76-b416-4736-8436-83ea08c399ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:05:19.600670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeccf76-b416-4736-8436-83ea08c399ad service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:05:19.609617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 740/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:05:21.846811 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76eec2-2dea-4a7c-8fe0-fa2d4e447138 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:21.847436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76eec2-2dea-4a7c-8fe0-fa2d4e447138 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:21.847728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76eec2-2dea-4a7c-8fe0-fa2d4e447138 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:21.849128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:05:21.854438 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4434cf-75b3-4863-a535-077248bd7a03 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:21.854849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4434cf-75b3-4863-a535-077248bd7a03 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:21.854984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4434cf-75b3-4863-a535-077248bd7a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:21.872599 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-de4434cf-75b3-4863-a535-077248bd7a03 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:05:21.873772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-de4434cf-75b3-4863-a535-077248bd7a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:05:21.882039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:05:21.917895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76eec2-2dea-4a7c-8fe0-fa2d4e447138 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:05:21.928629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76eec2-2dea-4a7c-8fe0-fa2d4e447138 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:05:21.932007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe7709-0d80-44f2-9037-546aa07302ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:05:21.932653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe7709-0d80-44f2-9037-546aa07302ae service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:21.932928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe7709-0d80-44f2-9037-546aa07302ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:21.933193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe7709-0d80-44f2-9037-546aa07302ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:21.942512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe7709-0d80-44f2-9037-546aa07302ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:05:21.943915 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe7709-0d80-44f2-9037-546aa07302ae service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:05:21.952827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 726/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:05:24.183744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6f9b5-b5be-44d2-be6c-2e00f9411de6 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:24.184319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6f9b5-b5be-44d2-be6c-2e00f9411de6 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:24.184319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6f9b5-b5be-44d2-be6c-2e00f9411de6 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:24.185678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:05:24.191514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d55d5-9eee-40af-89f8-7a1dcd77feaf None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:24.191961 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d55d5-9eee-40af-89f8-7a1dcd77feaf None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:24.192066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d55d5-9eee-40af-89f8-7a1dcd77feaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:24.209926 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a51d55d5-9eee-40af-89f8-7a1dcd77feaf None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:05:24.211102 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a51d55d5-9eee-40af-89f8-7a1dcd77feaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:05:24.218842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:05:24.254436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6f9b5-b5be-44d2-be6c-2e00f9411de6 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:05:24.264717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6f9b5-b5be-44d2-be6c-2e00f9411de6 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:05:24.268149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e19e43-bd10-44b3-9a9f-f306dcc2f6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:05:24.269325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e19e43-bd10-44b3-9a9f-f306dcc2f6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:24.269603 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e19e43-bd10-44b3-9a9f-f306dcc2f6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:24.269875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e19e43-bd10-44b3-9a9f-f306dcc2f6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:24.278401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e19e43-bd10-44b3-9a9f-f306dcc2f6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:05:24.279801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e19e43-bd10-44b3-9a9f-f306dcc2f6d4 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:05:24.288830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 743/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:05:57.531744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610ecb9-e933-4b47-93bd-5818a50dbb1a None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:57.532357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610ecb9-e933-4b47-93bd-5818a50dbb1a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:57.532357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610ecb9-e933-4b47-93bd-5818a50dbb1a None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:57.533681 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 728/1471] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:05:57.539789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f11788-5eb0-4f83-ab96-f3dc9d4ec87a None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:57.540288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f11788-5eb0-4f83-ab96-f3dc9d4ec87a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:57.540497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f11788-5eb0-4f83-ab96-f3dc9d4ec87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:57.564378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-66f11788-5eb0-4f83-ab96-f3dc9d4ec87a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:05:57.565609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-66f11788-5eb0-4f83-ab96-f3dc9d4ec87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:05:57.574472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 744/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:05:57.622585 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896389e-a89e-4355-a750-36f3ea2a2d10 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:57.622866 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896389e-a89e-4355-a750-36f3ea2a2d10 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:57.623138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896389e-a89e-4355-a750-36f3ea2a2d10 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:57.624523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 729/1473] 10.222.0.23 () {54 vars in 962 bytes} [Tue May 3 09:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:05:57.629160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb841e1-b0b5-4dad-9b1f-2a20b7ddc8a5 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:57.629449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb841e1-b0b5-4dad-9b1f-2a20b7ddc8a5 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:57.629726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb841e1-b0b5-4dad-9b1f-2a20b7ddc8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:57.647620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-2bb841e1-b0b5-4dad-9b1f-2a20b7ddc8a5 None None] MFA Rules not processed for user `1848679bce324613b4a92de808165ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:05:57.648830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-2bb841e1-b0b5-4dad-9b1f-2a20b7ddc8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:05:57.655102 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 745/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Tue May 3 09:05:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:05:57.662738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896389e-a89e-4355-a750-36f3ea2a2d10 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:05:57.672930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896389e-a89e-4355-a750-36f3ea2a2d10 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:05:57.676390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3926e-0188-4c52-968c-402c8061cd3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1848679bce324613b4a92de808165ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:05:57.676997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3926e-0188-4c52-968c-402c8061cd3a service glance] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:05:57.677273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3926e-0188-4c52-968c-402c8061cd3a service glance] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:05:57.677538 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3926e-0188-4c52-968c-402c8061cd3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:05:57.685992 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3926e-0188-4c52-968c-402c8061cd3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:05:57.687385 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3926e-0188-4c52-968c-402c8061cd3a service glance] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:05:57.696655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 730/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:06:00.014084 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848e350-32dd-4cb6-839f-8d783c8c400f None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:00.014628 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848e350-32dd-4cb6-839f-8d783c8c400f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:00.014628 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848e350-32dd-4cb6-839f-8d783c8c400f None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:00.015990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 746/1476] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:06:00.021209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa0297-9464-4a8c-a57f-27119d2f170e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:00.021640 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa0297-9464-4a8c-a57f-27119d2f170e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:00.021805 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa0297-9464-4a8c-a57f-27119d2f170e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:00.039744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-eafa0297-9464-4a8c-a57f-27119d2f170e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:06:00.040943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-eafa0297-9464-4a8c-a57f-27119d2f170e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:06:00.048585 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 731/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:06:00.072640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848e350-32dd-4cb6-839f-8d783c8c400f None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:06:00.084923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848e350-32dd-4cb6-839f-8d783c8c400f None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:06:00.089258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae9472-414c-4197-8d81-6375b8d42cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:06:00.089911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae9472-414c-4197-8d81-6375b8d42cff admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:00.090186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae9472-414c-4197-8d81-6375b8d42cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:00.090455 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae9472-414c-4197-8d81-6375b8d42cff admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:00.091205 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae9472-414c-4197-8d81-6375b8d42cff admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:06:00.093304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: WARNING py.warnings [None req-74ae9472-414c-4197-8d81-6375b8d42cff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:06:00.093304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: warnings.warn(msg) May 03 09:06:00.093304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: May 03 09:06:00.094431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae9472-414c-4197-8d81-6375b8d42cff admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:06:00.114003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 747/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 09:06:00 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:06:02.351860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03560b3-667f-4ef3-83d2-4a7a02185b60 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:02.352451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03560b3-667f-4ef3-83d2-4a7a02185b60 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:02.352451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03560b3-667f-4ef3-83d2-4a7a02185b60 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:02.353763 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 732/1479] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:06:02.358820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ce88-2e03-44ef-8f80-318fb26893c2 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:02.359263 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ce88-2e03-44ef-8f80-318fb26893c2 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:02.359367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ce88-2e03-44ef-8f80-318fb26893c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:02.377925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b563ce88-2e03-44ef-8f80-318fb26893c2 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:06:02.379125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b563ce88-2e03-44ef-8f80-318fb26893c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:06:02.386947 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 748/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:06:02.428659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03560b3-667f-4ef3-83d2-4a7a02185b60 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:06:02.443100 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03560b3-667f-4ef3-83d2-4a7a02185b60 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:06:02.448413 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0764f-516f-4e3d-9fb7-a87651564105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:06:02.449023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0764f-516f-4e3d-9fb7-a87651564105 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:02.449297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0764f-516f-4e3d-9fb7-a87651564105 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:02.449561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0764f-516f-4e3d-9fb7-a87651564105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:02.458195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0764f-516f-4e3d-9fb7-a87651564105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:06:02.459749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0764f-516f-4e3d-9fb7-a87651564105 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:06:02.468795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 733/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:06:04.870758 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a54b8-7ab9-49a0-9bac-2b18695a301f None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:04.871337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a54b8-7ab9-49a0-9bac-2b18695a301f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:04.871337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a54b8-7ab9-49a0-9bac-2b18695a301f None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:04.872687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 749/1482] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:06:04.878395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a39fa-464e-43a4-bf7c-29789f42fae3 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:04.878824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a39fa-464e-43a4-bf7c-29789f42fae3 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:04.878933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a39fa-464e-43a4-bf7c-29789f42fae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:04.898645 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-c21a39fa-464e-43a4-bf7c-29789f42fae3 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:06:04.899850 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c21a39fa-464e-43a4-bf7c-29789f42fae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:06:04.907583 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 734/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:06:04.943726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a54b8-7ab9-49a0-9bac-2b18695a301f None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:06:04.953981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a54b8-7ab9-49a0-9bac-2b18695a301f None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:06:04.958341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0054f-859c-4bde-bb9c-12ee84620f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:06:04.958987 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0054f-859c-4bde-bb9c-12ee84620f74 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:04.959260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0054f-859c-4bde-bb9c-12ee84620f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:04.959528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0054f-859c-4bde-bb9c-12ee84620f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:04.967906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0054f-859c-4bde-bb9c-12ee84620f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:06:04.969344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0054f-859c-4bde-bb9c-12ee84620f74 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:06:04.978202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 750/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:06:07.251034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243e2d3-ba7a-44a6-985b-53d6fa8c2062 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:07.251543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243e2d3-ba7a-44a6-985b-53d6fa8c2062 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:07.251650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243e2d3-ba7a-44a6-985b-53d6fa8c2062 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:07.253007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 735/1485] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:06:07.258156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae5aa3-19da-44bd-9432-dfae713efaa9 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:07.258625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae5aa3-19da-44bd-9432-dfae713efaa9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:07.258733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae5aa3-19da-44bd-9432-dfae713efaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:07.276146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-a2ae5aa3-19da-44bd-9432-dfae713efaa9 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:06:07.277299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a2ae5aa3-19da-44bd-9432-dfae713efaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:06:07.285669 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 751/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:06:07.323187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243e2d3-ba7a-44a6-985b-53d6fa8c2062 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:06:07.334092 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243e2d3-ba7a-44a6-985b-53d6fa8c2062 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:06:07.337604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b590c0e-5da2-4197-882b-1ca31ca34d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:06:07.338222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590c0e-5da2-4197-882b-1ca31ca34d23 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:07.338500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590c0e-5da2-4197-882b-1ca31ca34d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:07.338768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590c0e-5da2-4197-882b-1ca31ca34d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:07.347836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b590c0e-5da2-4197-882b-1ca31ca34d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:06:07.349355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b590c0e-5da2-4197-882b-1ca31ca34d23 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:06:07.358401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 736/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:06:09.740447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ed1a2-0363-4946-9162-eb0420562059 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:09.741026 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ed1a2-0363-4946-9162-eb0420562059 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:09.741026 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ed1a2-0363-4946-9162-eb0420562059 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:09.742346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 752/1488] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:06:09.747345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b87dc-0c7c-4cfd-bfb1-dd29d317aa3c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:09.747792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b87dc-0c7c-4cfd-bfb1-dd29d317aa3c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:09.747905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b87dc-0c7c-4cfd-bfb1-dd29d317aa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:09.765610 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-bf1b87dc-0c7c-4cfd-bfb1-dd29d317aa3c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:06:09.766784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-bf1b87dc-0c7c-4cfd-bfb1-dd29d317aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:06:09.774596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 737/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:06:09.814537 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ed1a2-0363-4946-9162-eb0420562059 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:06:09.825596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ed1a2-0363-4946-9162-eb0420562059 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:06:09.829045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9e0f0-93ce-49dc-9913-d73ccab3c940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:06:09.829670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9e0f0-93ce-49dc-9913-d73ccab3c940 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:09.829948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9e0f0-93ce-49dc-9913-d73ccab3c940 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:09.830219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9e0f0-93ce-49dc-9913-d73ccab3c940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:09.838645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9e0f0-93ce-49dc-9913-d73ccab3c940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:06:09.840044 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9e0f0-93ce-49dc-9913-d73ccab3c940 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:06:09.848996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 753/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:06:12.307798 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7441032-ce3b-4207-9296-38cb09283e9c None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:12.308449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7441032-ce3b-4207-9296-38cb09283e9c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:12.308449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7441032-ce3b-4207-9296-38cb09283e9c None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:12.309762 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 738/1491] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 09:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:06:12.315400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e32b6b-e7c9-44fc-918f-38f99c7413b3 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:12.315846 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e32b6b-e7c9-44fc-918f-38f99c7413b3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:12.315948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e32b6b-e7c9-44fc-918f-38f99c7413b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:12.333042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-d0e32b6b-e7c9-44fc-918f-38f99c7413b3 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:06:12.334202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d0e32b6b-e7c9-44fc-918f-38f99c7413b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:06:12.341829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 754/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 09:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:06:12.384232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7441032-ce3b-4207-9296-38cb09283e9c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:06:12.394554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7441032-ce3b-4207-9296-38cb09283e9c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:06:12.397984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc8fb4-0604-4e78-bd9c-d81232326d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:06:12.398601 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc8fb4-0604-4e78-bd9c-d81232326d54 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:06:12.398879 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc8fb4-0604-4e78-bd9c-d81232326d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:06:12.399147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc8fb4-0604-4e78-bd9c-d81232326d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:06:12.407644 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc8fb4-0604-4e78-bd9c-d81232326d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:06:12.409589 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc8fb4-0604-4e78-bd9c-d81232326d54 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:06:12.418591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 739/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:07:40.852728 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255c14-1e48-4fa3-9599-21264af03b46 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:40.853408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255c14-1e48-4fa3-9599-21264af03b46 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:40.853408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255c14-1e48-4fa3-9599-21264af03b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:40.870552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-9d255c14-1e48-4fa3-9599-21264af03b46 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:07:40.871741 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9d255c14-1e48-4fa3-9599-21264af03b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:07:40.879919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 755/1494] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:07:40.887648 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a720-5b03-48aa-9d0d-86ccbf3f572d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:40.888155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a720-5b03-48aa-9d0d-86ccbf3f572d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:40.888258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a720-5b03-48aa-9d0d-86ccbf3f572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:40.906358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-1eb6a720-5b03-48aa-9d0d-86ccbf3f572d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:07:40.907538 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1eb6a720-5b03-48aa-9d0d-86ccbf3f572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:07:40.915271 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 740/1495] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:07:40.919659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255c14-1e48-4fa3-9599-21264af03b46 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:07:40.928954 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255c14-1e48-4fa3-9599-21264af03b46 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:07:40.933616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3ea18-40c4-4397-a566-bc09730ab9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:07:40.934265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3ea18-40c4-4397-a566-bc09730ab9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:40.934546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3ea18-40c4-4397-a566-bc09730ab9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:40.934821 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3ea18-40c4-4397-a566-bc09730ab9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:40.935543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3ea18-40c4-4397-a566-bc09730ab9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:07:40.935849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3ea18-40c4-4397-a566-bc09730ab9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:07:40.936932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: WARNING py.warnings [None req-fde3ea18-40c4-4397-a566-bc09730ab9e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 09:07:40.936932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: warnings.warn(msg) May 03 09:07:40.936932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: May 03 09:07:40.937797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3ea18-40c4-4397-a566-bc09730ab9e3 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:07:40.949609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 756/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:07:40.958028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a720-5b03-48aa-9d0d-86ccbf3f572d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:07:40.966638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a720-5b03-48aa-9d0d-86ccbf3f572d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:07:40.971128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d620ee-deb5-4cb2-963f-07ae85008eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:07:40.971753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d620ee-deb5-4cb2-963f-07ae85008eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:40.972030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d620ee-deb5-4cb2-963f-07ae85008eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:40.972338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d620ee-deb5-4cb2-963f-07ae85008eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:40.973023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d620ee-deb5-4cb2-963f-07ae85008eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:07:40.974774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: WARNING py.warnings [None req-18d620ee-deb5-4cb2-963f-07ae85008eb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:07:40.974774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: warnings.warn(msg) May 03 09:07:40.974774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: May 03 09:07:40.976003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d620ee-deb5-4cb2-963f-07ae85008eb9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:07:41.010359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 741/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:07:40 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:07:41.014421 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3ea18-40c4-4397-a566-bc09730ab9e3 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:07:41.024764 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3ea18-40c4-4397-a566-bc09730ab9e3 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:07:41.077279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67a284-56ca-4f36-b6db-26692ae0c912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:07:41.077933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67a284-56ca-4f36-b6db-26692ae0c912 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:41.078210 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67a284-56ca-4f36-b6db-26692ae0c912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:41.078476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67a284-56ca-4f36-b6db-26692ae0c912 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:41.079143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67a284-56ca-4f36-b6db-26692ae0c912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:07:41.080770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: WARNING py.warnings [None req-6a67a284-56ca-4f36-b6db-26692ae0c912 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:07:41.080770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: warnings.warn(msg) May 03 09:07:41.080770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: May 03 09:07:41.081941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67a284-56ca-4f36-b6db-26692ae0c912 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:07:41.100868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 757/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:07:41 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:07:41.104702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d620ee-deb5-4cb2-963f-07ae85008eb9 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:07:41.114911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d620ee-deb5-4cb2-963f-07ae85008eb9 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:07:41.119407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1893954-a68b-4294-91bb-a96af8d9c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:07:41.120050 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1893954-a68b-4294-91bb-a96af8d9c0ce admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:41.120545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1893954-a68b-4294-91bb-a96af8d9c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:41.120819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1893954-a68b-4294-91bb-a96af8d9c0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:41.121540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1893954-a68b-4294-91bb-a96af8d9c0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:07:41.122570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: WARNING py.warnings [None req-c1893954-a68b-4294-91bb-a96af8d9c0ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 09:07:41.122570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: warnings.warn(msg) May 03 09:07:41.122570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: May 03 09:07:41.123441 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1893954-a68b-4294-91bb-a96af8d9c0ce admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:07:41.138026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 742/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:07:41.144411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67a284-56ca-4f36-b6db-26692ae0c912 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:07:41.154158 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67a284-56ca-4f36-b6db-26692ae0c912 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:07:41.158619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb743fb-8c2d-4c68-866c-e26f483e0963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:07:41.159275 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb743fb-8c2d-4c68-866c-e26f483e0963 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:41.159547 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb743fb-8c2d-4c68-866c-e26f483e0963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:41.159824 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb743fb-8c2d-4c68-866c-e26f483e0963 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:41.160579 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb743fb-8c2d-4c68-866c-e26f483e0963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:07:41.161610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: WARNING py.warnings [None req-cfb743fb-8c2d-4c68-866c-e26f483e0963 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 09:07:41.161610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: warnings.warn(msg) May 03 09:07:41.161610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: May 03 09:07:41.162476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb743fb-8c2d-4c68-866c-e26f483e0963 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:07:41.176006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 758/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:07:41.180153 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1893954-a68b-4294-91bb-a96af8d9c0ce admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:07:41.190619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1893954-a68b-4294-91bb-a96af8d9c0ce admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:07:41.195009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9f8d0-f6a5-4370-b251-fb3636351f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:07:41.195863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9f8d0-f6a5-4370-b251-fb3636351f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:41.196176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9f8d0-f6a5-4370-b251-fb3636351f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:41.196448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9f8d0-f6a5-4370-b251-fb3636351f47 admin admin] PATH_INFO: `/v3/projects/57ceba5de83442a69b4529ad73fe0046/users/80a46aaf4e1f43289b8125f0088d0b28/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:41.210491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9f8d0-f6a5-4370-b251-fb3636351f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ceba5de83442a69b4529ad73fe0046, user_id=80a46aaf4e1f43289b8125f0088d0b28, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:07:41.211518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: WARNING py.warnings [None req-f8b9f8d0-f6a5-4370-b251-fb3636351f47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:07:41.211518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: warnings.warn(msg) May 03 09:07:41.211518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: May 03 09:07:41.213461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9f8d0-f6a5-4370-b251-fb3636351f47 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:07:41.226114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 743/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:07:41 2022] PUT /identity/v3/projects/57ceba5de83442a69b4529ad73fe0046/users/80a46aaf4e1f43289b8125f0088d0b28/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:07:41.238156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeab3e-1262-4b14-9a5c-b4cce38e960d None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:41.238446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeab3e-1262-4b14-9a5c-b4cce38e960d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:41.238726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeab3e-1262-4b14-9a5c-b4cce38e960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:41.264358 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-bfdeab3e-1262-4b14-9a5c-b4cce38e960d None None] MFA Rules not processed for user `80a46aaf4e1f43289b8125f0088d0b28`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:07:41.265548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-bfdeab3e-1262-4b14-9a5c-b4cce38e960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:07:41.325727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 759/1502] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:07:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:07:41.336499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9f8d0-f6a5-4370-b251-fb3636351f47 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:07:41.403634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9f8d0-f6a5-4370-b251-fb3636351f47 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:07:41.408973 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778f498-cd04-44fb-bae4-548e2f6796bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:07:41.409598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778f498-cd04-44fb-bae4-548e2f6796bb service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:41.409875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778f498-cd04-44fb-bae4-548e2f6796bb service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:41.410150 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778f498-cd04-44fb-bae4-548e2f6796bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:41.417828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778f498-cd04-44fb-bae4-548e2f6796bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:07:41.419412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778f498-cd04-44fb-bae4-548e2f6796bb service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:07:41.428699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 744/1503] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:07:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:07:41.499366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6dd4-b6de-4c55-8551-deacd1917b31 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:41.499650 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6dd4-b6de-4c55-8551-deacd1917b31 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:41.499922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6dd4-b6de-4c55-8551-deacd1917b31 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:41.501276 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 760/1504] 10.222.0.23 () {52 vars in 829 bytes} [Tue May 3 09:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:07:41.504827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778f498-cd04-44fb-bae4-548e2f6796bb service nova] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:07:41.566309 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778f498-cd04-44fb-bae4-548e2f6796bb service nova] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:07:41.570732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:07:41.571580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:41.571856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:41.572139 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] PATH_INFO: `/v3/users/80a46aaf4e1f43289b8125f0088d0b28` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:41.573323 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a46aaf4e1f43289b8125f0088d0b28)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:07:41.574329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: WARNING py.warnings [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:07:41.574329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: warnings.warn(msg) May 03 09:07:41.574329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: May 03 09:07:41.575497 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:07:41.635447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a46aaf4e1f43289b8125f0088d0b28'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:07:41.644801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a46aaf4e1f43289b8125f0088d0b28'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:07:41.656621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a46aaf4e1f43289b8125f0088d0b28'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:07:41.657277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a46aaf4e1f43289b8125f0088d0b28'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:07:41.658465 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a46aaf4e1f43289b8125f0088d0b28'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:07:41.681069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 745/1505] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:07:41 2022] DELETE /identity/v3/users/80a46aaf4e1f43289b8125f0088d0b28 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:07:41.685501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf67e1-5c86-46e5-ac48-d5096d2c6ef0 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:41.685787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf67e1-5c86-46e5-ac48-d5096d2c6ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:41.686060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf67e1-5c86-46e5-ac48-d5096d2c6ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:41.702934 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-5dcf67e1-5c86-46e5-ac48-d5096d2c6ef0 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:07:41.704101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5dcf67e1-5c86-46e5-ac48-d5096d2c6ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:07:41.761711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 761/1506] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:07:41.771395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:07:41.772850 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:07:41.827434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ea97-37f1-4dc9-b0ea-bec57a8949be admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:07:41.831470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bee263-4d46-4486-93f3-d4daa5ccd65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:07:41.832120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bee263-4d46-4486-93f3-d4daa5ccd65d service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:41.832408 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bee263-4d46-4486-93f3-d4daa5ccd65d service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:41.832681 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bee263-4d46-4486-93f3-d4daa5ccd65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:41.841400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bee263-4d46-4486-93f3-d4daa5ccd65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:07:41.842895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bee263-4d46-4486-93f3-d4daa5ccd65d service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:07:41.853207 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 746/1507] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:07:42.212281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf67e1-5c86-46e5-ac48-d5096d2c6ef0 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:07:42.213748 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5dcf67e1-5c86-46e5-ac48-d5096d2c6ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:07:42.225502 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf67e1-5c86-46e5-ac48-d5096d2c6ef0 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:07:42.230216 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:07:42.231068 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:07:42.231354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:07:42.231631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] PATH_INFO: `/v3/projects/57ceba5de83442a69b4529ad73fe0046` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:07:42.232841 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ceba5de83442a69b4529ad73fe0046)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:07:42.233864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: WARNING py.warnings [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:07:42.233864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: warnings.warn(msg) May 03 09:07:42.233864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: May 03 09:07:42.235038 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:07:42.293818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ceba5de83442a69b4529ad73fe0046', 'request_id': 'req-459056bb-7e6b-499f-bc9e-8270cd48626d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:07:42.303143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ceba5de83442a69b4529ad73fe0046', 'request_id': 'req-459056bb-7e6b-499f-bc9e-8270cd48626d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:07:42.308970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ceba5de83442a69b4529ad73fe0046', 'request_id': 'req-459056bb-7e6b-499f-bc9e-8270cd48626d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:07:42.328467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] The token cache is being invalidate because project 57ceba5de83442a69b4529ad73fe0046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:07:42.328751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:07:42.329380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-459056bb-7e6b-499f-bc9e-8270cd48626d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:07:42.331558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 762/1508] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:07:42 2022] DELETE /identity/v3/projects/57ceba5de83442a69b4529ad73fe0046 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:09:21.703715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffad4a0-ae75-4994-8f30-1760edcef102 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:21.704351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffad4a0-ae75-4994-8f30-1760edcef102 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:21.704351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffad4a0-ae75-4994-8f30-1760edcef102 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:21.705697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 747/1509] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:09:21.710493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512ed50-c5f5-4620-8ca5-5edfc3f88496 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:21.710904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512ed50-c5f5-4620-8ca5-5edfc3f88496 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:21.711036 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512ed50-c5f5-4620-8ca5-5edfc3f88496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:21.728659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e512ed50-c5f5-4620-8ca5-5edfc3f88496 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:09:21.729853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e512ed50-c5f5-4620-8ca5-5edfc3f88496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:21.784539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 763/1510] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:09:21.934888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffad4a0-ae75-4994-8f30-1760edcef102 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:09:21.936580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7ffad4a0-ae75-4994-8f30-1760edcef102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:22.008224 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffad4a0-ae75-4994-8f30-1760edcef102 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:09:22.013523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3263-a2b1-4327-b8c6-5befe0c01695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:09:22.014151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3263-a2b1-4327-b8c6-5befe0c01695 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:22.014434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3263-a2b1-4327-b8c6-5befe0c01695 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:22.014709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3263-a2b1-4327-b8c6-5befe0c01695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:22.023006 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba3263-a2b1-4327-b8c6-5befe0c01695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:09:22.024605 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba3263-a2b1-4327-b8c6-5befe0c01695 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:09:22.033768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 748/1511] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:09:22.674775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33095534-50da-496b-a864-8b1046b24562 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:22.675067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33095534-50da-496b-a864-8b1046b24562 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:22.675340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33095534-50da-496b-a864-8b1046b24562 None None] PATH_INFO: `/v3` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:22.676703 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 764/1512] 10.222.0.36 () {54 vars in 925 bytes} [Tue May 3 09:09:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:09:22.683912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a67cf1-d31b-4de5-8ed1-48fae08a43f7 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:22.684230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a67cf1-d31b-4de5-8ed1-48fae08a43f7 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:22.684514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a67cf1-d31b-4de5-8ed1-48fae08a43f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:22.702325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-21a67cf1-d31b-4de5-8ed1-48fae08a43f7 None None] MFA Rules not processed for user `0f7f2aea3e494546a04e20d8cedccc9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:09:22.703532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-21a67cf1-d31b-4de5-8ed1-48fae08a43f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:22.763806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 749/1513] 10.222.0.36 () {58 vars in 1015 bytes} [Tue May 3 09:09:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:09:23.257925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0326853-1884-4609-89dd-ab1e3df31f6c None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:23.258387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0326853-1884-4609-89dd-ab1e3df31f6c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:23.258491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0326853-1884-4609-89dd-ab1e3df31f6c None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:23.259844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:09:23.264680 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9f39-241a-49b4-a7ca-b033b44b9a15 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:23.264965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9f39-241a-49b4-a7ca-b033b44b9a15 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:23.265235 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9f39-241a-49b4-a7ca-b033b44b9a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:23.283981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-2f2e9f39-241a-49b4-a7ca-b033b44b9a15 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:09:23.285190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2f2e9f39-241a-49b4-a7ca-b033b44b9a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:23.292858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:09:23.441362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0326853-1884-4609-89dd-ab1e3df31f6c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:09:23.455785 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0326853-1884-4609-89dd-ab1e3df31f6c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:09:23.461153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515715f8-7b1c-4786-99f4-b129b5281280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:09:23.461775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515715f8-7b1c-4786-99f4-b129b5281280 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:23.462053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515715f8-7b1c-4786-99f4-b129b5281280 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:23.462324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515715f8-7b1c-4786-99f4-b129b5281280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:23.470125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515715f8-7b1c-4786-99f4-b129b5281280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:09:23.471690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515715f8-7b1c-4786-99f4-b129b5281280 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:09:23.480713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 766/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:09:31.950429 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a9aa4-f251-4313-90d6-6e17e55e0a26 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:31.950968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a9aa4-f251-4313-90d6-6e17e55e0a26 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:31.950968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a9aa4-f251-4313-90d6-6e17e55e0a26 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:31.952557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 751/1517] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 3 09:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:09:31.957735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51860395-936d-4ae5-a4bb-f7893b7fc9fa None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:31.958195 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51860395-936d-4ae5-a4bb-f7893b7fc9fa None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:31.958316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51860395-936d-4ae5-a4bb-f7893b7fc9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:31.976045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-51860395-936d-4ae5-a4bb-f7893b7fc9fa None None] MFA Rules not processed for user `0f7f2aea3e494546a04e20d8cedccc9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:09:31.977249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-51860395-936d-4ae5-a4bb-f7893b7fc9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:31.986225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 767/1518] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 3 09:09:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:09:31.993393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a9aa4-f251-4313-90d6-6e17e55e0a26 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:09:32.006425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a9aa4-f251-4313-90d6-6e17e55e0a26 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:09:32.011204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76ea58-8dc6-470b-9076-3c48ee48e136 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7f2aea3e494546a04e20d8cedccc9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:09:32.011810 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ea58-8dc6-470b-9076-3c48ee48e136 service placement] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:32.012107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ea58-8dc6-470b-9076-3c48ee48e136 service placement] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:32.012380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ea58-8dc6-470b-9076-3c48ee48e136 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:32.020335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76ea58-8dc6-470b-9076-3c48ee48e136 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:09:32.021954 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76ea58-8dc6-470b-9076-3c48ee48e136 service placement] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:09:32.031090 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 752/1519] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:09:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:09:35.086527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519517c-70a1-427a-b043-70760c5caa6d None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:35.087069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519517c-70a1-427a-b043-70760c5caa6d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:35.087069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519517c-70a1-427a-b043-70760c5caa6d None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:35.088483 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 768/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:09:35.094457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fa5d0-0c78-48c2-9fed-2e68ffcb680e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:35.094883 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fa5d0-0c78-48c2-9fed-2e68ffcb680e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:35.094999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fa5d0-0c78-48c2-9fed-2e68ffcb680e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:35.114170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-018fa5d0-0c78-48c2-9fed-2e68ffcb680e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:09:35.115355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-018fa5d0-0c78-48c2-9fed-2e68ffcb680e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:35.122926 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 753/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:09:35.273087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519517c-70a1-427a-b043-70760c5caa6d None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:09:35.287946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519517c-70a1-427a-b043-70760c5caa6d None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:09:35.293217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea2f06-e14b-42ff-b491-abe47555342f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:09:35.293828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea2f06-e14b-42ff-b491-abe47555342f service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:35.294103 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea2f06-e14b-42ff-b491-abe47555342f service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:35.294377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea2f06-e14b-42ff-b491-abe47555342f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:35.302351 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea2f06-e14b-42ff-b491-abe47555342f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:09:35.303908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea2f06-e14b-42ff-b491-abe47555342f service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:09:35.313178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 769/1522] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:09:36.517228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47450229-2ba3-4642-862b-f49f35ed98bc None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:36.517787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47450229-2ba3-4642-862b-f49f35ed98bc None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:36.517787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47450229-2ba3-4642-862b-f49f35ed98bc None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:36.519174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 754/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:09:36.523887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433761cb-0336-4c48-a50c-b00c09bfe3cd None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:36.524303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433761cb-0336-4c48-a50c-b00c09bfe3cd None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:36.524456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433761cb-0336-4c48-a50c-b00c09bfe3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:36.541785 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-433761cb-0336-4c48-a50c-b00c09bfe3cd None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:09:36.542978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-433761cb-0336-4c48-a50c-b00c09bfe3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:36.551126 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 770/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:09:36.704214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47450229-2ba3-4642-862b-f49f35ed98bc None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:09:36.718147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47450229-2ba3-4642-862b-f49f35ed98bc None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:09:36.723576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a080-edab-41a9-b0fa-81fed4e74972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:09:36.724227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a080-edab-41a9-b0fa-81fed4e74972 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:36.724511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a080-edab-41a9-b0fa-81fed4e74972 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:36.724785 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a080-edab-41a9-b0fa-81fed4e74972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:36.732622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a080-edab-41a9-b0fa-81fed4e74972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:09:36.734726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a080-edab-41a9-b0fa-81fed4e74972 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:09:36.743772 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 755/1525] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:09:40.922153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0d45-7ac8-4658-9fa5-7baa6cf6b82b None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:40.922729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0d45-7ac8-4658-9fa5-7baa6cf6b82b None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:40.922729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0d45-7ac8-4658-9fa5-7baa6cf6b82b None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:40.924065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 771/1526] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:09:40.929250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cc554-880a-4132-812e-e46185cd9970 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:40.929727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cc554-880a-4132-812e-e46185cd9970 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:40.929833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cc554-880a-4132-812e-e46185cd9970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:40.952293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-700cc554-880a-4132-812e-e46185cd9970 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:09:40.953503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-700cc554-880a-4132-812e-e46185cd9970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:40.961555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 756/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:09:40.998596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0d45-7ac8-4658-9fa5-7baa6cf6b82b None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:09:41.000336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-06db0d45-7ac8-4658-9fa5-7baa6cf6b82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:41.055371 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0d45-7ac8-4658-9fa5-7baa6cf6b82b None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:09:41.058925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6b9dd-350c-43ea-8a5f-e899afe6ea76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:09:41.059557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6b9dd-350c-43ea-8a5f-e899afe6ea76 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:41.059844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6b9dd-350c-43ea-8a5f-e899afe6ea76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:41.060149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6b9dd-350c-43ea-8a5f-e899afe6ea76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:41.069048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6b9dd-350c-43ea-8a5f-e899afe6ea76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:09:41.070462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6b9dd-350c-43ea-8a5f-e899afe6ea76 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:09:41.080057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 772/1528] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:09:43.295469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ce50-9067-4999-bd43-c9942072c641 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:43.296062 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ce50-9067-4999-bd43-c9942072c641 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:43.296062 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ce50-9067-4999-bd43-c9942072c641 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:43.297994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 757/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:09:43.303222 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a14a9-491a-41e2-b994-b2e628d7ac27 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:43.303718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a14a9-491a-41e2-b994-b2e628d7ac27 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:43.303819 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a14a9-491a-41e2-b994-b2e628d7ac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:43.321465 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-1b8a14a9-491a-41e2-b994-b2e628d7ac27 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:09:43.322638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-1b8a14a9-491a-41e2-b994-b2e628d7ac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:43.330852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 773/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:09:43.365523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419ce50-9067-4999-bd43-c9942072c641 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:09:43.376195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419ce50-9067-4999-bd43-c9942072c641 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:09:43.379662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537f109-9812-4696-aed6-70c2e710456a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:09:43.380322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537f109-9812-4696-aed6-70c2e710456a service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:43.380603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537f109-9812-4696-aed6-70c2e710456a service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:43.380874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537f109-9812-4696-aed6-70c2e710456a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:43.389317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537f109-9812-4696-aed6-70c2e710456a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:09:43.391245 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537f109-9812-4696-aed6-70c2e710456a service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:09:43.400296 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 758/1531] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:09:47.189688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753397d0-3365-49e3-9d7a-d6fff1a44cb4 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:47.190192 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753397d0-3365-49e3-9d7a-d6fff1a44cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:47.190307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753397d0-3365-49e3-9d7a-d6fff1a44cb4 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:47.191617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 774/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:09:47.196963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244a47d-26e8-4af5-9095-5f23975afe17 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:47.197390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244a47d-26e8-4af5-9095-5f23975afe17 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:47.197523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244a47d-26e8-4af5-9095-5f23975afe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:47.215228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f244a47d-26e8-4af5-9095-5f23975afe17 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:09:47.216449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f244a47d-26e8-4af5-9095-5f23975afe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:47.224249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 759/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:09:47.495682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753397d0-3365-49e3-9d7a-d6fff1a44cb4 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:09:47.497386 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-753397d0-3365-49e3-9d7a-d6fff1a44cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:47.551507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753397d0-3365-49e3-9d7a-d6fff1a44cb4 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:09:47.555636 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598ebdd-1152-4ec5-9313-4f2514983394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:09:47.556634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598ebdd-1152-4ec5-9313-4f2514983394 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:47.556918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598ebdd-1152-4ec5-9313-4f2514983394 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:47.557193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598ebdd-1152-4ec5-9313-4f2514983394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:47.566344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598ebdd-1152-4ec5-9313-4f2514983394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:09:47.567769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598ebdd-1152-4ec5-9313-4f2514983394 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:09:47.576802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 775/1534] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:09:49.852379 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fd025-4ac3-4c50-bd18-2e8ebf41328b None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:49.852966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fd025-4ac3-4c50-bd18-2e8ebf41328b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:49.852966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fd025-4ac3-4c50-bd18-2e8ebf41328b None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:49.854289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 760/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:09:49.859441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899a265-264b-4a2e-b93a-ae41071b7883 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:49.859867 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899a265-264b-4a2e-b93a-ae41071b7883 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:49.859999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899a265-264b-4a2e-b93a-ae41071b7883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:49.878202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-0899a265-264b-4a2e-b93a-ae41071b7883 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:09:49.879396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0899a265-264b-4a2e-b93a-ae41071b7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:49.887187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 776/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:09:50.156566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837538-bea7-47a7-affd-d875c6576e7e None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:50.157046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837538-bea7-47a7-affd-d875c6576e7e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:50.157450 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837538-bea7-47a7-affd-d875c6576e7e None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:50.159084 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 761/1537] 10.222.0.23 () {54 vars in 963 bytes} [Tue May 3 09:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:09:50.164106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0ee04-d79c-4aaa-917c-2b00b87da3f9 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:50.164451 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0ee04-d79c-4aaa-917c-2b00b87da3f9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:50.164735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0ee04-d79c-4aaa-917c-2b00b87da3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:50.182746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-cec0ee04-d79c-4aaa-917c-2b00b87da3f9 None None] MFA Rules not processed for user `17e1e2dc0a0a45f4a36d1369edcc6e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:09:50.183902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-cec0ee04-d79c-4aaa-917c-2b00b87da3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:09:50.190837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 777/1538] 10.222.0.23 () {58 vars in 1060 bytes} [Tue May 3 09:09:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:09:50.198149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6837538-bea7-47a7-affd-d875c6576e7e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:09:50.208406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6837538-bea7-47a7-affd-d875c6576e7e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:09:50.211855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579ecb4-33a1-45ab-af5a-73113fbb3a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:09:50.212513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579ecb4-33a1-45ab-af5a-73113fbb3a9c service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:09:50.212796 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579ecb4-33a1-45ab-af5a-73113fbb3a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:09:50.213070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579ecb4-33a1-45ab-af5a-73113fbb3a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:09:50.222001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579ecb4-33a1-45ab-af5a-73113fbb3a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:09:50.223424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579ecb4-33a1-45ab-af5a-73113fbb3a9c service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:09:50.232706 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 762/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:20.625194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714260eb-4c3a-4db1-aa01-4f1f99bb6f94 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:20.626334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714260eb-4c3a-4db1-aa01-4f1f99bb6f94 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:20.626862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714260eb-4c3a-4db1-aa01-4f1f99bb6f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:20.670070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-714260eb-4c3a-4db1-aa01-4f1f99bb6f94 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:20.671331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-714260eb-4c3a-4db1-aa01-4f1f99bb6f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:20.685992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 778/1540] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:11:20.696786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d020c61-3405-48eb-96f8-b0b67342cdd9 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:20.697733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d020c61-3405-48eb-96f8-b0b67342cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:20.698211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d020c61-3405-48eb-96f8-b0b67342cdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:20.722791 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0d020c61-3405-48eb-96f8-b0b67342cdd9 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:20.724800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0d020c61-3405-48eb-96f8-b0b67342cdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:20.741506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 763/1541] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:11:20.746673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714260eb-4c3a-4db1-aa01-4f1f99bb6f94 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:20.762166 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714260eb-4c3a-4db1-aa01-4f1f99bb6f94 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:20.773357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c8c6f-98ab-4301-8f9e-abaa2fed0518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:20.774038 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c8c6f-98ab-4301-8f9e-abaa2fed0518 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:20.774321 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c8c6f-98ab-4301-8f9e-abaa2fed0518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:20.774598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c8c6f-98ab-4301-8f9e-abaa2fed0518 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:20.775344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c8c6f-98ab-4301-8f9e-abaa2fed0518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:20.775650 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c8c6f-98ab-4301-8f9e-abaa2fed0518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:20.777290 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c8c6f-98ab-4301-8f9e-abaa2fed0518 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:20.798199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 779/1542] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:20.806285 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d020c61-3405-48eb-96f8-b0b67342cdd9 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:20.821952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d020c61-3405-48eb-96f8-b0b67342cdd9 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:20.831887 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873a0ae-238d-4133-a18e-1f29b56ee19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:20.832881 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873a0ae-238d-4133-a18e-1f29b56ee19b admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:20.833364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873a0ae-238d-4133-a18e-1f29b56ee19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:20.833828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873a0ae-238d-4133-a18e-1f29b56ee19b admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:20.834738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873a0ae-238d-4133-a18e-1f29b56ee19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:20.836868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873a0ae-238d-4133-a18e-1f29b56ee19b admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:20.878468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 764/1543] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:20 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:20.882878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c8c6f-98ab-4301-8f9e-abaa2fed0518 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:20.892521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41410929-bf85-40fa-b29d-03f900af0831 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:20.893122 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41410929-bf85-40fa-b29d-03f900af0831 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:20.893595 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41410929-bf85-40fa-b29d-03f900af0831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:20.896899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c8c6f-98ab-4301-8f9e-abaa2fed0518 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:20.921987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-41410929-bf85-40fa-b29d-03f900af0831 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:20.923208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-41410929-bf85-40fa-b29d-03f900af0831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:20.971642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f78e07-038c-46f9-b98a-0f6c30e21f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:20.972744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f78e07-038c-46f9-b98a-0f6c30e21f0c admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:20.973246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f78e07-038c-46f9-b98a-0f6c30e21f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:20.973721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f78e07-038c-46f9-b98a-0f6c30e21f0c admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:20.974966 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f78e07-038c-46f9-b98a-0f6c30e21f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:20.977178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f78e07-038c-46f9-b98a-0f6c30e21f0c admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.002794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 765/1544] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.004177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0bd1f-9600-4f5e-addf-058edb942c5f None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.004473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0bd1f-9600-4f5e-addf-058edb942c5f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.004942 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0bd1f-9600-4f5e-addf-058edb942c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.011437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 780/1545] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:20 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.014773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b49ba-fcdb-4f8a-a4b4-9f6151bdcde5 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.014773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b49ba-fcdb-4f8a-a4b4-9f6151bdcde5 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.014773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b49ba-fcdb-4f8a-a4b4-9f6151bdcde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.022862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8ac0bd1f-9600-4f5e-addf-058edb942c5f None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.024076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8ac0bd1f-9600-4f5e-addf-058edb942c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.032262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-2a2b49ba-fcdb-4f8a-a4b4-9f6151bdcde5 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.032467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 766/1546] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.039120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-2a2b49ba-fcdb-4f8a-a4b4-9f6151bdcde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.039276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60d77e-1532-43a7-befb-f5cab16eff4f None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.039276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60d77e-1532-43a7-befb-f5cab16eff4f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.039276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60d77e-1532-43a7-befb-f5cab16eff4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.041172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 781/1547] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.042393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac03a3-0238-42d2-9e3d-d6fe080ea961 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.042672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac03a3-0238-42d2-9e3d-d6fe080ea961 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.042942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac03a3-0238-42d2-9e3d-d6fe080ea961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.052999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-4c60d77e-1532-43a7-befb-f5cab16eff4f None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.054183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4c60d77e-1532-43a7-befb-f5cab16eff4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.061447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f6ac03a3-0238-42d2-9e3d-d6fe080ea961 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.062527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 767/1548] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.062665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f6ac03a3-0238-42d2-9e3d-d6fe080ea961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.063562 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7d6c5-bdf6-4cfd-93fc-af9718146b48 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.063866 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7d6c5-bdf6-4cfd-93fc-af9718146b48 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.064152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7d6c5-bdf6-4cfd-93fc-af9718146b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.070788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 782/1549] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.072105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c00c19-e6db-4afe-b2e4-1c023604d83a None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.072420 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c00c19-e6db-4afe-b2e4-1c023604d83a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.072700 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c00c19-e6db-4afe-b2e4-1c023604d83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.082015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-78b7d6c5-bdf6-4cfd-93fc-af9718146b48 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.083210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-78b7d6c5-bdf6-4cfd-93fc-af9718146b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.091405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e2c00c19-e6db-4afe-b2e4-1c023604d83a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.091626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 768/1550] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.092658 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e2c00c19-e6db-4afe-b2e4-1c023604d83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.092983 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53e9fd-b2d4-4b01-99d4-8ce69885e78a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.093165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53e9fd-b2d4-4b01-99d4-8ce69885e78a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.093513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53e9fd-b2d4-4b01-99d4-8ce69885e78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.103366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 783/1551] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.105380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c00c19-e6db-4afe-b2e4-1c023604d83a None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.115029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c00c19-e6db-4afe-b2e4-1c023604d83a None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.115363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-4b53e9fd-b2d4-4b01-99d4-8ce69885e78a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.116592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4b53e9fd-b2d4-4b01-99d4-8ce69885e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.119578 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71ba67-3fb8-46a6-89ce-05fe0f8f6680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.120256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71ba67-3fb8-46a6-89ce-05fe0f8f6680 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.120539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71ba67-3fb8-46a6-89ce-05fe0f8f6680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.120809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71ba67-3fb8-46a6-89ce-05fe0f8f6680 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.121549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71ba67-3fb8-46a6-89ce-05fe0f8f6680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.123159 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71ba67-3fb8-46a6-89ce-05fe0f8f6680 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.124618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 769/1552] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.125801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b976f2e-c41d-4b7d-8a47-594800b843ca None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.126086 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b976f2e-c41d-4b7d-8a47-594800b843ca None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.126359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b976f2e-c41d-4b7d-8a47-594800b843ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.136657 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 784/1553] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:21.138674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3f665-84b8-46ce-b2c0-1bf5e7bbf3f5 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.138674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3f665-84b8-46ce-b2c0-1bf5e7bbf3f5 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.138959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3f665-84b8-46ce-b2c0-1bf5e7bbf3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.143955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5b976f2e-c41d-4b7d-8a47-594800b843ca None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.145192 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5b976f2e-c41d-4b7d-8a47-594800b843ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.153178 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 770/1554] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.155027 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b434-5ffa-4fc0-94ab-9ef6b2e961c4 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.155315 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b434-5ffa-4fc0-94ab-9ef6b2e961c4 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.155591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b434-5ffa-4fc0-94ab-9ef6b2e961c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.156708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-44a3f665-84b8-46ce-b2c0-1bf5e7bbf3f5 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.157983 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-44a3f665-84b8-46ce-b2c0-1bf5e7bbf3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.165672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 785/1555] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.166871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b298c4-5967-461e-8203-ec041a88cde7 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.167156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b298c4-5967-461e-8203-ec041a88cde7 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.167439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b298c4-5967-461e-8203-ec041a88cde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.175408 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-2bb4b434-5ffa-4fc0-94ab-9ef6b2e961c4 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.176609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2bb4b434-5ffa-4fc0-94ab-9ef6b2e961c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.184230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-65b298c4-5967-461e-8203-ec041a88cde7 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.184546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 771/1556] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.185658 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-65b298c4-5967-461e-8203-ec041a88cde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.185976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a52b6-427f-4127-a83b-f0952b879ca3 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.186256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a52b6-427f-4127-a83b-f0952b879ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.186526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a52b6-427f-4127-a83b-f0952b879ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.195646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 786/1557] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.196870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05f631-ab8d-459b-b026-72a755b8cd80 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.197228 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05f631-ab8d-459b-b026-72a755b8cd80 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.197576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05f631-ab8d-459b-b026-72a755b8cd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.205679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0d3a52b6-427f-4127-a83b-f0952b879ca3 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.209894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0d3a52b6-427f-4127-a83b-f0952b879ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.215436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-8b05f631-ab8d-459b-b026-72a755b8cd80 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.217786 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8b05f631-ab8d-459b-b026-72a755b8cd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.218168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 772/1558] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.219003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a52b6-427f-4127-a83b-f0952b879ca3 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.228844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 787/1559] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.229628 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05f631-ab8d-459b-b026-72a755b8cd80 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.230158 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a52b6-427f-4127-a83b-f0952b879ca3 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.234838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462ddd0-ef74-4b74-acc4-62be2aa9f795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.235485 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462ddd0-ef74-4b74-acc4-62be2aa9f795 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.235762 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462ddd0-ef74-4b74-acc4-62be2aa9f795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.236030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462ddd0-ef74-4b74-acc4-62be2aa9f795 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.236776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462ddd0-ef74-4b74-acc4-62be2aa9f795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:21.237073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462ddd0-ef74-4b74-acc4-62be2aa9f795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.238078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: WARNING py.warnings [None req-a462ddd0-ef74-4b74-acc4-62be2aa9f795 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 09:11:21.238078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: warnings.warn(msg) May 03 09:11:21.238078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: May 03 09:11:21.238953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462ddd0-ef74-4b74-acc4-62be2aa9f795 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.239060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05f631-ab8d-459b-b026-72a755b8cd80 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.243424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1026b22-b480-4472-a0bd-9e4a7cfe03cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.244102 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1026b22-b480-4472-a0bd-9e4a7cfe03cb admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.244394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1026b22-b480-4472-a0bd-9e4a7cfe03cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.244662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1026b22-b480-4472-a0bd-9e4a7cfe03cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.245375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1026b22-b480-4472-a0bd-9e4a7cfe03cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.247095 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1026b22-b480-4472-a0bd-9e4a7cfe03cb admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.250189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 773/1560] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:21.251034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462ddd0-ef74-4b74-acc4-62be2aa9f795 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.256792 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 788/1561] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:21.258212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1026b22-b480-4472-a0bd-9e4a7cfe03cb admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.260586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462ddd0-ef74-4b74-acc4-62be2aa9f795 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.265764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b009f-c705-4f2d-bc7f-97c95164d988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.266406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b009f-c705-4f2d-bc7f-97c95164d988 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.266689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b009f-c705-4f2d-bc7f-97c95164d988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.266963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b009f-c705-4f2d-bc7f-97c95164d988 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.267677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b009f-c705-4f2d-bc7f-97c95164d988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:21.267978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b009f-c705-4f2d-bc7f-97c95164d988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.268175 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1026b22-b480-4472-a0bd-9e4a7cfe03cb admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.269598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b009f-c705-4f2d-bc7f-97c95164d988 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.272765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c618d-dd99-473f-823f-43960e1f2f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.273383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c618d-dd99-473f-823f-43960e1f2f0e admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.273663 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c618d-dd99-473f-823f-43960e1f2f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.273935 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c618d-dd99-473f-823f-43960e1f2f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.274641 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c618d-dd99-473f-823f-43960e1f2f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:21.274941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c618d-dd99-473f-823f-43960e1f2f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.276521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c618d-dd99-473f-823f-43960e1f2f0e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.281812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 774/1562] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:21.282590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b009f-c705-4f2d-bc7f-97c95164d988 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.291279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 789/1563] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:21.292193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c618d-dd99-473f-823f-43960e1f2f0e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.292548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b009f-c705-4f2d-bc7f-97c95164d988 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.301797 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889f6c9-28a3-494f-99e9-2f5816c089a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.302433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889f6c9-28a3-494f-99e9-2f5816c089a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.302711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889f6c9-28a3-494f-99e9-2f5816c089a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.302980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889f6c9-28a3-494f-99e9-2f5816c089a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.303692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889f6c9-28a3-494f-99e9-2f5816c089a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:21.303992 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889f6c9-28a3-494f-99e9-2f5816c089a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.305594 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889f6c9-28a3-494f-99e9-2f5816c089a7 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.307144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c618d-dd99-473f-823f-43960e1f2f0e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.313716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50458e8e-e6ae-48b0-98ad-11632a773a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.314361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458e8e-e6ae-48b0-98ad-11632a773a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.314687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458e8e-e6ae-48b0-98ad-11632a773a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.315023 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458e8e-e6ae-48b0-98ad-11632a773a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.315803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50458e8e-e6ae-48b0-98ad-11632a773a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:21.316259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50458e8e-e6ae-48b0-98ad-11632a773a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.318530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 775/1564] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:21.318677 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50458e8e-e6ae-48b0-98ad-11632a773a0b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.319343 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889f6c9-28a3-494f-99e9-2f5816c089a7 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.329168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889f6c9-28a3-494f-99e9-2f5816c089a7 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.331014 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 790/1565] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:21.331998 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50458e8e-e6ae-48b0-98ad-11632a773a0b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.340479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65841a-d37e-4b04-be04-1e4a74490be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.341743 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65841a-d37e-4b04-be04-1e4a74490be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.341870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50458e8e-e6ae-48b0-98ad-11632a773a0b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.342026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65841a-d37e-4b04-be04-1e4a74490be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.342373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65841a-d37e-4b04-be04-1e4a74490be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.343022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65841a-d37e-4b04-be04-1e4a74490be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:21.343326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65841a-d37e-4b04-be04-1e4a74490be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.344943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65841a-d37e-4b04-be04-1e4a74490be9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.346373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287bda7-9484-4010-82b2-7e7bf8a44a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.346991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287bda7-9484-4010-82b2-7e7bf8a44a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.347269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287bda7-9484-4010-82b2-7e7bf8a44a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.347539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287bda7-9484-4010-82b2-7e7bf8a44a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.348269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287bda7-9484-4010-82b2-7e7bf8a44a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:21.348571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287bda7-9484-4010-82b2-7e7bf8a44a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.350115 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287bda7-9484-4010-82b2-7e7bf8a44a1d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.357106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 776/1566] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:21.357663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65841a-d37e-4b04-be04-1e4a74490be9 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.361598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 791/1567] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:21.362356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287bda7-9484-4010-82b2-7e7bf8a44a1d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.371649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287bda7-9484-4010-82b2-7e7bf8a44a1d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.375146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65841a-d37e-4b04-be04-1e4a74490be9 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.376184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d7a00-31fc-4157-86ff-fe56f830ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.377056 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d7a00-31fc-4157-86ff-fe56f830ab2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.377334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d7a00-31fc-4157-86ff-fe56f830ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.377603 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d7a00-31fc-4157-86ff-fe56f830ab2b admin admin] PATH_INFO: `/v3/projects/bbeea3c05a324177bee4dd9da8f9bfb1/users/a8828bb9477c48f7b464b0fed467fe62/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.379655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75fa9-e21e-4cd4-967a-a511d70d83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.380349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75fa9-e21e-4cd4-967a-a511d70d83c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.380627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75fa9-e21e-4cd4-967a-a511d70d83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.380899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75fa9-e21e-4cd4-967a-a511d70d83c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.381586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75fa9-e21e-4cd4-967a-a511d70d83c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.383463 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75fa9-e21e-4cd4-967a-a511d70d83c4 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.392283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d7a00-31fc-4157-86ff-fe56f830ab2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbeea3c05a324177bee4dd9da8f9bfb1, user_id=a8828bb9477c48f7b464b0fed467fe62, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.393246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: WARNING py.warnings [None req-d71d7a00-31fc-4157-86ff-fe56f830ab2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:11:21.393246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: warnings.warn(msg) May 03 09:11:21.393246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: May 03 09:11:21.395116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d7a00-31fc-4157-86ff-fe56f830ab2b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.408792 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 792/1568] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:21 2022] PUT /identity/v3/projects/bbeea3c05a324177bee4dd9da8f9bfb1/users/a8828bb9477c48f7b464b0fed467fe62/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:21.409384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d7a00-31fc-4157-86ff-fe56f830ab2b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.409736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 777/1569] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.410531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75fa9-e21e-4cd4-967a-a511d70d83c4 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.474787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d7a00-31fc-4157-86ff-fe56f830ab2b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.475049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75fa9-e21e-4cd4-967a-a511d70d83c4 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.479467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f65d6c-5c81-4a3e-aeff-867dde85e906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.479642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbea05-b906-4603-a4b1-8662931fb9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.480129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f65d6c-5c81-4a3e-aeff-867dde85e906 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.480253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbea05-b906-4603-a4b1-8662931fb9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.480434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f65d6c-5c81-4a3e-aeff-867dde85e906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.480580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbea05-b906-4603-a4b1-8662931fb9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.480698 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f65d6c-5c81-4a3e-aeff-867dde85e906 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.480794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbea05-b906-4603-a4b1-8662931fb9f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.481432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f65d6c-5c81-4a3e-aeff-867dde85e906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.481561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbea05-b906-4603-a4b1-8662931fb9f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.482437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: WARNING py.warnings [None req-25f65d6c-5c81-4a3e-aeff-867dde85e906 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:11:21.482437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: warnings.warn(msg) May 03 09:11:21.482437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: May 03 09:11:21.483338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbea05-b906-4603-a4b1-8662931fb9f8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.483591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f65d6c-5c81-4a3e-aeff-867dde85e906 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.508403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 793/1570] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.509200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f65d6c-5c81-4a3e-aeff-867dde85e906 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.510104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 778/1571] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.510780 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbea05-b906-4603-a4b1-8662931fb9f8 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.570091 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbea05-b906-4603-a4b1-8662931fb9f8 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.571164 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f65d6c-5c81-4a3e-aeff-867dde85e906 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.576950 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaffa26-400c-4bd2-ba11-8603287b9508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.577244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6c146-f490-45f9-863b-c6acf3e7076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.577679 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaffa26-400c-4bd2-ba11-8603287b9508 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.578002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaffa26-400c-4bd2-ba11-8603287b9508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.578123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6c146-f490-45f9-863b-c6acf3e7076e admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.578290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6c146-f490-45f9-863b-c6acf3e7076e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.578387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaffa26-400c-4bd2-ba11-8603287b9508 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.578557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6c146-f490-45f9-863b-c6acf3e7076e admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.579236 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaffa26-400c-4bd2-ba11-8603287b9508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.579361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6c146-f490-45f9-863b-c6acf3e7076e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.581244 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaffa26-400c-4bd2-ba11-8603287b9508 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.581428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6c146-f490-45f9-863b-c6acf3e7076e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.606267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 779/1572] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.606591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 794/1573] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.607563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaffa26-400c-4bd2-ba11-8603287b9508 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.607797 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6c146-f490-45f9-863b-c6acf3e7076e admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.667367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6c146-f490-45f9-863b-c6acf3e7076e admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.667557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaffa26-400c-4bd2-ba11-8603287b9508 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.671859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d1cda-fd2c-40b0-b65f-e78ffb0265c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.672070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca678d49-5b06-4e1c-8dd9-6b4aa28e3af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.672539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d1cda-fd2c-40b0-b65f-e78ffb0265c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.672740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca678d49-5b06-4e1c-8dd9-6b4aa28e3af5 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.672837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d1cda-fd2c-40b0-b65f-e78ffb0265c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.673036 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca678d49-5b06-4e1c-8dd9-6b4aa28e3af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.673154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d1cda-fd2c-40b0-b65f-e78ffb0265c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.673300 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca678d49-5b06-4e1c-8dd9-6b4aa28e3af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.673745 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d1cda-fd2c-40b0-b65f-e78ffb0265c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.673972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca678d49-5b06-4e1c-8dd9-6b4aa28e3af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.675647 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d1cda-fd2c-40b0-b65f-e78ffb0265c7 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.675843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca678d49-5b06-4e1c-8dd9-6b4aa28e3af5 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.702337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 795/1574] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/projects => generated 405 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.703803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1c0ee-acb5-4833-a6bc-624e563e20e7 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.704103 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1c0ee-acb5-4833-a6bc-624e563e20e7 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.704381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1c0ee-acb5-4833-a6bc-624e563e20e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.707205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 780/1575] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.708049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d1cda-fd2c-40b0-b65f-e78ffb0265c7 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.729378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-66c1c0ee-acb5-4833-a6bc-624e563e20e7 None None] MFA Rules not processed for user `a8828bb9477c48f7b464b0fed467fe62`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:21.730565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-66c1c0ee-acb5-4833-a6bc-624e563e20e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:21.766141 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d1cda-fd2c-40b0-b65f-e78ffb0265c7 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.770715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209fdb1-832a-40f4-ac91-6fab988c8c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.771369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209fdb1-832a-40f4-ac91-6fab988c8c05 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.771649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209fdb1-832a-40f4-ac91-6fab988c8c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.771925 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209fdb1-832a-40f4-ac91-6fab988c8c05 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.772674 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209fdb1-832a-40f4-ac91-6fab988c8c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.773980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: WARNING py.warnings [None req-4209fdb1-832a-40f4-ac91-6fab988c8c05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:11:21.773980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: warnings.warn(msg) May 03 09:11:21.773980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: May 03 09:11:21.775215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209fdb1-832a-40f4-ac91-6fab988c8c05 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.793758 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 796/1576] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:21.795321 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1c0ee-acb5-4833-a6bc-624e563e20e7 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.796792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 781/1577] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.797741 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209fdb1-832a-40f4-ac91-6fab988c8c05 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.808658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209fdb1-832a-40f4-ac91-6fab988c8c05 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.809354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1c0ee-acb5-4833-a6bc-624e563e20e7 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.813992 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82c03b-9277-4673-96b2-510730a2eff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.814642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c03b-9277-4673-96b2-510730a2eff3 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.814948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c03b-9277-4673-96b2-510730a2eff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.815236 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c03b-9277-4673-96b2-510730a2eff3 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.815390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df543594-f5f5-4971-84ba-ba557e65eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.815939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82c03b-9277-4673-96b2-510730a2eff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.816041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df543594-f5f5-4971-84ba-ba557e65eaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.816323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df543594-f5f5-4971-84ba-ba557e65eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.816647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df543594-f5f5-4971-84ba-ba557e65eaf3 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.817326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df543594-f5f5-4971-84ba-ba557e65eaf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.817877 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82c03b-9277-4673-96b2-510730a2eff3 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.819208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df543594-f5f5-4971-84ba-ba557e65eaf3 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.838696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 782/1578] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.842492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 797/1579] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.842662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82c03b-9277-4673-96b2-510730a2eff3 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.842765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df543594-f5f5-4971-84ba-ba557e65eaf3 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.849557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df543594-f5f5-4971-84ba-ba557e65eaf3 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.851372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82c03b-9277-4673-96b2-510730a2eff3 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.854106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70328bc7-3595-4f36-bb4a-4e4139ca2f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.854743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70328bc7-3595-4f36-bb4a-4e4139ca2f71 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.855019 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70328bc7-3595-4f36-bb4a-4e4139ca2f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.855291 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70328bc7-3595-4f36-bb4a-4e4139ca2f71 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.855917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334c9a2-f63f-4e3d-8ca0-64ea63f733e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.856041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70328bc7-3595-4f36-bb4a-4e4139ca2f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.857121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334c9a2-f63f-4e3d-8ca0-64ea63f733e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.857400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334c9a2-f63f-4e3d-8ca0-64ea63f733e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.857669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334c9a2-f63f-4e3d-8ca0-64ea63f733e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.858342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334c9a2-f63f-4e3d-8ca0-64ea63f733e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.858436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70328bc7-3595-4f36-bb4a-4e4139ca2f71 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.860265 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334c9a2-f63f-4e3d-8ca0-64ea63f733e1 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.877746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 798/1580] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/users => generated 295 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.878533 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70328bc7-3595-4f36-bb4a-4e4139ca2f71 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.880010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 783/1581] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/users => generated 282 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.883523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334c9a2-f63f-4e3d-8ca0-64ea63f733e1 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.887827 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70328bc7-3595-4f36-bb4a-4e4139ca2f71 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.892330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad135ab5-8cf5-4388-b4e6-379b180635fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.892560 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334c9a2-f63f-4e3d-8ca0-64ea63f733e1 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.892954 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad135ab5-8cf5-4388-b4e6-379b180635fd admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.893326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad135ab5-8cf5-4388-b4e6-379b180635fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.893724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad135ab5-8cf5-4388-b4e6-379b180635fd admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.894467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad135ab5-8cf5-4388-b4e6-379b180635fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.896391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad135ab5-8cf5-4388-b4e6-379b180635fd admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.897445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35428905-ab06-46ea-87a9-f1e0c53c3fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.898078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35428905-ab06-46ea-87a9-f1e0c53c3fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.898356 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35428905-ab06-46ea-87a9-f1e0c53c3fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.898626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35428905-ab06-46ea-87a9-f1e0c53c3fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.899291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35428905-ab06-46ea-87a9-f1e0c53c3fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.901197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35428905-ab06-46ea-87a9-f1e0c53c3fc3 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.920452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 799/1582] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/users => generated 303 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.920452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad135ab5-8cf5-4388-b4e6-379b180635fd admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.925839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 784/1583] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:21 2022] POST /identity/v3/users => generated 296 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:21.925839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc808b9-c45c-4b2c-aaa2-f4e471a67fbb None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.925839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc808b9-c45c-4b2c-aaa2-f4e471a67fbb None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.925839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc808b9-c45c-4b2c-aaa2-f4e471a67fbb None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.926383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 785/1584] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 3 09:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:11:21.927085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc808b9-c45c-4b2c-aaa2-f4e471a67fbb None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.927224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad135ab5-8cf5-4388-b4e6-379b180635fd admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.931729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25e082-6dbb-4b54-9ddb-91e1708d3b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.932378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25e082-6dbb-4b54-9ddb-91e1708d3b04 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.932657 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25e082-6dbb-4b54-9ddb-91e1708d3b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.932928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25e082-6dbb-4b54-9ddb-91e1708d3b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.933642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25e082-6dbb-4b54-9ddb-91e1708d3b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.936058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25e082-6dbb-4b54-9ddb-91e1708d3b04 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.940111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc808b9-c45c-4b2c-aaa2-f4e471a67fbb None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.944592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854f858-661c-4aaf-ba81-a9293f9e337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.945212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854f858-661c-4aaf-ba81-a9293f9e337b admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.945494 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854f858-661c-4aaf-ba81-a9293f9e337b admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.945768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854f858-661c-4aaf-ba81-a9293f9e337b admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.949203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 800/1585] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:21.949345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854f858-661c-4aaf-ba81-a9293f9e337b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.949468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25e082-6dbb-4b54-9ddb-91e1708d3b04 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.949564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854f858-661c-4aaf-ba81-a9293f9e337b admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.955927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25e082-6dbb-4b54-9ddb-91e1708d3b04 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.958221 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 786/1586] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:21.958749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854f858-661c-4aaf-ba81-a9293f9e337b admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.960580 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23ec5-6a43-4aae-84ef-b54717f4aaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.961165 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23ec5-6a43-4aae-84ef-b54717f4aaef admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.961440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23ec5-6a43-4aae-84ef-b54717f4aaef admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.961712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23ec5-6a43-4aae-84ef-b54717f4aaef admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.962408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d23ec5-6a43-4aae-84ef-b54717f4aaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.963936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d23ec5-6a43-4aae-84ef-b54717f4aaef admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.967808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854f858-661c-4aaf-ba81-a9293f9e337b admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.972311 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4d066-b28e-4db2-9b30-d1aa9aedd256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.972935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4d066-b28e-4db2-9b30-d1aa9aedd256 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.973222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4d066-b28e-4db2-9b30-d1aa9aedd256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.973471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 801/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:21.973589 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4d066-b28e-4db2-9b30-d1aa9aedd256 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.974186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23ec5-6a43-4aae-84ef-b54717f4aaef admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.974297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4d066-b28e-4db2-9b30-d1aa9aedd256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.975737 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4d066-b28e-4db2-9b30-d1aa9aedd256 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.985293 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23ec5-6a43-4aae-84ef-b54717f4aaef admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:21.985907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 787/1588] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:21.986719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4d066-b28e-4db2-9b30-d1aa9aedd256 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:21.990837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08e6f3-9d55-401d-a31e-f01e477f5f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:21.991471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08e6f3-9d55-401d-a31e-f01e477f5f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:21.991748 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08e6f3-9d55-401d-a31e-f01e477f5f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:21.992018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08e6f3-9d55-401d-a31e-f01e477f5f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:21.992863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08e6f3-9d55-401d-a31e-f01e477f5f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:21.994402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08e6f3-9d55-401d-a31e-f01e477f5f9d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:21.995849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4d066-b28e-4db2-9b30-d1aa9aedd256 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.001532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc23368-b630-4acb-9114-84ef070832a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.002160 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23368-b630-4acb-9114-84ef070832a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.002464 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23368-b630-4acb-9114-84ef070832a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.002782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23368-b630-4acb-9114-84ef070832a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.003493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc23368-b630-4acb-9114-84ef070832a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.008015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 802/1589] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:22.008171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc23368-b630-4acb-9114-84ef070832a6 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.008268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08e6f3-9d55-401d-a31e-f01e477f5f9d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.018345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 788/1590] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:22.018345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536f2ee-a784-4467-b6dd-60672a25a80a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.018345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536f2ee-a784-4467-b6dd-60672a25a80a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.018345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536f2ee-a784-4467-b6dd-60672a25a80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.018785 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08e6f3-9d55-401d-a31e-f01e477f5f9d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.022899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687d749-f73c-442e-b473-4993566e2ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.023561 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d749-f73c-442e-b473-4993566e2ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.023827 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d749-f73c-442e-b473-4993566e2ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.024133 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d749-f73c-442e-b473-4993566e2ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.024859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687d749-f73c-442e-b473-4993566e2ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.026465 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687d749-f73c-442e-b473-4993566e2ffd admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.034293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8536f2ee-a784-4467-b6dd-60672a25a80a None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:22.035488 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8536f2ee-a784-4467-b6dd-60672a25a80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:22.036843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 803/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:22.037840 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687d749-f73c-442e-b473-4993566e2ffd admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.048640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687d749-f73c-442e-b473-4993566e2ffd admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.053061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74d64c-8f80-471f-8ee2-97c1b4276157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.053674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d64c-8f80-471f-8ee2-97c1b4276157 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.053951 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d64c-8f80-471f-8ee2-97c1b4276157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.054221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d64c-8f80-471f-8ee2-97c1b4276157 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.054915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74d64c-8f80-471f-8ee2-97c1b4276157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.056501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74d64c-8f80-471f-8ee2-97c1b4276157 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.066604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 804/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:22.067354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74d64c-8f80-471f-8ee2-97c1b4276157 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.076410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74d64c-8f80-471f-8ee2-97c1b4276157 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.080963 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635e9f2-cf7d-4c7b-831c-607e91bc0a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.081613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635e9f2-cf7d-4c7b-831c-607e91bc0a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.081896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635e9f2-cf7d-4c7b-831c-607e91bc0a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.082174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635e9f2-cf7d-4c7b-831c-607e91bc0a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.082873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635e9f2-cf7d-4c7b-831c-607e91bc0a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.084458 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635e9f2-cf7d-4c7b-831c-607e91bc0a97 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.093925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 805/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:22.094687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635e9f2-cf7d-4c7b-831c-607e91bc0a97 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.101593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 789/1594] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 3 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:22.102402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536f2ee-a784-4467-b6dd-60672a25a80a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.103808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635e9f2-cf7d-4c7b-831c-607e91bc0a97 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.108955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a42e6-3157-4c69-ab0f-09c056d07431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.109585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a42e6-3157-4c69-ab0f-09c056d07431 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.109869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a42e6-3157-4c69-ab0f-09c056d07431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.110147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a42e6-3157-4c69-ab0f-09c056d07431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.110854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a42e6-3157-4c69-ab0f-09c056d07431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.112465 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a42e6-3157-4c69-ab0f-09c056d07431 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.113397 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536f2ee-a784-4467-b6dd-60672a25a80a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.117948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cc4e1-8a69-47fc-a0b6-680be515407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.118588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cc4e1-8a69-47fc-a0b6-680be515407e admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.118868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cc4e1-8a69-47fc-a0b6-680be515407e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.119141 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cc4e1-8a69-47fc-a0b6-680be515407e admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.119887 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cc4e1-8a69-47fc-a0b6-680be515407e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.121539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cc4e1-8a69-47fc-a0b6-680be515407e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.123218 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 806/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:22.123854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a42e6-3157-4c69-ab0f-09c056d07431 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.133203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a42e6-3157-4c69-ab0f-09c056d07431 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.138039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 790/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:22.138039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cc4e1-8a69-47fc-a0b6-680be515407e admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.138271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa498d5e-5324-4423-a612-80e992dd9ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.138626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa498d5e-5324-4423-a612-80e992dd9ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.138901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa498d5e-5324-4423-a612-80e992dd9ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.139169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa498d5e-5324-4423-a612-80e992dd9ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.139869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa498d5e-5324-4423-a612-80e992dd9ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.141494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa498d5e-5324-4423-a612-80e992dd9ad4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.145136 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cc4e1-8a69-47fc-a0b6-680be515407e admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.150345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98deee7-2ec7-48e8-be30-88967e2eab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.151060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 807/1597] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:22.151194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98deee7-2ec7-48e8-be30-88967e2eab32 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.151281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98deee7-2ec7-48e8-be30-88967e2eab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.151591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98deee7-2ec7-48e8-be30-88967e2eab32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.151712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa498d5e-5324-4423-a612-80e992dd9ad4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.152319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98deee7-2ec7-48e8-be30-88967e2eab32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.153918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98deee7-2ec7-48e8-be30-88967e2eab32 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.162745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa498d5e-5324-4423-a612-80e992dd9ad4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.165104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 791/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:22.165853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98deee7-2ec7-48e8-be30-88967e2eab32 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.167382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc87c67-e72f-40fa-bdb6-80daa83bcfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.168336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc87c67-e72f-40fa-bdb6-80daa83bcfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.168459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc87c67-e72f-40fa-bdb6-80daa83bcfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.168647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc87c67-e72f-40fa-bdb6-80daa83bcfe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.169910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc87c67-e72f-40fa-bdb6-80daa83bcfe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.171519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc87c67-e72f-40fa-bdb6-80daa83bcfe8 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.175344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98deee7-2ec7-48e8-be30-88967e2eab32 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.179887 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2a32-eba6-435e-a3e2-e159f78b9e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.180750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2a32-eba6-435e-a3e2-e159f78b9e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.181030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2a32-eba6-435e-a3e2-e159f78b9e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.181131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 808/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:22.181775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc87c67-e72f-40fa-bdb6-80daa83bcfe8 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.184269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2a32-eba6-435e-a3e2-e159f78b9e86 admin admin] PATH_INFO: `/v3/projects/1697e2ae98ba497fac063a92519958c9/users/277965e5d263401f937f090380ced6dd/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.191566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc87c67-e72f-40fa-bdb6-80daa83bcfe8 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.196011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1719-5482-4787-ba7d-1464be9bc4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.196897 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1719-5482-4787-ba7d-1464be9bc4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.197180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1719-5482-4787-ba7d-1464be9bc4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.197457 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1719-5482-4787-ba7d-1464be9bc4cd admin admin] PATH_INFO: `/v3/projects/8efd3e9b2ee14e56ac919b0165e6b7f2/users/1758efeac1af430eb608ba98df1118d3/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.199279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef2a32-eba6-435e-a3e2-e159f78b9e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1697e2ae98ba497fac063a92519958c9, user_id=277965e5d263401f937f090380ced6dd, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.202023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef2a32-eba6-435e-a3e2-e159f78b9e86 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.213042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d1719-5482-4787-ba7d-1464be9bc4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efd3e9b2ee14e56ac919b0165e6b7f2, user_id=1758efeac1af430eb608ba98df1118d3, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.215502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 792/1600] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:22 2022] PUT /identity/v3/projects/1697e2ae98ba497fac063a92519958c9/users/277965e5d263401f937f090380ced6dd/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:22.225910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d1719-5482-4787-ba7d-1464be9bc4cd admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.226848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2a32-eba6-435e-a3e2-e159f78b9e86 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.236324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 809/1601] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:22 2022] PUT /identity/v3/projects/8efd3e9b2ee14e56ac919b0165e6b7f2/users/1758efeac1af430eb608ba98df1118d3/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:22.237213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1719-5482-4787-ba7d-1464be9bc4cd admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.288319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2a32-eba6-435e-a3e2-e159f78b9e86 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.302019 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1719-5482-4787-ba7d-1464be9bc4cd admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.306917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70492d1b-2b8d-46c8-afba-5c80381c125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.307831 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70492d1b-2b8d-46c8-afba-5c80381c125c admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.308135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70492d1b-2b8d-46c8-afba-5c80381c125c admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.308413 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70492d1b-2b8d-46c8-afba-5c80381c125c admin admin] PATH_INFO: `/v3/projects/db9273e9f75e4918b29f8d1e4dc4d1c3/users/638e8e052fda4abe989c714c28564c5b/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.322551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70492d1b-2b8d-46c8-afba-5c80381c125c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9273e9f75e4918b29f8d1e4dc4d1c3, user_id=638e8e052fda4abe989c714c28564c5b, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.325231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70492d1b-2b8d-46c8-afba-5c80381c125c admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.339352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 810/1602] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:22 2022] PUT /identity/v3/projects/db9273e9f75e4918b29f8d1e4dc4d1c3/users/638e8e052fda4abe989c714c28564c5b/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:22.340146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70492d1b-2b8d-46c8-afba-5c80381c125c admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.350782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f748c5-eded-495d-b52d-966ceb1f7c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.351424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f748c5-eded-495d-b52d-966ceb1f7c02 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.351701 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f748c5-eded-495d-b52d-966ceb1f7c02 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.351972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f748c5-eded-495d-b52d-966ceb1f7c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.398410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70492d1b-2b8d-46c8-afba-5c80381c125c admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.403799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52659e-2ef1-48c5-a4f5-c6f7e23d3ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.404718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52659e-2ef1-48c5-a4f5-c6f7e23d3ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.405001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52659e-2ef1-48c5-a4f5-c6f7e23d3ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.405277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52659e-2ef1-48c5-a4f5-c6f7e23d3ddb admin admin] PATH_INFO: `/v3/projects/dd20006a6f1b4ef0951f86c839eb33ec/users/adc15a08f9f94c71bc1e0a092e1b7818/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.405829 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f748c5-eded-495d-b52d-966ceb1f7c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.407405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f748c5-eded-495d-b52d-966ceb1f7c02 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.416214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 793/1603] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:22.416971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f748c5-eded-495d-b52d-966ceb1f7c02 service nova] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.419922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52659e-2ef1-48c5-a4f5-c6f7e23d3ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd20006a6f1b4ef0951f86c839eb33ec, user_id=adc15a08f9f94c71bc1e0a092e1b7818, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.422737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52659e-2ef1-48c5-a4f5-c6f7e23d3ddb admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.427279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f748c5-eded-495d-b52d-966ceb1f7c02 service nova] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.433000 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67a621-d228-46e7-ad02-621d952db050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.433923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67a621-d228-46e7-ad02-621d952db050 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.434205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67a621-d228-46e7-ad02-621d952db050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.434551 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67a621-d228-46e7-ad02-621d952db050 admin admin] PATH_INFO: `/v3/projects/c4d7367b48464629af2ce84cd4dc3537/users/9715bdfb1fc54261a94bc157d5cdd54d/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.441840 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 811/1604] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:22 2022] PUT /identity/v3/projects/dd20006a6f1b4ef0951f86c839eb33ec/users/adc15a08f9f94c71bc1e0a092e1b7818/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:22.441840 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52659e-2ef1-48c5-a4f5-c6f7e23d3ddb admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.450333 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67a621-d228-46e7-ad02-621d952db050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7367b48464629af2ce84cd4dc3537, user_id=9715bdfb1fc54261a94bc157d5cdd54d, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.453280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67a621-d228-46e7-ad02-621d952db050 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.468510 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 794/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:22 2022] PUT /identity/v3/projects/c4d7367b48464629af2ce84cd4dc3537/users/9715bdfb1fc54261a94bc157d5cdd54d/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:22.469071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67a621-d228-46e7-ad02-621d952db050 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.506137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52659e-2ef1-48c5-a4f5-c6f7e23d3ddb admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.541589 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67a621-d228-46e7-ad02-621d952db050 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.546931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4ae1a-82ce-4aad-992b-770aaf2c4eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.547803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4ae1a-82ce-4aad-992b-770aaf2c4eba admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.548079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4ae1a-82ce-4aad-992b-770aaf2c4eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.548378 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4ae1a-82ce-4aad-992b-770aaf2c4eba admin admin] PATH_INFO: `/v3/projects/7842b8edaf5847d387b8390dc4cf09b4/users/1e4b30ac01a84009b41f6c83de99cfb3/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.562840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4ae1a-82ce-4aad-992b-770aaf2c4eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7842b8edaf5847d387b8390dc4cf09b4, user_id=1e4b30ac01a84009b41f6c83de99cfb3, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.564403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0a1ee-a221-4b1d-b7b1-f77128ec0fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.565288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0a1ee-a221-4b1d-b7b1-f77128ec0fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.565572 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0a1ee-a221-4b1d-b7b1-f77128ec0fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.565688 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4ae1a-82ce-4aad-992b-770aaf2c4eba admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.565873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0a1ee-a221-4b1d-b7b1-f77128ec0fa4 admin admin] PATH_INFO: `/v3/projects/14529898edf44b858828a56edbb56557/users/b5a2c9b5836b47ff8ff800fa4a6a521a/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.581619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 795/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:22 2022] PUT /identity/v3/projects/7842b8edaf5847d387b8390dc4cf09b4/users/1e4b30ac01a84009b41f6c83de99cfb3/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:22.582512 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0a1ee-a221-4b1d-b7b1-f77128ec0fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14529898edf44b858828a56edbb56557, user_id=b5a2c9b5836b47ff8ff800fa4a6a521a, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.583113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a54d11-e28a-440b-87c3-405186f90553 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.583408 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a54d11-e28a-440b-87c3-405186f90553 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.583686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a54d11-e28a-440b-87c3-405186f90553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.586455 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0a1ee-a221-4b1d-b7b1-f77128ec0fa4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.601368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 812/1607] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:22 2022] PUT /identity/v3/projects/14529898edf44b858828a56edbb56557/users/b5a2c9b5836b47ff8ff800fa4a6a521a/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:22.602556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeb5ae-9271-477e-ac8c-ac077528493d None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.602843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeb5ae-9271-477e-ac8c-ac077528493d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.603235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeb5ae-9271-477e-ac8c-ac077528493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.612166 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-25a54d11-e28a-440b-87c3-405186f90553 None None] MFA Rules not processed for user `277965e5d263401f937f090380ced6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:22.613395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-25a54d11-e28a-440b-87c3-405186f90553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:22.632530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-8efeb5ae-9271-477e-ac8c-ac077528493d None None] MFA Rules not processed for user `1758efeac1af430eb608ba98df1118d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:22.634064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8efeb5ae-9271-477e-ac8c-ac077528493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:22.678853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 796/1608] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:22.680139 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde5e56-4a26-470c-b93a-c52e733cd16d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.680437 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde5e56-4a26-470c-b93a-c52e733cd16d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.680717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde5e56-4a26-470c-b93a-c52e733cd16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.702076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5cde5e56-4a26-470c-b93a-c52e733cd16d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:22.703281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5cde5e56-4a26-470c-b93a-c52e733cd16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:22.707803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 813/1609] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:22.707803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d908b-bfb1-4670-97ac-13f7d8f507db None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.707803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d908b-bfb1-4670-97ac-13f7d8f507db None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.707803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d908b-bfb1-4670-97ac-13f7d8f507db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.724816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-d94d908b-bfb1-4670-97ac-13f7d8f507db None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:22.725990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d94d908b-bfb1-4670-97ac-13f7d8f507db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:22.769088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 797/1610] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:22.774228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a66530-6fa2-4a99-b522-fa9fb7290a8c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.774521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a66530-6fa2-4a99-b522-fa9fb7290a8c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.774807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a66530-6fa2-4a99-b522-fa9fb7290a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.791354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 814/1611] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:22.792837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb41e-cf2b-42aa-992d-06f608ad6325 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.793132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb41e-cf2b-42aa-992d-06f608ad6325 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.793471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb41e-cf2b-42aa-992d-06f608ad6325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.811543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-79a66530-6fa2-4a99-b522-fa9fb7290a8c None None] MFA Rules not processed for user `9715bdfb1fc54261a94bc157d5cdd54d`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:22.812665 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-79a66530-6fa2-4a99-b522-fa9fb7290a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:22.815444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b88cb41e-cf2b-42aa-992d-06f608ad6325 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:22.817143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b88cb41e-cf2b-42aa-992d-06f608ad6325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:22.828003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 815/1612] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:22.829568 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bb721-2a07-4eb0-9ed8-56b60cccc90e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.829859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bb721-2a07-4eb0-9ed8-56b60cccc90e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.830339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bb721-2a07-4eb0-9ed8-56b60cccc90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.853365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b20bb721-2a07-4eb0-9ed8-56b60cccc90e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:22.854572 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b20bb721-2a07-4eb0-9ed8-56b60cccc90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:22.865385 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 816/1613] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:22.865385 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bb721-2a07-4eb0-9ed8-56b60cccc90e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.890132 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 798/1614] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:22.891105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a66530-6fa2-4a99-b522-fa9fb7290a8c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.900996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a66530-6fa2-4a99-b522-fa9fb7290a8c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.906531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79152144-2df1-4ab2-bc12-ed9b8354d82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.907174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79152144-2df1-4ab2-bc12-ed9b8354d82e admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.907451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79152144-2df1-4ab2-bc12-ed9b8354d82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.907720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79152144-2df1-4ab2-bc12-ed9b8354d82e admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:22.908435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79152144-2df1-4ab2-bc12-ed9b8354d82e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:22.910856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79152144-2df1-4ab2-bc12-ed9b8354d82e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:22.941364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 799/1615] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:22 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:22.941364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79152144-2df1-4ab2-bc12-ed9b8354d82e admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:22.942903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bb721-2a07-4eb0-9ed8-56b60cccc90e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.990606 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79152144-2df1-4ab2-bc12-ed9b8354d82e admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:22.994439 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144b3b5-30e8-4afc-9737-bbcffa17e23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:22.995072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b3b5-30e8-4afc-9737-bbcffa17e23e service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:22.995361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b3b5-30e8-4afc-9737-bbcffa17e23e service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:22.995634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b3b5-30e8-4afc-9737-bbcffa17e23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.003706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b9ea6-5ce5-4e67-b41c-f1150c929cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.004381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b9ea6-5ce5-4e67-b41c-f1150c929cb9 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.004664 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b9ea6-5ce5-4e67-b41c-f1150c929cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.004938 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b9ea6-5ce5-4e67-b41c-f1150c929cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.055327 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144b3b5-30e8-4afc-9737-bbcffa17e23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.056821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144b3b5-30e8-4afc-9737-bbcffa17e23e service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.059027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b9ea6-5ce5-4e67-b41c-f1150c929cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.061394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b9ea6-5ce5-4e67-b41c-f1150c929cb9 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.066972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 800/1616] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:23.067756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144b3b5-30e8-4afc-9737-bbcffa17e23e service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.070910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 817/1617] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:23.072728 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b9ea6-5ce5-4e67-b41c-f1150c929cb9 service nova] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.076182 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144b3b5-30e8-4afc-9737-bbcffa17e23e service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.080807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2054a-bcf6-497a-9014-6af006332a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.081453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2054a-bcf6-497a-9014-6af006332a30 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.081754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2054a-bcf6-497a-9014-6af006332a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.082001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2054a-bcf6-497a-9014-6af006332a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.082830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b9ea6-5ce5-4e67-b41c-f1150c929cb9 service nova] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.086853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1655a-57e2-4384-b4a8-4a3c35164c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.087618 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1655a-57e2-4384-b4a8-4a3c35164c3c service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.087907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1655a-57e2-4384-b4a8-4a3c35164c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.088514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1655a-57e2-4384-b4a8-4a3c35164c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.092163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2054a-bcf6-497a-9014-6af006332a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.094019 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2054a-bcf6-497a-9014-6af006332a30 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.101234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1655a-57e2-4384-b4a8-4a3c35164c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.102492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1655a-57e2-4384-b4a8-4a3c35164c3c service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.104880 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 801/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:23.105692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2054a-bcf6-497a-9014-6af006332a30 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.113480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 818/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:23.114275 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1655a-57e2-4384-b4a8-4a3c35164c3c service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.114535 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2054a-bcf6-497a-9014-6af006332a30 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.118263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f627e-a6f8-4d97-b0b0-57191aca2017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.119073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f627e-a6f8-4d97-b0b0-57191aca2017 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.119409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f627e-a6f8-4d97-b0b0-57191aca2017 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.119686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f627e-a6f8-4d97-b0b0-57191aca2017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.124229 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1655a-57e2-4384-b4a8-4a3c35164c3c service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.129306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9501c-ce5f-4553-b41e-3306772f4b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.129972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9501c-ce5f-4553-b41e-3306772f4b89 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.130516 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9501c-ce5f-4553-b41e-3306772f4b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.130988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9501c-ce5f-4553-b41e-3306772f4b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.131875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9501c-ce5f-4553-b41e-3306772f4b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.132252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f627e-a6f8-4d97-b0b0-57191aca2017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.133818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9501c-ce5f-4553-b41e-3306772f4b89 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.133948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f627e-a6f8-4d97-b0b0-57191aca2017 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.146225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 802/1620] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:23.147906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c3d6-aaa3-4e48-ba29-ac905a9de3e8 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.148255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c3d6-aaa3-4e48-ba29-ac905a9de3e8 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.148530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c3d6-aaa3-4e48-ba29-ac905a9de3e8 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.149799 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 803/1621] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 3 09:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:11:23.150763 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04c3d6-aaa3-4e48-ba29-ac905a9de3e8 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.165357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04c3d6-aaa3-4e48-ba29-ac905a9de3e8 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.171056 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 819/1622] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:23 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:23.171056 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b20187-7179-46a1-9b59-45aa6d9e0551 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.171056 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b20187-7179-46a1-9b59-45aa6d9e0551 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.171056 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b20187-7179-46a1-9b59-45aa6d9e0551 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.171745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 820/1623] 10.222.0.23 () {54 vars in 912 bytes} [Tue May 3 09:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:11:23.172829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df291e0d-8671-4662-aa58-aad0aa0b1630 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.173216 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df291e0d-8671-4662-aa58-aad0aa0b1630 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.173575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df291e0d-8671-4662-aa58-aad0aa0b1630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.194604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-df291e0d-8671-4662-aa58-aad0aa0b1630 None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:23.195820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-df291e0d-8671-4662-aa58-aad0aa0b1630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:23.249642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323c6eb-5b62-402b-87c3-c45b393fbe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.250510 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323c6eb-5b62-402b-87c3-c45b393fbe7f admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.250860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323c6eb-5b62-402b-87c3-c45b393fbe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.251218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323c6eb-5b62-402b-87c3-c45b393fbe7f admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.252306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323c6eb-5b62-402b-87c3-c45b393fbe7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.254491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323c6eb-5b62-402b-87c3-c45b393fbe7f admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.277692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 804/1624] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:23 2022] POST /identity/v3/users => generated 303 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:23.279051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323c6eb-5b62-402b-87c3-c45b393fbe7f admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.282984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 821/1625] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 3 09:11:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:23.284479 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae039360-a18d-4f9d-8a01-478472303863 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.284906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae039360-a18d-4f9d-8a01-478472303863 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.285332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae039360-a18d-4f9d-8a01-478472303863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.293109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323c6eb-5b62-402b-87c3-c45b393fbe7f admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.300860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db89e3f-f41d-4bdb-bbe6-79f83a282d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.301627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89e3f-f41d-4bdb-bbe6-79f83a282d1e admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.301964 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89e3f-f41d-4bdb-bbe6-79f83a282d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.302308 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89e3f-f41d-4bdb-bbe6-79f83a282d1e admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.303073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89e3f-f41d-4bdb-bbe6-79f83a282d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.305186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89e3f-f41d-4bdb-bbe6-79f83a282d1e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.312180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ae039360-a18d-4f9d-8a01-478472303863 None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:23.314462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ae039360-a18d-4f9d-8a01-478472303863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:23.325334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 822/1626] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:11:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:23.326155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae039360-a18d-4f9d-8a01-478472303863 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.336735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 805/1627] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:23 2022] POST /identity/v3/users => generated 289 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:23.338158 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff64ef8-1c25-40df-bae5-63b2fcb9400c None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.338592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff64ef8-1c25-40df-bae5-63b2fcb9400c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.338878 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff64ef8-1c25-40df-bae5-63b2fcb9400c None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.340503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 806/1628] 10.222.0.23 () {54 vars in 912 bytes} [Tue May 3 09:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:11:23.341070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff64ef8-1c25-40df-bae5-63b2fcb9400c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.346451 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae039360-a18d-4f9d-8a01-478472303863 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.352263 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fcbdb-7ea7-4138-8131-794e01f39755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.352965 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fcbdb-7ea7-4138-8131-794e01f39755 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.353274 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fcbdb-7ea7-4138-8131-794e01f39755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.353532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fcbdb-7ea7-4138-8131-794e01f39755 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.354279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fcbdb-7ea7-4138-8131-794e01f39755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.354557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff64ef8-1c25-40df-bae5-63b2fcb9400c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.356849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fcbdb-7ea7-4138-8131-794e01f39755 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.362403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b00d7-7c43-46c7-a01b-56776ef24f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.363148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b00d7-7c43-46c7-a01b-56776ef24f80 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.363348 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b00d7-7c43-46c7-a01b-56776ef24f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.363579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b00d7-7c43-46c7-a01b-56776ef24f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.364542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b00d7-7c43-46c7-a01b-56776ef24f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.366282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b00d7-7c43-46c7-a01b-56776ef24f80 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.367707 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 823/1629] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:23.369380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fcbdb-7ea7-4138-8131-794e01f39755 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.380842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 807/1630] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:23.382984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899e0cd-9331-4150-89d1-36a95372f63a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.383281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899e0cd-9331-4150-89d1-36a95372f63a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.383896 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899e0cd-9331-4150-89d1-36a95372f63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.405848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a899e0cd-9331-4150-89d1-36a95372f63a None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:23.407085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a899e0cd-9331-4150-89d1-36a95372f63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:23.417895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 808/1631] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:11:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:23.418499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899e0cd-9331-4150-89d1-36a95372f63a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.432537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899e0cd-9331-4150-89d1-36a95372f63a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.437108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fcbdb-7ea7-4138-8131-794e01f39755 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.439128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5cfc1-21da-4d57-85fa-fbaf5e2cb65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.440711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5cfc1-21da-4d57-85fa-fbaf5e2cb65d admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.441336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5cfc1-21da-4d57-85fa-fbaf5e2cb65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.441906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5cfc1-21da-4d57-85fa-fbaf5e2cb65d admin admin] PATH_INFO: `/v3/projects/28030370a6a647e2a72922e3ad175712/users/410d40a8a4984ab1ac6fc2a05125b6a9/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.442030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480e78a-d296-48b7-9c19-77c096d4c594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.442799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480e78a-d296-48b7-9c19-77c096d4c594 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.443338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480e78a-d296-48b7-9c19-77c096d4c594 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.443774 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480e78a-d296-48b7-9c19-77c096d4c594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.459926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480e78a-d296-48b7-9c19-77c096d4c594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.461525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480e78a-d296-48b7-9c19-77c096d4c594 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.462423 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5cfc1-21da-4d57-85fa-fbaf5e2cb65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=28030370a6a647e2a72922e3ad175712, user_id=410d40a8a4984ab1ac6fc2a05125b6a9, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.465255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5cfc1-21da-4d57-85fa-fbaf5e2cb65d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.477226 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 824/1632] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:23.489544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 809/1633] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:23 2022] PUT /identity/v3/projects/28030370a6a647e2a72922e3ad175712/users/410d40a8a4984ab1ac6fc2a05125b6a9/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:23.489995 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480e78a-d296-48b7-9c19-77c096d4c594 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.490359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5cfc1-21da-4d57-85fa-fbaf5e2cb65d admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.505003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480e78a-d296-48b7-9c19-77c096d4c594 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.576311 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541cccd-5e49-4ea4-a618-497e78abfb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.577496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541cccd-5e49-4ea4-a618-497e78abfb81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.578221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541cccd-5e49-4ea4-a618-497e78abfb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.578573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541cccd-5e49-4ea4-a618-497e78abfb81 admin admin] PATH_INFO: `/v3/projects/32a17eca3d42484b9cb53a07406a2a07/users/5a0004dac4bb4952a81a903d413736ca/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.597730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541cccd-5e49-4ea4-a618-497e78abfb81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a17eca3d42484b9cb53a07406a2a07, user_id=5a0004dac4bb4952a81a903d413736ca, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.601282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541cccd-5e49-4ea4-a618-497e78abfb81 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.613239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5cfc1-21da-4d57-85fa-fbaf5e2cb65d admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.624155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 825/1634] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:23 2022] PUT /identity/v3/projects/32a17eca3d42484b9cb53a07406a2a07/users/5a0004dac4bb4952a81a903d413736ca/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:23.627149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541cccd-5e49-4ea4-a618-497e78abfb81 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.690298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41980e9a-69c4-4ef4-b13c-2fe46efe2d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.691223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41980e9a-69c4-4ef4-b13c-2fe46efe2d18 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.691766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41980e9a-69c4-4ef4-b13c-2fe46efe2d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.692591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41980e9a-69c4-4ef4-b13c-2fe46efe2d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.709727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541cccd-5e49-4ea4-a618-497e78abfb81 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.717114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c149481-5d97-46fa-8a33-3437e6f2a017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.717795 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c149481-5d97-46fa-8a33-3437e6f2a017 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.718074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c149481-5d97-46fa-8a33-3437e6f2a017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.718378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c149481-5d97-46fa-8a33-3437e6f2a017 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.719122 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c149481-5d97-46fa-8a33-3437e6f2a017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.720928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c149481-5d97-46fa-8a33-3437e6f2a017 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.736360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 826/1635] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:23.736360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c149481-5d97-46fa-8a33-3437e6f2a017 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.744943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c149481-5d97-46fa-8a33-3437e6f2a017 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.750021 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440a747-151d-4b4e-869a-4730e1dce23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.750713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440a747-151d-4b4e-869a-4730e1dce23f admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.751050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440a747-151d-4b4e-869a-4730e1dce23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.751334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440a747-151d-4b4e-869a-4730e1dce23f admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.752078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440a747-151d-4b4e-869a-4730e1dce23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.755969 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440a747-151d-4b4e-869a-4730e1dce23f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.770433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 827/1636] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:23.770433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440a747-151d-4b4e-869a-4730e1dce23f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.783024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440a747-151d-4b4e-869a-4730e1dce23f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.789609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7579eb-cad7-4e11-b966-8bcffda6168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.790559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7579eb-cad7-4e11-b966-8bcffda6168b admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.790801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7579eb-cad7-4e11-b966-8bcffda6168b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.791076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7579eb-cad7-4e11-b966-8bcffda6168b admin admin] PATH_INFO: `/v3/projects/28030370a6a647e2a72922e3ad175712/users/410d40a8a4984ab1ac6fc2a05125b6a9/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.793183 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7579eb-cad7-4e11-b966-8bcffda6168b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28030370a6a647e2a72922e3ad175712, user_id=410d40a8a4984ab1ac6fc2a05125b6a9, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.796660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7579eb-cad7-4e11-b966-8bcffda6168b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.810880 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 828/1637] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:23 2022] PUT /identity/v3/projects/28030370a6a647e2a72922e3ad175712/users/410d40a8a4984ab1ac6fc2a05125b6a9/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:23.821868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7579eb-cad7-4e11-b966-8bcffda6168b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:23.822071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41980e9a-69c4-4ef4-b13c-2fe46efe2d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.822539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41980e9a-69c4-4ef4-b13c-2fe46efe2d18 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:23.850480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 810/1638] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:23.853606 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda3bd4-a77e-4237-a3e8-bf4179112bfb None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.853974 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda3bd4-a77e-4237-a3e8-bf4179112bfb None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.854755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda3bd4-a77e-4237-a3e8-bf4179112bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.897149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-9bda3bd4-a77e-4237-a3e8-bf4179112bfb None None] MFA Rules not processed for user `410d40a8a4984ab1ac6fc2a05125b6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:23.898378 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9bda3bd4-a77e-4237-a3e8-bf4179112bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:23.959706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7579eb-cad7-4e11-b966-8bcffda6168b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:23.971440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18266b3b-83c4-4a57-ba48-6a2b4dfa4cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:23.972538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18266b3b-83c4-4a57-ba48-6a2b4dfa4cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:23.973124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18266b3b-83c4-4a57-ba48-6a2b4dfa4cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:23.973484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18266b3b-83c4-4a57-ba48-6a2b4dfa4cf0 admin admin] PATH_INFO: `/v3/projects/32a17eca3d42484b9cb53a07406a2a07/users/5a0004dac4bb4952a81a903d413736ca/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:23.975719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18266b3b-83c4-4a57-ba48-6a2b4dfa4cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a17eca3d42484b9cb53a07406a2a07, user_id=5a0004dac4bb4952a81a903d413736ca, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:23.984198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18266b3b-83c4-4a57-ba48-6a2b4dfa4cf0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:24.002606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 829/1639] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:23 2022] PUT /identity/v3/projects/32a17eca3d42484b9cb53a07406a2a07/users/5a0004dac4bb4952a81a903d413736ca/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:24.014928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 811/1640] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:24.020500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b3aab-18f3-40c8-b777-895335157ba4 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:24.020802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b3aab-18f3-40c8-b777-895335157ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:24.021113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b3aab-18f3-40c8-b777-895335157ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:24.029473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda3bd4-a77e-4237-a3e8-bf4179112bfb None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:24.081019 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-dc9b3aab-18f3-40c8-b777-895335157ba4 None None] MFA Rules not processed for user `5a0004dac4bb4952a81a903d413736ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:24.082517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-dc9b3aab-18f3-40c8-b777-895335157ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:24.134642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda3bd4-a77e-4237-a3e8-bf4179112bfb None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:24.185774 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 830/1641] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:24.248870 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1324e-03aa-46ca-9ee6-d574e8015ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:24.250184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1324e-03aa-46ca-9ee6-d574e8015ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:24.250654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1324e-03aa-46ca-9ee6-d574e8015ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:24.251087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1324e-03aa-46ca-9ee6-d574e8015ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:24.393363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1324e-03aa-46ca-9ee6-d574e8015ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:24.396681 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1324e-03aa-46ca-9ee6-d574e8015ee2 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:24.404367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b3aab-18f3-40c8-b777-895335157ba4 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:24.416046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b3aab-18f3-40c8-b777-895335157ba4 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:24.420843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f9c6c-35b2-48c7-b739-a971d314c243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:24.422082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f9c6c-35b2-48c7-b739-a971d314c243 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:24.422542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f9c6c-35b2-48c7-b739-a971d314c243 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:24.422973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f9c6c-35b2-48c7-b739-a971d314c243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:24.436576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 812/1642] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:11:24.453507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f9c6c-35b2-48c7-b739-a971d314c243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:24.455123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f9c6c-35b2-48c7-b739-a971d314c243 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:24.514844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 831/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:24.579267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e29df-256a-4aae-a732-19ba29e59fd8 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:24.579740 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e29df-256a-4aae-a732-19ba29e59fd8 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:24.580249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e29df-256a-4aae-a732-19ba29e59fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:24.631631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f9c6c-35b2-48c7-b739-a971d314c243 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:24.650952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-937e29df-256a-4aae-a732-19ba29e59fd8 None None] MFA Rules not processed for user `638e8e052fda4abe989c714c28564c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:24.652373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-937e29df-256a-4aae-a732-19ba29e59fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:24.739250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 813/1644] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:24.739250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e29df-256a-4aae-a732-19ba29e59fd8 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:24.751143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e29df-256a-4aae-a732-19ba29e59fd8 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:24.757357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36094c-17f4-4ccd-a7d1-65102ecc6b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:24.759297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36094c-17f4-4ccd-a7d1-65102ecc6b30 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:24.759934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36094c-17f4-4ccd-a7d1-65102ecc6b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:24.761137 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36094c-17f4-4ccd-a7d1-65102ecc6b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:24.769497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f9c6c-35b2-48c7-b739-a971d314c243 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:24.781507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322b020-3163-40ce-9404-c56d1ecc5d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:24.782908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322b020-3163-40ce-9404-c56d1ecc5d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:24.783197 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322b020-3163-40ce-9404-c56d1ecc5d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:24.783474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322b020-3163-40ce-9404-c56d1ecc5d1b admin admin] PATH_INFO: `/v3/users/a8828bb9477c48f7b464b0fed467fe62` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:24.790445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322b020-3163-40ce-9404-c56d1ecc5d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8828bb9477c48f7b464b0fed467fe62)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:24.791523 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: WARNING py.warnings [None req-7322b020-3163-40ce-9404-c56d1ecc5d1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:11:24.791523 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: warnings.warn(msg) May 03 09:11:24.791523 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: May 03 09:11:24.792774 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322b020-3163-40ce-9404-c56d1ecc5d1b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:24.845009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36094c-17f4-4ccd-a7d1-65102ecc6b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:24.847286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36094c-17f4-4ccd-a7d1-65102ecc6b30 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:24.856878 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 814/1645] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:24.858532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2bb5a-8f1b-43c6-a63a-efd65231be73 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:24.858821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2bb5a-8f1b-43c6-a63a-efd65231be73 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:24.859163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2bb5a-8f1b-43c6-a63a-efd65231be73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:24.887126 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a3f2bb5a-8f1b-43c6-a63a-efd65231be73 None None] MFA Rules not processed for user `638e8e052fda4abe989c714c28564c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:24.892251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a3f2bb5a-8f1b-43c6-a63a-efd65231be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:24.900477 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 815/1646] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:24.916608 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2bb5a-8f1b-43c6-a63a-efd65231be73 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:24.932779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7322b020-3163-40ce-9404-c56d1ecc5d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8828bb9477c48f7b464b0fed467fe62'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:24.963696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7322b020-3163-40ce-9404-c56d1ecc5d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8828bb9477c48f7b464b0fed467fe62'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:24.964519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7322b020-3163-40ce-9404-c56d1ecc5d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8828bb9477c48f7b464b0fed467fe62'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:24.966230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7322b020-3163-40ce-9404-c56d1ecc5d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8828bb9477c48f7b464b0fed467fe62'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:25.018755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7322b020-3163-40ce-9404-c56d1ecc5d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8828bb9477c48f7b464b0fed467fe62'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:25.046659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 832/1647] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:24 2022] DELETE /identity/v3/users/a8828bb9477c48f7b464b0fed467fe62 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:11:25.050764 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd556bb-43a1-41f7-a8ef-dce1d5c39bab None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:25.051131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd556bb-43a1-41f7-a8ef-dce1d5c39bab None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:25.051454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd556bb-43a1-41f7-a8ef-dce1d5c39bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:25.099011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-9bd556bb-43a1-41f7-a8ef-dce1d5c39bab None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:25.101181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2bb5a-8f1b-43c6-a63a-efd65231be73 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:25.102812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9bd556bb-43a1-41f7-a8ef-dce1d5c39bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:25.201699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 833/1648] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:25.211059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e705fa3-85ae-4159-8fac-e3f9b3db7995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:25.211786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705fa3-85ae-4159-8fac-e3f9b3db7995 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:25.212124 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705fa3-85ae-4159-8fac-e3f9b3db7995 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:25.212459 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705fa3-85ae-4159-8fac-e3f9b3db7995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:25.214436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9e705fa3-85ae-4159-8fac-e3f9b3db7995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:25.218189 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd556bb-43a1-41f7-a8ef-dce1d5c39bab None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:25.219582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9bd556bb-43a1-41f7-a8ef-dce1d5c39bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:25.348518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd556bb-43a1-41f7-a8ef-dce1d5c39bab None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:25.363283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43470d20-c20f-4ddd-a12f-5413f11fdfdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:25.365434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43470d20-c20f-4ddd-a12f-5413f11fdfdd service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:25.365708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43470d20-c20f-4ddd-a12f-5413f11fdfdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:25.365980 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43470d20-c20f-4ddd-a12f-5413f11fdfdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:25.368352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e705fa3-85ae-4159-8fac-e3f9b3db7995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:25.374480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e705fa3-85ae-4159-8fac-e3f9b3db7995 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:25.387309 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43470d20-c20f-4ddd-a12f-5413f11fdfdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:25.394456 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 816/1649] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:25.394908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43470d20-c20f-4ddd-a12f-5413f11fdfdd service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:25.411921 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 834/1650] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:11:25.509744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e705fa3-85ae-4159-8fac-e3f9b3db7995 service nova] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:25.511270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9e705fa3-85ae-4159-8fac-e3f9b3db7995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:25.525980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e705fa3-85ae-4159-8fac-e3f9b3db7995 service nova] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:25.531501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:25.532629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:25.532913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:25.533187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] PATH_INFO: `/v3/users/9715bdfb1fc54261a94bc157d5cdd54d` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:25.534841 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9715bdfb1fc54261a94bc157d5cdd54d)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:25.536801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:25.615307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9715bdfb1fc54261a94bc157d5cdd54d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:25.634105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9715bdfb1fc54261a94bc157d5cdd54d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:25.645614 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9715bdfb1fc54261a94bc157d5cdd54d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:25.646635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9715bdfb1fc54261a94bc157d5cdd54d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:25.647263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9715bdfb1fc54261a94bc157d5cdd54d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:25.692377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 817/1651] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:25 2022] DELETE /identity/v3/users/9715bdfb1fc54261a94bc157d5cdd54d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:25.693691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c7527-9950-4506-8269-de8874fa2eeb None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:25.694054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c7527-9950-4506-8269-de8874fa2eeb None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:25.694405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c7527-9950-4506-8269-de8874fa2eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:25.713833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-0a0c7527-9950-4506-8269-de8874fa2eeb None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:25.715341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0a0c7527-9950-4506-8269-de8874fa2eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:25.788506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 835/1652] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:25.815027 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:25.818214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:25.892768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7b10c-4fd6-4705-bb6b-8a303370e477 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:25.898043 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f0c20-8e5d-411f-8b2a-bb78d4fcce3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:25.898898 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f0c20-8e5d-411f-8b2a-bb78d4fcce3b service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:25.899234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f0c20-8e5d-411f-8b2a-bb78d4fcce3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:25.899433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f0c20-8e5d-411f-8b2a-bb78d4fcce3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:25.916598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f0c20-8e5d-411f-8b2a-bb78d4fcce3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:25.918278 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f0c20-8e5d-411f-8b2a-bb78d4fcce3b service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:25.933721 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 818/1653] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:26.031971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5523da-a466-4b24-8573-b2aa979ca2c6 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:26.032413 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5523da-a466-4b24-8573-b2aa979ca2c6 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:26.032824 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5523da-a466-4b24-8573-b2aa979ca2c6 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:26.035617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 836/1654] 10.222.0.23 () {54 vars in 912 bytes} [Tue May 3 09:11:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:11:26.041014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaef150-4cbb-47f3-a52b-1274205a60ed None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:26.043050 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaef150-4cbb-47f3-a52b-1274205a60ed None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:26.044359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaef150-4cbb-47f3-a52b-1274205a60ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:26.105065 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-ddaef150-4cbb-47f3-a52b-1274205a60ed None None] MFA Rules not processed for user `418178b7e70f47d291e239a1297ccf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:26.107346 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ddaef150-4cbb-47f3-a52b-1274205a60ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:26.119697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 819/1655] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:26.136957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaef150-4cbb-47f3-a52b-1274205a60ed None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:26.137150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f6c6d-b668-425d-9ffc-5e9d87f981e4 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:26.137258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f6c6d-b668-425d-9ffc-5e9d87f981e4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:26.137560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f6c6d-b668-425d-9ffc-5e9d87f981e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:26.139443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ddaef150-4cbb-47f3-a52b-1274205a60ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:26.158029 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaef150-4cbb-47f3-a52b-1274205a60ed None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:26.168013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba281f-0c86-4aae-871d-a7d6bb5991f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:26.169910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba281f-0c86-4aae-871d-a7d6bb5991f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:26.170368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba281f-0c86-4aae-871d-a7d6bb5991f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:26.170831 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba281f-0c86-4aae-871d-a7d6bb5991f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:26.182229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba281f-0c86-4aae-871d-a7d6bb5991f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:26.184063 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba281f-0c86-4aae-871d-a7d6bb5991f7 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:26.192589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-545f6c6d-b668-425d-9ffc-5e9d87f981e4 None None] MFA Rules not processed for user `b5a2c9b5836b47ff8ff800fa4a6a521a`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:26.195196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-545f6c6d-b668-425d-9ffc-5e9d87f981e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:26.200050 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 820/1656] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:26.203940 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba281f-0c86-4aae-871d-a7d6bb5991f7 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:26.204863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-50ba281f-0c86-4aae-871d-a7d6bb5991f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:26.240711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba281f-0c86-4aae-871d-a7d6bb5991f7 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:26.245770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:26.246845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:26.247131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:26.247403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] PATH_INFO: `/v3/projects/bbeea3c05a324177bee4dd9da8f9bfb1` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:26.248719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbeea3c05a324177bee4dd9da8f9bfb1)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:26.249748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: WARNING py.warnings [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:11:26.249748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: warnings.warn(msg) May 03 09:11:26.249748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: May 03 09:11:26.250942 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:26.326963 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 837/1657] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:26.332645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f6c6d-b668-425d-9ffc-5e9d87f981e4 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:26.336927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-545f6c6d-b668-425d-9ffc-5e9d87f981e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:26.350978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbeea3c05a324177bee4dd9da8f9bfb1', 'request_id': 'req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:26.358849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbeea3c05a324177bee4dd9da8f9bfb1', 'request_id': 'req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:26.368326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f6c6d-b668-425d-9ffc-5e9d87f981e4 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:26.370491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbeea3c05a324177bee4dd9da8f9bfb1', 'request_id': 'req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:26.418778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] The token cache is being invalidate because project bbeea3c05a324177bee4dd9da8f9bfb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:26.419075 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:26.422740 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0cd0d632-cf30-471e-90dc-d9cff7c1a29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:26.425205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 821/1658] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:26 2022] DELETE /identity/v3/projects/bbeea3c05a324177bee4dd9da8f9bfb1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:26.431630 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc2245-f406-4d0f-8c20-3fbd9d8cef80 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:26.431924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc2245-f406-4d0f-8c20-3fbd9d8cef80 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:26.432287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc2245-f406-4d0f-8c20-3fbd9d8cef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:26.466592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8fcc2245-f406-4d0f-8c20-3fbd9d8cef80 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:26.468691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8fcc2245-f406-4d0f-8c20-3fbd9d8cef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:26.554029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122e211-30db-4309-a00d-ea5f6b230cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:26.555008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122e211-30db-4309-a00d-ea5f6b230cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:26.555491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122e211-30db-4309-a00d-ea5f6b230cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:26.555945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122e211-30db-4309-a00d-ea5f6b230cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:26.556957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122e211-30db-4309-a00d-ea5f6b230cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:26.559354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122e211-30db-4309-a00d-ea5f6b230cd4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:26.638446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 838/1659] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:26 2022] POST /identity/v3/projects => generated 403 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:26.642986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122e211-30db-4309-a00d-ea5f6b230cd4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:26.646956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6122e211-30db-4309-a00d-ea5f6b230cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:26.661740 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 822/1660] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:26.664386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ee02-e841-4b1b-82ff-724cf1858f83 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:26.664675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ee02-e841-4b1b-82ff-724cf1858f83 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:26.664954 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ee02-e841-4b1b-82ff-724cf1858f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:26.705462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-9af4ee02-e841-4b1b-82ff-724cf1858f83 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:26.706744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9af4ee02-e841-4b1b-82ff-724cf1858f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:26.802072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 823/1661] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:26.803085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4ee02-e841-4b1b-82ff-724cf1858f83 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:26.804593 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122e211-30db-4309-a00d-ea5f6b230cd4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:26.813854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4ee02-e841-4b1b-82ff-724cf1858f83 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:26.820118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854bb36-64f9-49de-9878-001af151c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:26.820846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854bb36-64f9-49de-9878-001af151c642 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:26.821132 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854bb36-64f9-49de-9878-001af151c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:26.821408 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854bb36-64f9-49de-9878-001af151c642 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:26.822314 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854bb36-64f9-49de-9878-001af151c642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:26.822853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854bb36-64f9-49de-9878-001af151c642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:26.823033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35146643-4174-4b78-a32c-012ec64dc841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:26.823999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146643-4174-4b78-a32c-012ec64dc841 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:26.826873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854bb36-64f9-49de-9878-001af151c642 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:26.828922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146643-4174-4b78-a32c-012ec64dc841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:26.829455 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146643-4174-4b78-a32c-012ec64dc841 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:26.832105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35146643-4174-4b78-a32c-012ec64dc841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:26.839145 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35146643-4174-4b78-a32c-012ec64dc841 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:26.845485 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 824/1662] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:26.852346 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854bb36-64f9-49de-9878-001af151c642 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:26.866026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854bb36-64f9-49de-9878-001af151c642 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:26.874342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad3639-a535-45fb-838f-7dfc88e41f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:26.875127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad3639-a535-45fb-838f-7dfc88e41f14 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:26.875417 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad3639-a535-45fb-838f-7dfc88e41f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:26.875923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad3639-a535-45fb-838f-7dfc88e41f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:26.876683 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad3639-a535-45fb-838f-7dfc88e41f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:26.879183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad3639-a535-45fb-838f-7dfc88e41f14 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:26.886123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 839/1663] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:26 2022] POST /identity/v3/users => generated 308 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:26.890409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35146643-4174-4b78-a32c-012ec64dc841 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:26.910762 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35146643-4174-4b78-a32c-012ec64dc841 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:26.924339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b1122-fe1e-48ba-9b64-78c37b5e98e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:26.925066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b1122-fe1e-48ba-9b64-78c37b5e98e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:26.925543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b1122-fe1e-48ba-9b64-78c37b5e98e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:26.925982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b1122-fe1e-48ba-9b64-78c37b5e98e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:26.927330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 825/1664] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:26 2022] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:11:26.928273 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b1122-fe1e-48ba-9b64-78c37b5e98e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:26.932309 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b1122-fe1e-48ba-9b64-78c37b5e98e6 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:26.933188 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad3639-a535-45fb-838f-7dfc88e41f14 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:26.972993 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 840/1665] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:26.983638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b1122-fe1e-48ba-9b64-78c37b5e98e6 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:27.012137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b1122-fe1e-48ba-9b64-78c37b5e98e6 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:27.045844 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad3639-a535-45fb-838f-7dfc88e41f14 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:27.057675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f139547-1592-44d4-850f-b2ca7dabc165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:27.058405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f139547-1592-44d4-850f-b2ca7dabc165 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:27.058691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f139547-1592-44d4-850f-b2ca7dabc165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:27.060458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f139547-1592-44d4-850f-b2ca7dabc165 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:27.061956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f139547-1592-44d4-850f-b2ca7dabc165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:27.070807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f139547-1592-44d4-850f-b2ca7dabc165 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:27.117105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 826/1666] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:26 2022] POST /identity/v3/users => generated 282 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:27.123168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f139547-1592-44d4-850f-b2ca7dabc165 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:27.140023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f139547-1592-44d4-850f-b2ca7dabc165 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:27.146732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e951dc6-b124-4c5b-90f7-70b1c9f45036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:27.147174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed700636-198d-495b-b2b6-ea6472e3842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:27.147641 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e951dc6-b124-4c5b-90f7-70b1c9f45036 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:27.148028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e951dc6-b124-4c5b-90f7-70b1c9f45036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:27.148466 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e951dc6-b124-4c5b-90f7-70b1c9f45036 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:27.148829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed700636-198d-495b-b2b6-ea6472e3842a admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:27.149352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed700636-198d-495b-b2b6-ea6472e3842a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:27.149776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e951dc6-b124-4c5b-90f7-70b1c9f45036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:27.150116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed700636-198d-495b-b2b6-ea6472e3842a admin admin] PATH_INFO: `/v3/projects/e1d56ce3f5eb4110b991d9b9fcfae300/users/41e96233588b49a5b57ec340d481c335/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:27.151935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e951dc6-b124-4c5b-90f7-70b1c9f45036 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:27.170969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 827/1667] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:27.173685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed700636-198d-495b-b2b6-ea6472e3842a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d56ce3f5eb4110b991d9b9fcfae300, user_id=41e96233588b49a5b57ec340d481c335, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:27.176168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e951dc6-b124-4c5b-90f7-70b1c9f45036 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:27.188114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed700636-198d-495b-b2b6-ea6472e3842a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:27.193593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e951dc6-b124-4c5b-90f7-70b1c9f45036 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:27.199590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855be26-786b-412d-9f12-9fe6542b902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:27.203065 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855be26-786b-412d-9f12-9fe6542b902d admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:27.204781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855be26-786b-412d-9f12-9fe6542b902d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:27.205322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855be26-786b-412d-9f12-9fe6542b902d admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:27.213582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855be26-786b-412d-9f12-9fe6542b902d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:27.218192 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855be26-786b-412d-9f12-9fe6542b902d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:27.219092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 841/1668] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:26 2022] PUT /identity/v3/projects/e1d56ce3f5eb4110b991d9b9fcfae300/users/41e96233588b49a5b57ec340d481c335/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:27.232750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed700636-198d-495b-b2b6-ea6472e3842a admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:27.260958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 828/1669] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:11:27.264496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855be26-786b-412d-9f12-9fe6542b902d admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:27.285531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855be26-786b-412d-9f12-9fe6542b902d admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:27.429300 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58cdb0-286c-40a9-b133-97e39adf70e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:27.430219 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58cdb0-286c-40a9-b133-97e39adf70e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:27.430502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58cdb0-286c-40a9-b133-97e39adf70e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:27.430781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58cdb0-286c-40a9-b133-97e39adf70e7 admin admin] PATH_INFO: `/v3/projects/5a15dc06e95c4d93a9e372ae251c5128/users/335e2dbbe6b44a90837ef49b33b4bf20/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:27.461821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58cdb0-286c-40a9-b133-97e39adf70e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a15dc06e95c4d93a9e372ae251c5128, user_id=335e2dbbe6b44a90837ef49b33b4bf20, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:27.466568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58cdb0-286c-40a9-b133-97e39adf70e7 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:27.524147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 829/1670] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:27 2022] PUT /identity/v3/projects/5a15dc06e95c4d93a9e372ae251c5128/users/335e2dbbe6b44a90837ef49b33b4bf20/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:27.536971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169eddc-3fc6-4ffc-bd22-bab0483fd816 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:27.536971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169eddc-3fc6-4ffc-bd22-bab0483fd816 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:27.536971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169eddc-3fc6-4ffc-bd22-bab0483fd816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:27.598555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-9169eddc-3fc6-4ffc-bd22-bab0483fd816 None None] MFA Rules not processed for user `335e2dbbe6b44a90837ef49b33b4bf20`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:27.599925 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9169eddc-3fc6-4ffc-bd22-bab0483fd816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:27.706393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed700636-198d-495b-b2b6-ea6472e3842a admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:27.758257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 830/1671] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:11:27.766145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd431a-9488-43e7-8d5c-ff139f645e25 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:27.766400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd431a-9488-43e7-8d5c-ff139f645e25 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:27.767461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd431a-9488-43e7-8d5c-ff139f645e25 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:27.788520 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 831/1672] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 3 09:11:27 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:11:27.788520 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd431a-9488-43e7-8d5c-ff139f645e25 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:27.790149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-21cd431a-9488-43e7-8d5c-ff139f645e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:27.917490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd431a-9488-43e7-8d5c-ff139f645e25 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:27.925719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:27.926936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:27.927737 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:27.929383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] PATH_INFO: `/v3/projects/c4d7367b48464629af2ce84cd4dc3537` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:27.930209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281e2e8-2831-46c5-ac6d-03b8fc76e708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:27.931978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281e2e8-2831-46c5-ac6d-03b8fc76e708 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:27.932870 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d7367b48464629af2ce84cd4dc3537)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:27.933342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281e2e8-2831-46c5-ac6d-03b8fc76e708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:27.935770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:27.936325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281e2e8-2831-46c5-ac6d-03b8fc76e708 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:27.937282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281e2e8-2831-46c5-ac6d-03b8fc76e708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:27.939093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281e2e8-2831-46c5-ac6d-03b8fc76e708 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:27.967808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 842/1673] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 735 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:27.970743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281e2e8-2831-46c5-ac6d-03b8fc76e708 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:27.995552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281e2e8-2831-46c5-ac6d-03b8fc76e708 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:28.024864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5859475-81b5-43b4-a73c-1d498cc3535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:28.026578 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5859475-81b5-43b4-a73c-1d498cc3535f admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:28.027311 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5859475-81b5-43b4-a73c-1d498cc3535f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:28.027578 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5859475-81b5-43b4-a73c-1d498cc3535f admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:28.030533 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5859475-81b5-43b4-a73c-1d498cc3535f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:28.033730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5859475-81b5-43b4-a73c-1d498cc3535f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:28.073105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d7367b48464629af2ce84cd4dc3537', 'request_id': 'req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:28.090144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d7367b48464629af2ce84cd4dc3537', 'request_id': 'req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:28.106847 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d7367b48464629af2ce84cd4dc3537', 'request_id': 'req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:28.110927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 843/1674] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:27 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:28.115354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22061c73-a343-44b7-a949-b5e9f18a9123 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:28.115981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22061c73-a343-44b7-a949-b5e9f18a9123 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:28.117500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22061c73-a343-44b7-a949-b5e9f18a9123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:28.134988 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] The token cache is being invalidate because project c4d7367b48464629af2ce84cd4dc3537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:28.141085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:28.143179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:28.147356 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 832/1675] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:27 2022] DELETE /identity/v3/projects/c4d7367b48464629af2ce84cd4dc3537 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:28.148876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:28.155171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:28.175288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-22061c73-a343-44b7-a949-b5e9f18a9123 None None] MFA Rules not processed for user `0f7f2aea3e494546a04e20d8cedccc9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:28.177810 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-22061c73-a343-44b7-a949-b5e9f18a9123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:28.265422 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c8d0b-0bba-4d98-85ac-23c495dd4741 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:28.310817 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 844/1676] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 3 09:11:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:28.312033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22061c73-a343-44b7-a949-b5e9f18a9123 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:28.315915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-22061c73-a343-44b7-a949-b5e9f18a9123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:28.427290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896f7ef-ef32-4464-90c5-789959134276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:28.428986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896f7ef-ef32-4464-90c5-789959134276 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:28.429308 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896f7ef-ef32-4464-90c5-789959134276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:28.429589 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896f7ef-ef32-4464-90c5-789959134276 admin admin] PATH_INFO: `/v3/projects/e1d56ce3f5eb4110b991d9b9fcfae300/users/41e96233588b49a5b57ec340d481c335/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:28.435202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896f7ef-ef32-4464-90c5-789959134276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d56ce3f5eb4110b991d9b9fcfae300, user_id=41e96233588b49a5b57ec340d481c335, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:28.438116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896f7ef-ef32-4464-90c5-789959134276 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:28.460671 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22061c73-a343-44b7-a949-b5e9f18a9123 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:28.465689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 833/1677] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:28 2022] PUT /identity/v3/projects/e1d56ce3f5eb4110b991d9b9fcfae300/users/41e96233588b49a5b57ec340d481c335/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:28.467177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896f7ef-ef32-4464-90c5-789959134276 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:28.473766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f896f7ef-ef32-4464-90c5-789959134276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:28.572193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcabbe-7201-4a6c-ae9a-9c6ecb3121ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:28.572880 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcabbe-7201-4a6c-ae9a-9c6ecb3121ed admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:28.573167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcabbe-7201-4a6c-ae9a-9c6ecb3121ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:28.573447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcabbe-7201-4a6c-ae9a-9c6ecb3121ed admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:28.575802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcabbe-7201-4a6c-ae9a-9c6ecb3121ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:28.578179 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcabbe-7201-4a6c-ae9a-9c6ecb3121ed admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:28.612410 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896f7ef-ef32-4464-90c5-789959134276 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:28.618913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:28.620122 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:28.620513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:28.620877 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] PATH_INFO: `/v3/users/5a0004dac4bb4952a81a903d413736ca` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:28.622770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0004dac4bb4952a81a903d413736ca)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:28.624894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:28.628054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 845/1678] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:28 2022] POST /identity/v3/users => generated 288 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:28.629039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcabbe-7201-4a6c-ae9a-9c6ecb3121ed admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:28.743996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0004dac4bb4952a81a903d413736ca'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:28.769667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0004dac4bb4952a81a903d413736ca'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:28.782191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0004dac4bb4952a81a903d413736ca'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:28.783642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0004dac4bb4952a81a903d413736ca'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:28.785235 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0004dac4bb4952a81a903d413736ca'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:28.787930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcabbe-7201-4a6c-ae9a-9c6ecb3121ed admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:28.797544 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05a342-2150-4a3c-8cd1-dfe7d47260f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7f2aea3e494546a04e20d8cedccc9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:28.798492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05a342-2150-4a3c-8cd1-dfe7d47260f6 service placement] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:28.800456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05a342-2150-4a3c-8cd1-dfe7d47260f6 service placement] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:28.801077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05a342-2150-4a3c-8cd1-dfe7d47260f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:28.807847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-2c05a342-2150-4a3c-8cd1-dfe7d47260f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:28.820749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 834/1679] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:28 2022] DELETE /identity/v3/users/5a0004dac4bb4952a81a903d413736ca => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:28.822101 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:28.825050 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:28.837430 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05a342-2150-4a3c-8cd1-dfe7d47260f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:28.839353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05a342-2150-4a3c-8cd1-dfe7d47260f6 service placement] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:28.857690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 846/1680] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:29.030711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fab558-80ad-4fb7-ae74-8f0ffc9f901c admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:29.030711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578479c-ee1a-475a-8e93-3d3bf05c599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:29.030711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578479c-ee1a-475a-8e93-3d3bf05c599e admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:29.030711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578479c-ee1a-475a-8e93-3d3bf05c599e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:29.032058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578479c-ee1a-475a-8e93-3d3bf05c599e admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:29.032058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578479c-ee1a-475a-8e93-3d3bf05c599e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:29.032058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578479c-ee1a-475a-8e93-3d3bf05c599e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:29.058457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 835/1681] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:29.063352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05a342-2150-4a3c-8cd1-dfe7d47260f6 service placement] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:29.076586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05a342-2150-4a3c-8cd1-dfe7d47260f6 service placement] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:29.083939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc66d7e-871f-4009-9bed-045685479b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:29.085257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc66d7e-871f-4009-9bed-045685479b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:29.085766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc66d7e-871f-4009-9bed-045685479b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:29.086248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc66d7e-871f-4009-9bed-045685479b2d admin admin] PATH_INFO: `/v3/projects/01dd3e397ebb41f5bd9b8098056230e0/users/ebddfcd337074c81820ec60a866731d3/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:29.107391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc66d7e-871f-4009-9bed-045685479b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01dd3e397ebb41f5bd9b8098056230e0, user_id=ebddfcd337074c81820ec60a866731d3, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:29.110433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc66d7e-871f-4009-9bed-045685479b2d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:29.134900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 847/1682] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:29 2022] PUT /identity/v3/projects/01dd3e397ebb41f5bd9b8098056230e0/users/ebddfcd337074c81820ec60a866731d3/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:29.139141 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578479c-ee1a-475a-8e93-3d3bf05c599e admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:29.159708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578479c-ee1a-475a-8e93-3d3bf05c599e admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:29.334426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cc867-e31e-4966-9b3b-73ffa6dee75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:29.335223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cc867-e31e-4966-9b3b-73ffa6dee75e admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:29.336683 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cc867-e31e-4966-9b3b-73ffa6dee75e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:29.337912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cc867-e31e-4966-9b3b-73ffa6dee75e admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:29.340186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cc867-e31e-4966-9b3b-73ffa6dee75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:29.345182 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cc867-e31e-4966-9b3b-73ffa6dee75e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:29.371571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 836/1683] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:29.372367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc66d7e-871f-4009-9bed-045685479b2d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:29.385601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc66d7e-871f-4009-9bed-045685479b2d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:29.397913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1c7cf-8b12-4087-8191-a66924c6af5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:29.398827 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1c7cf-8b12-4087-8191-a66924c6af5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:29.399108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1c7cf-8b12-4087-8191-a66924c6af5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:29.399378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1c7cf-8b12-4087-8191-a66924c6af5d admin admin] PATH_INFO: `/v3/projects/01dd3e397ebb41f5bd9b8098056230e0/users/ebddfcd337074c81820ec60a866731d3/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:29.408297 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1c7cf-8b12-4087-8191-a66924c6af5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01dd3e397ebb41f5bd9b8098056230e0, user_id=ebddfcd337074c81820ec60a866731d3, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:29.410952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1c7cf-8b12-4087-8191-a66924c6af5d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:29.481006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 848/1684] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:29 2022] PUT /identity/v3/projects/01dd3e397ebb41f5bd9b8098056230e0/users/ebddfcd337074c81820ec60a866731d3/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:29.482916 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c3e1-51b4-4e96-a2b6-ee89143e4443 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:29.483091 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c3e1-51b4-4e96-a2b6-ee89143e4443 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:29.483367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c3e1-51b4-4e96-a2b6-ee89143e4443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:29.555815 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-7990c3e1-51b4-4e96-a2b6-ee89143e4443 None None] MFA Rules not processed for user `ebddfcd337074c81820ec60a866731d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:29.557085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7990c3e1-51b4-4e96-a2b6-ee89143e4443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:29.719893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 837/1685] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:29 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:29.734732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1c7cf-8b12-4087-8191-a66924c6af5d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:29.736943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b9b1c7cf-8b12-4087-8191-a66924c6af5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:29.913558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990c3e1-51b4-4e96-a2b6-ee89143e4443 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:29.916843 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7990c3e1-51b4-4e96-a2b6-ee89143e4443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:29.928598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1c7cf-8b12-4087-8191-a66924c6af5d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:29.940122 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79025ba3-5c88-4fd7-a068-9b77f6340ba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:29.940810 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79025ba3-5c88-4fd7-a068-9b77f6340ba1 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:29.941091 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79025ba3-5c88-4fd7-a068-9b77f6340ba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:29.941365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79025ba3-5c88-4fd7-a068-9b77f6340ba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:29.971374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79025ba3-5c88-4fd7-a068-9b77f6340ba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:29.972927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79025ba3-5c88-4fd7-a068-9b77f6340ba1 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:29.997722 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 849/1686] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:29 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:30.122859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990c3e1-51b4-4e96-a2b6-ee89143e4443 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:30.139568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:30.142380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:30.143274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:30.143772 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe admin admin] PATH_INFO: `/v3/projects/32a17eca3d42484b9cb53a07406a2a07` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:30.155557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a17eca3d42484b9cb53a07406a2a07)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:30.160428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:30.288523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a17eca3d42484b9cb53a07406a2a07', 'request_id': 'req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:30.314726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a17eca3d42484b9cb53a07406a2a07', 'request_id': 'req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:30.326885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79025ba3-5c88-4fd7-a068-9b77f6340ba1 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:30.334561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a17eca3d42484b9cb53a07406a2a07', 'request_id': 'req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:30.338147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79025ba3-5c88-4fd7-a068-9b77f6340ba1 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:30.372261 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe admin admin] The token cache is being invalidate because project 32a17eca3d42484b9cb53a07406a2a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:30.373899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:30.379505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d59e4ad2-32cd-4bf8-91a6-707d0b5680fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:30.389304 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 838/1687] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:29 2022] DELETE /identity/v3/projects/32a17eca3d42484b9cb53a07406a2a07 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:30.391875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e5dae-36db-4252-bc07-cd0786703ea5 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:30.394009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e5dae-36db-4252-bc07-cd0786703ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:30.394378 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e5dae-36db-4252-bc07-cd0786703ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:30.443268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-6b1e5dae-36db-4252-bc07-cd0786703ea5 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:30.444335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259bd45-dc74-46a9-81ef-b3e518bbbd81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:30.444556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6b1e5dae-36db-4252-bc07-cd0786703ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:30.445402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259bd45-dc74-46a9-81ef-b3e518bbbd81 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:30.445905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259bd45-dc74-46a9-81ef-b3e518bbbd81 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:30.446443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259bd45-dc74-46a9-81ef-b3e518bbbd81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:30.454982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0259bd45-dc74-46a9-81ef-b3e518bbbd81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:30.574258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259bd45-dc74-46a9-81ef-b3e518bbbd81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:30.575823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259bd45-dc74-46a9-81ef-b3e518bbbd81 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:30.594479 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 850/1688] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:30.594654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 839/1689] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:30.594729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e353760-94a7-401a-9b62-88cabaffb6d3 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:30.594729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e353760-94a7-401a-9b62-88cabaffb6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:30.594729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e353760-94a7-401a-9b62-88cabaffb6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:30.633856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-9e353760-94a7-401a-9b62-88cabaffb6d3 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:30.635085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9e353760-94a7-401a-9b62-88cabaffb6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:30.652525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 851/1690] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:30.657263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e5dae-36db-4252-bc07-cd0786703ea5 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:30.672724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e5dae-36db-4252-bc07-cd0786703ea5 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:30.683030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea7aa3-8ae7-4741-af32-00c9993a0287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:30.683872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea7aa3-8ae7-4741-af32-00c9993a0287 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:30.684245 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea7aa3-8ae7-4741-af32-00c9993a0287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:30.684511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea7aa3-8ae7-4741-af32-00c9993a0287 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:30.685520 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea7aa3-8ae7-4741-af32-00c9993a0287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:30.685861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea7aa3-8ae7-4741-af32-00c9993a0287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:30.687451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea7aa3-8ae7-4741-af32-00c9993a0287 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:30.724444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e353760-94a7-401a-9b62-88cabaffb6d3 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:30.727708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 840/1691] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:30.740423 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e353760-94a7-401a-9b62-88cabaffb6d3 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:30.754819 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b219fab-25f8-4f9e-a5da-4a376eac02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:30.755985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b219fab-25f8-4f9e-a5da-4a376eac02f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:30.757396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b219fab-25f8-4f9e-a5da-4a376eac02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:30.758424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b219fab-25f8-4f9e-a5da-4a376eac02f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:30.762450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b219fab-25f8-4f9e-a5da-4a376eac02f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:30.766696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b219fab-25f8-4f9e-a5da-4a376eac02f5 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:30.874109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 852/1692] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:30 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:30.879344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea7aa3-8ae7-4741-af32-00c9993a0287 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:30.899466 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea7aa3-8ae7-4741-af32-00c9993a0287 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:31.030356 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3914c6-0009-4323-896d-00ac4bd4fcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:31.031385 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3914c6-0009-4323-896d-00ac4bd4fcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:31.031857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3914c6-0009-4323-896d-00ac4bd4fcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:31.032453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3914c6-0009-4323-896d-00ac4bd4fcc7 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:31.033356 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3914c6-0009-4323-896d-00ac4bd4fcc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:31.036280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3914c6-0009-4323-896d-00ac4bd4fcc7 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:31.095646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 841/1693] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:30 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:31.099390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b219fab-25f8-4f9e-a5da-4a376eac02f5 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:31.112975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b219fab-25f8-4f9e-a5da-4a376eac02f5 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:31.119084 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4170-d348-4999-a1bb-d3f1f5137905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:31.120188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4170-d348-4999-a1bb-d3f1f5137905 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:31.120670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4170-d348-4999-a1bb-d3f1f5137905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:31.121095 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4170-d348-4999-a1bb-d3f1f5137905 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:31.122509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f4170-d348-4999-a1bb-d3f1f5137905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:31.124466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f4170-d348-4999-a1bb-d3f1f5137905 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:31.142964 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 853/1694] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:31.144239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3914c6-0009-4323-896d-00ac4bd4fcc7 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:31.161821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3914c6-0009-4323-896d-00ac4bd4fcc7 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:31.168905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f3f42-e2f1-44fd-80b2-482d4d2204e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:31.169769 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f3f42-e2f1-44fd-80b2-482d4d2204e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:31.170316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f3f42-e2f1-44fd-80b2-482d4d2204e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:31.170316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f3f42-e2f1-44fd-80b2-482d4d2204e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:31.171032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f3f42-e2f1-44fd-80b2-482d4d2204e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:31.172846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f3f42-e2f1-44fd-80b2-482d4d2204e4 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:31.188805 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 842/1695] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:31.190861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4170-d348-4999-a1bb-d3f1f5137905 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:31.215072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4170-d348-4999-a1bb-d3f1f5137905 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:31.229677 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa331014-f720-4e7c-b20e-3584fa6ad876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:31.230345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa331014-f720-4e7c-b20e-3584fa6ad876 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:31.230667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa331014-f720-4e7c-b20e-3584fa6ad876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:31.230960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa331014-f720-4e7c-b20e-3584fa6ad876 admin admin] PATH_INFO: `/v3/projects/dfe914f1820d457a9c998d240af616ef/users/7b232dd34fc04cb7a38375a2173e6558/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:31.268539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa331014-f720-4e7c-b20e-3584fa6ad876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe914f1820d457a9c998d240af616ef, user_id=7b232dd34fc04cb7a38375a2173e6558, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:31.277209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa331014-f720-4e7c-b20e-3584fa6ad876 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:31.315168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 854/1696] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:31 2022] PUT /identity/v3/projects/dfe914f1820d457a9c998d240af616ef/users/7b232dd34fc04cb7a38375a2173e6558/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:31.320234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceceee34-2103-435c-bc3c-39dc8cc329ee None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:31.320626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceceee34-2103-435c-bc3c-39dc8cc329ee None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:31.320860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceceee34-2103-435c-bc3c-39dc8cc329ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:31.389510 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-ceceee34-2103-435c-bc3c-39dc8cc329ee None None] MFA Rules not processed for user `7b232dd34fc04cb7a38375a2173e6558`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:31.391479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ceceee34-2103-435c-bc3c-39dc8cc329ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:31.550649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 843/1697] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:31.555162 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa331014-f720-4e7c-b20e-3584fa6ad876 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:31.688362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa331014-f720-4e7c-b20e-3584fa6ad876 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:31.700886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998337a9-fc44-41aa-bb9d-68efcc1288d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:31.701585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998337a9-fc44-41aa-bb9d-68efcc1288d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:31.701868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998337a9-fc44-41aa-bb9d-68efcc1288d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:31.702139 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998337a9-fc44-41aa-bb9d-68efcc1288d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:31.702836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998337a9-fc44-41aa-bb9d-68efcc1288d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:31.705152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998337a9-fc44-41aa-bb9d-68efcc1288d4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:31.777713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 855/1698] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:31 2022] POST /identity/v3/projects => generated 365 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:31.779212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998337a9-fc44-41aa-bb9d-68efcc1288d4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:31.780764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb07fe4-994d-453b-af4b-48f616c92917 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:31.781060 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb07fe4-994d-453b-af4b-48f616c92917 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:31.781584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb07fe4-994d-453b-af4b-48f616c92917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:31.829751 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-7fb07fe4-994d-453b-af4b-48f616c92917 None None] MFA Rules not processed for user `41e96233588b49a5b57ec340d481c335`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:31.830902 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7fb07fe4-994d-453b-af4b-48f616c92917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:31.915022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 844/1699] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:31.916896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998337a9-fc44-41aa-bb9d-68efcc1288d4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:31.925041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9df59f-ac5c-4de1-8128-05dfb465ed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:31.925627 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9df59f-ac5c-4de1-8128-05dfb465ed42 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:31.925885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9df59f-ac5c-4de1-8128-05dfb465ed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:31.926335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9df59f-ac5c-4de1-8128-05dfb465ed42 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:31.927197 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9df59f-ac5c-4de1-8128-05dfb465ed42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:31.929302 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9df59f-ac5c-4de1-8128-05dfb465ed42 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:31.978178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 856/1700] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:31 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:31.983054 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb07fe4-994d-453b-af4b-48f616c92917 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:32.003057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb07fe4-994d-453b-af4b-48f616c92917 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:32.018462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ffbed-b9bd-49f9-8bd1-24235a1c264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:32.019936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ffbed-b9bd-49f9-8bd1-24235a1c264c admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:32.022655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ffbed-b9bd-49f9-8bd1-24235a1c264c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:32.023684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ffbed-b9bd-49f9-8bd1-24235a1c264c admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:32.026282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ffbed-b9bd-49f9-8bd1-24235a1c264c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:32.033150 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ffbed-b9bd-49f9-8bd1-24235a1c264c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:32.065312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 845/1701] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:32.069124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9df59f-ac5c-4de1-8128-05dfb465ed42 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:32.080301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9df59f-ac5c-4de1-8128-05dfb465ed42 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:32.102464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace83105-cfea-4430-89c8-046b86ef6542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:32.103399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace83105-cfea-4430-89c8-046b86ef6542 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:32.103692 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace83105-cfea-4430-89c8-046b86ef6542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:32.103975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace83105-cfea-4430-89c8-046b86ef6542 admin admin] PATH_INFO: `/v3/projects/eeb06fb3546349d596ce96d1ccfef6c5/users/64feb1d9dc7548079660f4afb70a9bb9/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:32.138578 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace83105-cfea-4430-89c8-046b86ef6542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb06fb3546349d596ce96d1ccfef6c5, user_id=64feb1d9dc7548079660f4afb70a9bb9, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:32.143472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace83105-cfea-4430-89c8-046b86ef6542 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:32.181257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 857/1702] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:32 2022] PUT /identity/v3/projects/eeb06fb3546349d596ce96d1ccfef6c5/users/64feb1d9dc7548079660f4afb70a9bb9/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:32.182528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ffbed-b9bd-49f9-8bd1-24235a1c264c admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:32.218885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ffbed-b9bd-49f9-8bd1-24235a1c264c admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:32.342387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310ea63-ed8d-4f3d-9ff3-6df5638b51f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:32.343079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ea63-ed8d-4f3d-9ff3-6df5638b51f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:32.343365 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ea63-ed8d-4f3d-9ff3-6df5638b51f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:32.343634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ea63-ed8d-4f3d-9ff3-6df5638b51f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:32.348873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310ea63-ed8d-4f3d-9ff3-6df5638b51f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:32.354283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310ea63-ed8d-4f3d-9ff3-6df5638b51f4 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:32.382563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 846/1703] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:32.383734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace83105-cfea-4430-89c8-046b86ef6542 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:32.406375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace83105-cfea-4430-89c8-046b86ef6542 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:32.412500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085d3cd-f5a3-4dcb-9709-be4220ab6e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:32.413220 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085d3cd-f5a3-4dcb-9709-be4220ab6e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:32.413501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085d3cd-f5a3-4dcb-9709-be4220ab6e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:32.413774 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085d3cd-f5a3-4dcb-9709-be4220ab6e3c admin admin] PATH_INFO: `/v3/projects/eeb06fb3546349d596ce96d1ccfef6c5/users/64feb1d9dc7548079660f4afb70a9bb9/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:32.416126 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085d3cd-f5a3-4dcb-9709-be4220ab6e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb06fb3546349d596ce96d1ccfef6c5, user_id=64feb1d9dc7548079660f4afb70a9bb9, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:32.419639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085d3cd-f5a3-4dcb-9709-be4220ab6e3c admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:32.441216 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 858/1704] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:32 2022] PUT /identity/v3/projects/eeb06fb3546349d596ce96d1ccfef6c5/users/64feb1d9dc7548079660f4afb70a9bb9/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:11:32.457576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7aa22-8bf3-454d-bf86-c8bace9b468a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:32.458221 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7aa22-8bf3-454d-bf86-c8bace9b468a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:32.459306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7aa22-8bf3-454d-bf86-c8bace9b468a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:32.507430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-e1b7aa22-8bf3-454d-bf86-c8bace9b468a None None] MFA Rules not processed for user `64feb1d9dc7548079660f4afb70a9bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:32.509111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e1b7aa22-8bf3-454d-bf86-c8bace9b468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:32.733908 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 847/1705] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:32.742984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085d3cd-f5a3-4dcb-9709-be4220ab6e3c admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:32.744715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f085d3cd-f5a3-4dcb-9709-be4220ab6e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:32.978950 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085d3cd-f5a3-4dcb-9709-be4220ab6e3c admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:32.983942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8b47e-4300-4b62-a6ec-8337dd5ce69c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:32.984875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8b47e-4300-4b62-a6ec-8337dd5ce69c service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:32.985237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8b47e-4300-4b62-a6ec-8337dd5ce69c service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:32.989984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8b47e-4300-4b62-a6ec-8337dd5ce69c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:33.004673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8b47e-4300-4b62-a6ec-8337dd5ce69c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:33.007781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8b47e-4300-4b62-a6ec-8337dd5ce69c service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:33.025675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 859/1706] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:33.154807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7aa22-8bf3-454d-bf86-c8bace9b468a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:33.156287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e1b7aa22-8bf3-454d-bf86-c8bace9b468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:33.173581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7aa22-8bf3-454d-bf86-c8bace9b468a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:33.188498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c426c-227b-48a0-890f-44fca795a41d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:33.189850 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c426c-227b-48a0-890f-44fca795a41d service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:33.190670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c426c-227b-48a0-890f-44fca795a41d service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:33.191128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c426c-227b-48a0-890f-44fca795a41d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:33.353659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c426c-227b-48a0-890f-44fca795a41d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:33.355053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c426c-227b-48a0-890f-44fca795a41d service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:33.391016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 848/1707] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:34.310167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aeb6f-810a-4d7d-9379-0a4c7fe83dca None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:34.310576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aeb6f-810a-4d7d-9379-0a4c7fe83dca None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:34.311121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aeb6f-810a-4d7d-9379-0a4c7fe83dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:34.375284 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-467aeb6f-810a-4d7d-9379-0a4c7fe83dca None None] MFA Rules not processed for user `adc15a08f9f94c71bc1e0a092e1b7818`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:34.376554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-467aeb6f-810a-4d7d-9379-0a4c7fe83dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:34.526710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 860/1708] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:34.549696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c426c-227b-48a0-890f-44fca795a41d service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:34.552531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-697c426c-227b-48a0-890f-44fca795a41d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:34.792023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c426c-227b-48a0-890f-44fca795a41d service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:34.820625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c48100-3deb-4579-b3ca-8842f6784ef8 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:34.821184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c48100-3deb-4579-b3ca-8842f6784ef8 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:34.821494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c48100-3deb-4579-b3ca-8842f6784ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:34.834217 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd2ee2-5cd4-4574-b70c-1cb174b0d794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:34.835470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd2ee2-5cd4-4574-b70c-1cb174b0d794 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:34.836062 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd2ee2-5cd4-4574-b70c-1cb174b0d794 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:34.836566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd2ee2-5cd4-4574-b70c-1cb174b0d794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:34.862744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd2ee2-5cd4-4574-b70c-1cb174b0d794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:34.867635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd2ee2-5cd4-4574-b70c-1cb174b0d794 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:34.893497 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 849/1709] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:34.992584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-86c48100-3deb-4579-b3ca-8842f6784ef8 None None] MFA Rules not processed for user `1e4b30ac01a84009b41f6c83de99cfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:35.000399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-86c48100-3deb-4579-b3ca-8842f6784ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:35.324602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 861/1710] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:11:35.337298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c543490-4cb7-4aa5-b44e-4166a903d061 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:35.339918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c543490-4cb7-4aa5-b44e-4166a903d061 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:35.342116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c543490-4cb7-4aa5-b44e-4166a903d061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:35.406470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0c543490-4cb7-4aa5-b44e-4166a903d061 None None] MFA Rules not processed for user `1e4b30ac01a84009b41f6c83de99cfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:35.408336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0c543490-4cb7-4aa5-b44e-4166a903d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:35.440842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 850/1711] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:35.492436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c48100-3deb-4579-b3ca-8842f6784ef8 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:35.494551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-86c48100-3deb-4579-b3ca-8842f6784ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:35.558575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c543490-4cb7-4aa5-b44e-4166a903d061 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:35.561366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0c543490-4cb7-4aa5-b44e-4166a903d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:35.604375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c543490-4cb7-4aa5-b44e-4166a903d061 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:35.622854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29413-bcfb-4733-aad1-ae8cf920add0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:35.638138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c48100-3deb-4579-b3ca-8842f6784ef8 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:35.646019 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29413-bcfb-4733-aad1-ae8cf920add0 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:35.646399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29413-bcfb-4733-aad1-ae8cf920add0 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:35.646690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29413-bcfb-4733-aad1-ae8cf920add0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:35.651677 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a3baa-da2e-48dd-9ab6-fb99ad479bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:35.659613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a3baa-da2e-48dd-9ab6-fb99ad479bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:35.659905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a3baa-da2e-48dd-9ab6-fb99ad479bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:35.660209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a3baa-da2e-48dd-9ab6-fb99ad479bfb admin admin] PATH_INFO: `/v3/users/b5a2c9b5836b47ff8ff800fa4a6a521a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:35.662941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a3baa-da2e-48dd-9ab6-fb99ad479bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a2c9b5836b47ff8ff800fa4a6a521a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:35.669665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a3baa-da2e-48dd-9ab6-fb99ad479bfb admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:35.725688 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29413-bcfb-4733-aad1-ae8cf920add0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:35.737678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29413-bcfb-4733-aad1-ae8cf920add0 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:35.781792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 851/1712] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:35.782876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29413-bcfb-4733-aad1-ae8cf920add0 service nova] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:35.786658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e5c29413-bcfb-4733-aad1-ae8cf920add0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:35.788805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-288a3baa-da2e-48dd-9ab6-fb99ad479bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a2c9b5836b47ff8ff800fa4a6a521a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:35.806740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-288a3baa-da2e-48dd-9ab6-fb99ad479bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a2c9b5836b47ff8ff800fa4a6a521a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:35.808580 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-288a3baa-da2e-48dd-9ab6-fb99ad479bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a2c9b5836b47ff8ff800fa4a6a521a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:35.809496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-288a3baa-da2e-48dd-9ab6-fb99ad479bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a2c9b5836b47ff8ff800fa4a6a521a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:35.857498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29413-bcfb-4733-aad1-ae8cf920add0 service nova] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:35.893431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabf5b3-8507-4126-8262-10351bb56675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:35.900830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf5b3-8507-4126-8262-10351bb56675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:35.901834 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf5b3-8507-4126-8262-10351bb56675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:35.905481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf5b3-8507-4126-8262-10351bb56675 admin admin] PATH_INFO: `/v3/users/1758efeac1af430eb608ba98df1118d3` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:35.909297 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-288a3baa-da2e-48dd-9ab6-fb99ad479bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a2c9b5836b47ff8ff800fa4a6a521a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:35.910265 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabf5b3-8507-4126-8262-10351bb56675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1758efeac1af430eb608ba98df1118d3)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:35.922656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabf5b3-8507-4126-8262-10351bb56675 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:35.955087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 862/1713] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:35 2022] DELETE /identity/v3/users/b5a2c9b5836b47ff8ff800fa4a6a521a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:36.005847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce15e8-f5ee-4516-ad1b-d21ba5a64929 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:36.006251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce15e8-f5ee-4516-ad1b-d21ba5a64929 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:36.007661 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce15e8-f5ee-4516-ad1b-d21ba5a64929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:36.035926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-13ce15e8-f5ee-4516-ad1b-d21ba5a64929 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:36.038091 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-13ce15e8-f5ee-4516-ad1b-d21ba5a64929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:36.045535 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0aabf5b3-8507-4126-8262-10351bb56675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1758efeac1af430eb608ba98df1118d3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:36.066028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0aabf5b3-8507-4126-8262-10351bb56675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1758efeac1af430eb608ba98df1118d3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:36.077902 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0aabf5b3-8507-4126-8262-10351bb56675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1758efeac1af430eb608ba98df1118d3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:36.078869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0aabf5b3-8507-4126-8262-10351bb56675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1758efeac1af430eb608ba98df1118d3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:36.079632 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0aabf5b3-8507-4126-8262-10351bb56675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1758efeac1af430eb608ba98df1118d3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:36.131051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 852/1714] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:35 2022] DELETE /identity/v3/users/1758efeac1af430eb608ba98df1118d3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:36.135740 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae9c6a-a983-48d0-860d-1f317d3b5fd0 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:36.136144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae9c6a-a983-48d0-860d-1f317d3b5fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:36.136716 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae9c6a-a983-48d0-860d-1f317d3b5fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:36.195019 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-9dae9c6a-a983-48d0-860d-1f317d3b5fd0 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:36.200177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9dae9c6a-a983-48d0-860d-1f317d3b5fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:36.228588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 863/1715] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:36.373607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 853/1716] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:36.407658 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce15e8-f5ee-4516-ad1b-d21ba5a64929 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:36.413592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-13ce15e8-f5ee-4516-ad1b-d21ba5a64929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:36.528541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce15e8-f5ee-4516-ad1b-d21ba5a64929 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:36.591492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae9c6a-a983-48d0-860d-1f317d3b5fd0 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:36.592979 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9dae9c6a-a983-48d0-860d-1f317d3b5fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:36.690422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a151b-cc90-4ced-a88d-95cd6cb3f13a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:36.691365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a151b-cc90-4ced-a88d-95cd6cb3f13a service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:36.695269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a151b-cc90-4ced-a88d-95cd6cb3f13a service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:36.695988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a151b-cc90-4ced-a88d-95cd6cb3f13a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:36.733684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a151b-cc90-4ced-a88d-95cd6cb3f13a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:36.737083 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a151b-cc90-4ced-a88d-95cd6cb3f13a service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:36.809482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 864/1717] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:36.819009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae9c6a-a983-48d0-860d-1f317d3b5fd0 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:36.840387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2508e-f663-4723-b56a-e932a46a4810 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:36.841061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2508e-f663-4723-b56a-e932a46a4810 service swift] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:36.843332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2508e-f663-4723-b56a-e932a46a4810 service swift] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:36.843756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2508e-f663-4723-b56a-e932a46a4810 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:36.895626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a151b-cc90-4ced-a88d-95cd6cb3f13a service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:36.899674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-2e4a151b-cc90-4ced-a88d-95cd6cb3f13a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:36.958342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a151b-cc90-4ced-a88d-95cd6cb3f13a service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:36.971739 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:36.975281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:36.975847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:36.976385 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] PATH_INFO: `/v3/projects/14529898edf44b858828a56edbb56557` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:36.979337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14529898edf44b858828a56edbb56557)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:36.986171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:37.070858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2508e-f663-4723-b56a-e932a46a4810 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:37.072322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2508e-f663-4723-b56a-e932a46a4810 service swift] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:37.126482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 854/1718] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:11:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 09:11:37.181137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14529898edf44b858828a56edbb56557', 'request_id': 'req-e3012ada-738e-4e9e-a7cc-a00042446d99'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:37.199372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14529898edf44b858828a56edbb56557', 'request_id': 'req-e3012ada-738e-4e9e-a7cc-a00042446d99'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:37.229004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14529898edf44b858828a56edbb56557', 'request_id': 'req-e3012ada-738e-4e9e-a7cc-a00042446d99'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:37.263693 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] The token cache is being invalidate because project 14529898edf44b858828a56edbb56557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:37.265824 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:37.267816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:37.271264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 865/1719] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:36 2022] DELETE /identity/v3/projects/14529898edf44b858828a56edbb56557 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:11:37.275001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2508e-f663-4723-b56a-e932a46a4810 service swift] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:37.294805 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2508e-f663-4723-b56a-e932a46a4810 service swift] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:37.544049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:37.545252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:37.545613 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:37.546023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] PATH_INFO: `/v3/users/41e96233588b49a5b57ec340d481c335` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:37.549876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e96233588b49a5b57ec340d481c335)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:37.556580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:37.742554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e96233588b49a5b57ec340d481c335'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:37.777570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e96233588b49a5b57ec340d481c335'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:37.802937 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e96233588b49a5b57ec340d481c335'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:37.805424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e96233588b49a5b57ec340d481c335'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:37.808506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e96233588b49a5b57ec340d481c335'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:37.860401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 855/1720] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:37 2022] DELETE /identity/v3/users/41e96233588b49a5b57ec340d481c335 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:37.924721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:37.927028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:37.958161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3012ada-738e-4e9e-a7cc-a00042446d99 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:38.175370 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:38.177781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:38.203854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4274d69-44e4-4da5-b564-1addd9c09bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:38.218468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274d69-44e4-4da5-b564-1addd9c09bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:38.218799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274d69-44e4-4da5-b564-1addd9c09bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:38.226870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274d69-44e4-4da5-b564-1addd9c09bdf admin admin] PATH_INFO: `/v3/users/7b232dd34fc04cb7a38375a2173e6558` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:38.232174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4274d69-44e4-4da5-b564-1addd9c09bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b232dd34fc04cb7a38375a2173e6558)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:38.235868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4274d69-44e4-4da5-b564-1addd9c09bdf admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:38.367331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29450da3-f487-4e2f-bf94-2c77f7e49bfa admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:38.368145 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b4274d69-44e4-4da5-b564-1addd9c09bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b232dd34fc04cb7a38375a2173e6558'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:38.378792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b3d4f-8947-464a-92d7-5a7cc6f78754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:38.381032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b3d4f-8947-464a-92d7-5a7cc6f78754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:38.383969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b3d4f-8947-464a-92d7-5a7cc6f78754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:38.384445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b3d4f-8947-464a-92d7-5a7cc6f78754 admin admin] PATH_INFO: `/v3/users/277965e5d263401f937f090380ced6dd` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:38.386355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b3d4f-8947-464a-92d7-5a7cc6f78754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=277965e5d263401f937f090380ced6dd)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:38.387070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b4274d69-44e4-4da5-b564-1addd9c09bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b232dd34fc04cb7a38375a2173e6558'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:38.388535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b4274d69-44e4-4da5-b564-1addd9c09bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b232dd34fc04cb7a38375a2173e6558'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:38.392201 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b4274d69-44e4-4da5-b564-1addd9c09bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b232dd34fc04cb7a38375a2173e6558'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:38.393312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b3d4f-8947-464a-92d7-5a7cc6f78754 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:38.430900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b4274d69-44e4-4da5-b564-1addd9c09bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b232dd34fc04cb7a38375a2173e6558'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:38.492561 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 866/1721] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:37 2022] DELETE /identity/v3/users/7b232dd34fc04cb7a38375a2173e6558 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:38.497912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21fa01-9a19-42bc-9d11-751f23b5e61c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:38.498177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21fa01-9a19-42bc-9d11-751f23b5e61c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:38.498432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21fa01-9a19-42bc-9d11-751f23b5e61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:38.552279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-6c21fa01-9a19-42bc-9d11-751f23b5e61c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:38.553514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6c21fa01-9a19-42bc-9d11-751f23b5e61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:38.554100 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-605b3d4f-8947-464a-92d7-5a7cc6f78754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277965e5d263401f937f090380ced6dd'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:38.576245 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-605b3d4f-8947-464a-92d7-5a7cc6f78754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277965e5d263401f937f090380ced6dd'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:38.589521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-605b3d4f-8947-464a-92d7-5a7cc6f78754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277965e5d263401f937f090380ced6dd'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:38.590540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-605b3d4f-8947-464a-92d7-5a7cc6f78754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277965e5d263401f937f090380ced6dd'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:38.591754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-605b3d4f-8947-464a-92d7-5a7cc6f78754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277965e5d263401f937f090380ced6dd'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:38.650368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 856/1722] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:38 2022] DELETE /identity/v3/users/277965e5d263401f937f090380ced6dd => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:11:38.654783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0398021-da2e-491e-8d22-3bd58ba75d80 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:38.656069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0398021-da2e-491e-8d22-3bd58ba75d80 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:38.658171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0398021-da2e-491e-8d22-3bd58ba75d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:38.750587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-b0398021-da2e-491e-8d22-3bd58ba75d80 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:38.758591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b0398021-da2e-491e-8d22-3bd58ba75d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:38.792142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 867/1723] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:38.883901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21fa01-9a19-42bc-9d11-751f23b5e61c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:38.888449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6c21fa01-9a19-42bc-9d11-751f23b5e61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:38.999815 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 857/1724] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:39.005500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21fa01-9a19-42bc-9d11-751f23b5e61c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:39.088560 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0398021-da2e-491e-8d22-3bd58ba75d80 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:39.227891 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493979ef-986a-450b-a727-3b88af624421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:39.228184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493979ef-986a-450b-a727-3b88af624421 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:39.228476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493979ef-986a-450b-a727-3b88af624421 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:39.228755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493979ef-986a-450b-a727-3b88af624421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:39.263308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493979ef-986a-450b-a727-3b88af624421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:39.264783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493979ef-986a-450b-a727-3b88af624421 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:39.269326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0398021-da2e-491e-8d22-3bd58ba75d80 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:39.279287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc853b1-f83c-40ae-ba34-50d4c02e5e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:39.282153 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc853b1-f83c-40ae-ba34-50d4c02e5e1e service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:39.282609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc853b1-f83c-40ae-ba34-50d4c02e5e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:39.283089 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc853b1-f83c-40ae-ba34-50d4c02e5e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:39.304069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 868/1725] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:11:39.322564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc853b1-f83c-40ae-ba34-50d4c02e5e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:39.324273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc853b1-f83c-40ae-ba34-50d4c02e5e1e service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:39.338933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 858/1726] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:39.749631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493979ef-986a-450b-a727-3b88af624421 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:39.751228 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-493979ef-986a-450b-a727-3b88af624421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:39.806707 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493979ef-986a-450b-a727-3b88af624421 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:39.825719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:39.834498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:39.834498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:39.834498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] PATH_INFO: `/v3/projects/8efd3e9b2ee14e56ac919b0165e6b7f2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:39.834911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc853b1-f83c-40ae-ba34-50d4c02e5e1e service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:39.836677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1fc853b1-f83c-40ae-ba34-50d4c02e5e1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:39.837280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8efd3e9b2ee14e56ac919b0165e6b7f2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:39.847768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:39.886181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc853b1-f83c-40ae-ba34-50d4c02e5e1e service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:39.898086 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1c381-32b9-4325-bee3-b91a7399ed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:39.899908 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c381-32b9-4325-bee3-b91a7399ed96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:39.901032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c381-32b9-4325-bee3-b91a7399ed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:39.902140 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c381-32b9-4325-bee3-b91a7399ed96 admin admin] PATH_INFO: `/v3/projects/e1d56ce3f5eb4110b991d9b9fcfae300` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:39.904682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1c381-32b9-4325-bee3-b91a7399ed96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1d56ce3f5eb4110b991d9b9fcfae300)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:39.908040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1c381-32b9-4325-bee3-b91a7399ed96 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:40.031138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8efd3e9b2ee14e56ac919b0165e6b7f2', 'request_id': 'req-91e8dec2-5a94-4e62-b944-9eebaf73f09e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.038974 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e4b1c381-32b9-4325-bee3-b91a7399ed96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1d56ce3f5eb4110b991d9b9fcfae300', 'request_id': 'req-e4b1c381-32b9-4325-bee3-b91a7399ed96'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.053852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e4b1c381-32b9-4325-bee3-b91a7399ed96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1d56ce3f5eb4110b991d9b9fcfae300', 'request_id': 'req-e4b1c381-32b9-4325-bee3-b91a7399ed96'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.056298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8efd3e9b2ee14e56ac919b0165e6b7f2', 'request_id': 'req-91e8dec2-5a94-4e62-b944-9eebaf73f09e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.065416 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8efd3e9b2ee14e56ac919b0165e6b7f2', 'request_id': 'req-91e8dec2-5a94-4e62-b944-9eebaf73f09e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.087987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e4b1c381-32b9-4325-bee3-b91a7399ed96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1d56ce3f5eb4110b991d9b9fcfae300', 'request_id': 'req-e4b1c381-32b9-4325-bee3-b91a7399ed96'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.093104 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] The token cache is being invalidate because project 8efd3e9b2ee14e56ac919b0165e6b7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:40.097702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.100210 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.108882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 869/1727] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:39 2022] DELETE /identity/v3/projects/8efd3e9b2ee14e56ac919b0165e6b7f2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:40.110054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:40.116946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:40.119910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e4b1c381-32b9-4325-bee3-b91a7399ed96 admin admin] The token cache is being invalidate because project e1d56ce3f5eb4110b991d9b9fcfae300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:40.120408 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e4b1c381-32b9-4325-bee3-b91a7399ed96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.122048 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e4b1c381-32b9-4325-bee3-b91a7399ed96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.126995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 859/1728] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:39 2022] DELETE /identity/v3/projects/e1d56ce3f5eb4110b991d9b9fcfae300 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:40.131929 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0d6d0-010c-4e85-8043-0fa410d04d85 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:40.132460 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0d6d0-010c-4e85-8043-0fa410d04d85 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:40.132884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0d6d0-010c-4e85-8043-0fa410d04d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:40.175163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f6e0d6d0-010c-4e85-8043-0fa410d04d85 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:40.176912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f6e0d6d0-010c-4e85-8043-0fa410d04d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:40.314046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 860/1729] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:40.315725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf8b54-8f37-449c-987c-97e9287c072a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:40.316202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf8b54-8f37-449c-987c-97e9287c072a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:40.316641 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf8b54-8f37-449c-987c-97e9287c072a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:40.348497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8dec2-5a94-4e62-b944-9eebaf73f09e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:40.359888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:40.361052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:40.361479 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:40.361917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] PATH_INFO: `/v3/users/410d40a8a4984ab1ac6fc2a05125b6a9` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:40.364360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=410d40a8a4984ab1ac6fc2a05125b6a9)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:40.366467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:40.372914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-95bf8b54-8f37-449c-987c-97e9287c072a None None] MFA Rules not processed for user `1e4b30ac01a84009b41f6c83de99cfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:40.374160 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-95bf8b54-8f37-449c-987c-97e9287c072a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:40.516061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410d40a8a4984ab1ac6fc2a05125b6a9'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.535780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410d40a8a4984ab1ac6fc2a05125b6a9'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.536692 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410d40a8a4984ab1ac6fc2a05125b6a9'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.538751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410d40a8a4984ab1ac6fc2a05125b6a9'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.584222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 861/1730] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:40.585766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42c549-ede4-45ea-b517-be0de83ef08b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:40.591225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42c549-ede4-45ea-b517-be0de83ef08b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:40.591533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42c549-ede4-45ea-b517-be0de83ef08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:40.597077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410d40a8a4984ab1ac6fc2a05125b6a9'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:40.653295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 870/1731] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:40 2022] DELETE /identity/v3/users/410d40a8a4984ab1ac6fc2a05125b6a9 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:40.669910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-3d42c549-ede4-45ea-b517-be0de83ef08b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:40.671165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3d42c549-ede4-45ea-b517-be0de83ef08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:40.837607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:40.843776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 862/1732] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:40.862086 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f64ad6-14dc-449f-a67e-181ba7b35e91 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:40.873712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c5488-bc31-4d79-983f-5879fc980fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:40.874757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c5488-bc31-4d79-983f-5879fc980fee admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:40.876049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c5488-bc31-4d79-983f-5879fc980fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:40.877083 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c5488-bc31-4d79-983f-5879fc980fee admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:40.878692 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c5488-bc31-4d79-983f-5879fc980fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:40.880319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c5488-bc31-4d79-983f-5879fc980fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:40.882524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c5488-bc31-4d79-983f-5879fc980fee admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:40.903642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 871/1733] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:11:40.907784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42c549-ede4-45ea-b517-be0de83ef08b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:40.919422 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42c549-ede4-45ea-b517-be0de83ef08b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:40.927349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24256c93-f162-4ad5-8dc5-b8fcd2ac2173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:40.927836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24256c93-f162-4ad5-8dc5-b8fcd2ac2173 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:40.929143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24256c93-f162-4ad5-8dc5-b8fcd2ac2173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:40.929609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24256c93-f162-4ad5-8dc5-b8fcd2ac2173 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:40.932992 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24256c93-f162-4ad5-8dc5-b8fcd2ac2173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:40.935768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24256c93-f162-4ad5-8dc5-b8fcd2ac2173 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:41.007890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 863/1734] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:40 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:41.010563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c5488-bc31-4d79-983f-5879fc980fee admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:41.024464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c5488-bc31-4d79-983f-5879fc980fee admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:41.232424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e3388-76c7-4b1c-9a05-1d119656f9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:41.233093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e3388-76c7-4b1c-9a05-1d119656f9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:41.233383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e3388-76c7-4b1c-9a05-1d119656f9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:41.233656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e3388-76c7-4b1c-9a05-1d119656f9a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:41.248968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e3388-76c7-4b1c-9a05-1d119656f9a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:41.258655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e3388-76c7-4b1c-9a05-1d119656f9a7 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:41.306567 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 872/1735] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:41 2022] POST /identity/v3/users => generated 287 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:11:41.310644 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24256c93-f162-4ad5-8dc5-b8fcd2ac2173 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:41.333087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24256c93-f162-4ad5-8dc5-b8fcd2ac2173 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:41.348705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f3df4-4066-4a24-9a60-3090bf92b80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:41.349397 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3df4-4066-4a24-9a60-3090bf92b80c admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:41.349684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3df4-4066-4a24-9a60-3090bf92b80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:41.349962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3df4-4066-4a24-9a60-3090bf92b80c admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:41.350710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f3df4-4066-4a24-9a60-3090bf92b80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:41.352363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f3df4-4066-4a24-9a60-3090bf92b80c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:41.403021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 864/1736] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:41.403698 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e3388-76c7-4b1c-9a05-1d119656f9a7 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:41.424533 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e3388-76c7-4b1c-9a05-1d119656f9a7 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:41.432632 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a45d3-508e-4962-9c37-d455784f65e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:41.434779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a45d3-508e-4962-9c37-d455784f65e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:41.435163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a45d3-508e-4962-9c37-d455784f65e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:41.435530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a45d3-508e-4962-9c37-d455784f65e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:41.436584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a45d3-508e-4962-9c37-d455784f65e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:41.439165 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a45d3-508e-4962-9c37-d455784f65e5 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:41.456398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 873/1737] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:11:41.461175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f3df4-4066-4a24-9a60-3090bf92b80c admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:41.479955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f3df4-4066-4a24-9a60-3090bf92b80c admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:41.510539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e125a-f682-422e-a4fd-3958e0954739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:41.511934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e125a-f682-422e-a4fd-3958e0954739 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:41.511934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e125a-f682-422e-a4fd-3958e0954739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:41.512212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e125a-f682-422e-a4fd-3958e0954739 admin admin] PATH_INFO: `/v3/projects/d9792bfbaec74b52be6c8bab7a1eb536/users/2f63e415fcce47658cb7f85ac6d4a468/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:41.548152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e125a-f682-422e-a4fd-3958e0954739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9792bfbaec74b52be6c8bab7a1eb536, user_id=2f63e415fcce47658cb7f85ac6d4a468, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:41.552003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e125a-f682-422e-a4fd-3958e0954739 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:41.595279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 865/1738] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:41 2022] PUT /identity/v3/projects/d9792bfbaec74b52be6c8bab7a1eb536/users/2f63e415fcce47658cb7f85ac6d4a468/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:41.597089 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198362b8-0836-46e3-8c22-c51f6242df88 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:41.597473 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198362b8-0836-46e3-8c22-c51f6242df88 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:41.597664 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198362b8-0836-46e3-8c22-c51f6242df88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:41.653041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-198362b8-0836-46e3-8c22-c51f6242df88 None None] MFA Rules not processed for user `2f63e415fcce47658cb7f85ac6d4a468`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:41.655201 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-198362b8-0836-46e3-8c22-c51f6242df88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:41.715649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e125a-f682-422e-a4fd-3958e0954739 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:41.717610 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d60e125a-f682-422e-a4fd-3958e0954739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:41.789035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 874/1739] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:41.794401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198362b8-0836-46e3-8c22-c51f6242df88 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:41.853272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e125a-f682-422e-a4fd-3958e0954739 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:41.861847 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c74df-cede-429f-bf10-f2aefa103c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:41.862983 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c74df-cede-429f-bf10-f2aefa103c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:41.863509 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c74df-cede-429f-bf10-f2aefa103c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:41.865479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c74df-cede-429f-bf10-f2aefa103c15 admin admin] PATH_INFO: `/v3/projects/1697e2ae98ba497fac063a92519958c9` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:41.868160 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c74df-cede-429f-bf10-f2aefa103c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1697e2ae98ba497fac063a92519958c9)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:41.870368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c74df-cede-429f-bf10-f2aefa103c15 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:41.892340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198362b8-0836-46e3-8c22-c51f6242df88 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:41.898121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7737b6c-064b-436d-b07e-e730ef08bc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:41.898875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7737b6c-064b-436d-b07e-e730ef08bc77 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:41.899525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7737b6c-064b-436d-b07e-e730ef08bc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:41.899875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7737b6c-064b-436d-b07e-e730ef08bc77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:41.900687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7737b6c-064b-436d-b07e-e730ef08bc77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:41.903509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7737b6c-064b-436d-b07e-e730ef08bc77 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:41.947306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 875/1740] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:41 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:11:41.954068 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d2393-1a83-45ba-bdf6-50335328340f None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:41.954381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d2393-1a83-45ba-bdf6-50335328340f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:41.954649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d2393-1a83-45ba-bdf6-50335328340f None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:41.957034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 876/1741] 10.222.0.23 () {54 vars in 912 bytes} [Tue May 3 09:11:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:11:41.957861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d2393-1a83-45ba-bdf6-50335328340f None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:41.977158 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-562c74df-cede-429f-bf10-f2aefa103c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1697e2ae98ba497fac063a92519958c9', 'request_id': 'req-562c74df-cede-429f-bf10-f2aefa103c15'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:41.984752 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-562c74df-cede-429f-bf10-f2aefa103c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1697e2ae98ba497fac063a92519958c9', 'request_id': 'req-562c74df-cede-429f-bf10-f2aefa103c15'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:41.996418 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-562c74df-cede-429f-bf10-f2aefa103c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1697e2ae98ba497fac063a92519958c9', 'request_id': 'req-562c74df-cede-429f-bf10-f2aefa103c15'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.030695 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-562c74df-cede-429f-bf10-f2aefa103c15 admin admin] The token cache is being invalidate because project 1697e2ae98ba497fac063a92519958c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:42.031096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-562c74df-cede-429f-bf10-f2aefa103c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.031790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-562c74df-cede-429f-bf10-f2aefa103c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.033521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 866/1742] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:41 2022] DELETE /identity/v3/projects/1697e2ae98ba497fac063a92519958c9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:42.035071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde62aa-527c-4435-8c8c-35024e147a5e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:42.035554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde62aa-527c-4435-8c8c-35024e147a5e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:42.036019 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde62aa-527c-4435-8c8c-35024e147a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:42.088713 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-bcde62aa-527c-4435-8c8c-35024e147a5e None None] MFA Rules not processed for user `418178b7e70f47d291e239a1297ccf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:42.091634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-bcde62aa-527c-4435-8c8c-35024e147a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:42.151971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d2393-1a83-45ba-bdf6-50335328340f None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:42.165693 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c95f3-fa6d-4a85-8016-28b212058adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:42.167696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c95f3-fa6d-4a85-8016-28b212058adf admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:42.168203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c95f3-fa6d-4a85-8016-28b212058adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:42.168630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c95f3-fa6d-4a85-8016-28b212058adf admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:42.169577 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c95f3-fa6d-4a85-8016-28b212058adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:42.171706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c95f3-fa6d-4a85-8016-28b212058adf admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:42.218276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 867/1743] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:11:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:42.219751 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab02bdb-671a-4b01-9820-0550ac8f8105 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:42.220047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab02bdb-671a-4b01-9820-0550ac8f8105 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:42.220352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab02bdb-671a-4b01-9820-0550ac8f8105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:42.221650 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 877/1744] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:41 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:42.225472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c95f3-fa6d-4a85-8016-28b212058adf admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:42.232732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c48c95f3-fa6d-4a85-8016-28b212058adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:42.255535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c95f3-fa6d-4a85-8016-28b212058adf admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:42.261073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-1ab02bdb-671a-4b01-9820-0550ac8f8105 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:42.264852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1ab02bdb-671a-4b01-9820-0550ac8f8105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:42.268147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:42.269030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:42.269311 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:42.269585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] PATH_INFO: `/v3/projects/28030370a6a647e2a72922e3ad175712` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:42.271070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28030370a6a647e2a72922e3ad175712)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:42.273818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:42.286934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 868/1745] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:42.287868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab02bdb-671a-4b01-9820-0550ac8f8105 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:42.289198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1ab02bdb-671a-4b01-9820-0550ac8f8105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:42.302165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab02bdb-671a-4b01-9820-0550ac8f8105 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:42.308135 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:42.310537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:42.311056 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:42.311756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] PATH_INFO: `/v3/projects/dfe914f1820d457a9c998d240af616ef` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:42.322258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe914f1820d457a9c998d240af616ef)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:42.322258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:42.366265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28030370a6a647e2a72922e3ad175712', 'request_id': 'req-31d6b9c2-1a2d-421b-91e2-592381763ee0'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.379534 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28030370a6a647e2a72922e3ad175712', 'request_id': 'req-31d6b9c2-1a2d-421b-91e2-592381763ee0'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.387343 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe914f1820d457a9c998d240af616ef', 'request_id': 'req-62717f38-bfe5-47da-983b-1ff14c5bbad3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.387512 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28030370a6a647e2a72922e3ad175712', 'request_id': 'req-31d6b9c2-1a2d-421b-91e2-592381763ee0'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.393481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe914f1820d457a9c998d240af616ef', 'request_id': 'req-62717f38-bfe5-47da-983b-1ff14c5bbad3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.402088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe914f1820d457a9c998d240af616ef', 'request_id': 'req-62717f38-bfe5-47da-983b-1ff14c5bbad3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.405246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] The token cache is being invalidate because project 28030370a6a647e2a72922e3ad175712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:42.406037 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.406889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.412934 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 878/1746] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:42 2022] DELETE /identity/v3/projects/28030370a6a647e2a72922e3ad175712 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:42.414443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:42.415631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:42.420311 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] The token cache is being invalidate because project dfe914f1820d457a9c998d240af616ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:42.420647 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.421673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:42.429713 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 869/1747] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:42 2022] DELETE /identity/v3/projects/dfe914f1820d457a9c998d240af616ef => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:42.430628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:42.432380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:42.535047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62717f38-bfe5-47da-983b-1ff14c5bbad3 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:42.539657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdbaee-c5ae-487b-85e5-08f732b50532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:42.540552 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdbaee-c5ae-487b-85e5-08f732b50532 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:42.540840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdbaee-c5ae-487b-85e5-08f732b50532 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:42.541155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdbaee-c5ae-487b-85e5-08f732b50532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:42.543721 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a8cdbaee-c5ae-487b-85e5-08f732b50532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:42.556433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdbaee-c5ae-487b-85e5-08f732b50532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:42.558011 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdbaee-c5ae-487b-85e5-08f732b50532 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:42.558232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6b9c2-1a2d-421b-91e2-592381763ee0 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:42.572128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 870/1748] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:42.573991 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57da7-1085-4e77-8975-25b5d301f500 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:42.574667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57da7-1085-4e77-8975-25b5d301f500 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:42.574951 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57da7-1085-4e77-8975-25b5d301f500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:42.638205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-9ec57da7-1085-4e77-8975-25b5d301f500 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:42.639584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9ec57da7-1085-4e77-8975-25b5d301f500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:42.722904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10526c-86b7-4a6a-8319-52c89a13b221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:42.723739 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10526c-86b7-4a6a-8319-52c89a13b221 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:42.724017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10526c-86b7-4a6a-8319-52c89a13b221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:42.724305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10526c-86b7-4a6a-8319-52c89a13b221 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:42.725238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10526c-86b7-4a6a-8319-52c89a13b221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:42.726852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10526c-86b7-4a6a-8319-52c89a13b221 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:42.753370 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 879/1749] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:42.759621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f18aae-5ede-405c-ae64-5275146dbc8c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:42.759906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f18aae-5ede-405c-ae64-5275146dbc8c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:42.760208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f18aae-5ede-405c-ae64-5275146dbc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:42.779449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 871/1750] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:42.784227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1437f8e-7569-42a8-a92b-b887e3d04f7a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:42.784533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1437f8e-7569-42a8-a92b-b887e3d04f7a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:42.784811 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1437f8e-7569-42a8-a92b-b887e3d04f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:42.805197 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b4f18aae-5ede-405c-ae64-5275146dbc8c None None] MFA Rules not processed for user `adc15a08f9f94c71bc1e0a092e1b7818`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:42.806437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b4f18aae-5ede-405c-ae64-5275146dbc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:42.825970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f1437f8e-7569-42a8-a92b-b887e3d04f7a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:42.827177 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f1437f8e-7569-42a8-a92b-b887e3d04f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:42.847060 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 872/1751] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:42.847917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1437f8e-7569-42a8-a92b-b887e3d04f7a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:42.851678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f1437f8e-7569-42a8-a92b-b887e3d04f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:42.885759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1437f8e-7569-42a8-a92b-b887e3d04f7a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:42.896609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318e85a-cfb3-458b-80eb-18080cae83cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:42.898319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318e85a-cfb3-458b-80eb-18080cae83cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:42.898795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318e85a-cfb3-458b-80eb-18080cae83cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:42.899259 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318e85a-cfb3-458b-80eb-18080cae83cf admin admin] PATH_INFO: `/v3/users/64feb1d9dc7548079660f4afb70a9bb9` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:42.900874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318e85a-cfb3-458b-80eb-18080cae83cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=64feb1d9dc7548079660f4afb70a9bb9)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:42.904252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318e85a-cfb3-458b-80eb-18080cae83cf admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:42.910543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 880/1752] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:42.911583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f18aae-5ede-405c-ae64-5275146dbc8c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:42.913711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b4f18aae-5ede-405c-ae64-5275146dbc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:42.936165 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f18aae-5ede-405c-ae64-5275146dbc8c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:42.941910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15e133-ddd3-4d58-a924-6d906416b3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:42.943162 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15e133-ddd3-4d58-a924-6d906416b3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:42.943700 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15e133-ddd3-4d58-a924-6d906416b3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:42.944210 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15e133-ddd3-4d58-a924-6d906416b3f7 admin admin] PATH_INFO: `/v3/projects/6f39b40165e74c61a6fcc539f26136f5/users/b1df8f11fb674313ab7f27cc50444180/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:42.965453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15e133-ddd3-4d58-a924-6d906416b3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f39b40165e74c61a6fcc539f26136f5, user_id=b1df8f11fb674313ab7f27cc50444180, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:42.968810 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15e133-ddd3-4d58-a924-6d906416b3f7 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:42.996413 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 881/1753] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:42 2022] PUT /identity/v3/projects/6f39b40165e74c61a6fcc539f26136f5/users/b1df8f11fb674313ab7f27cc50444180/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:42.997769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15e133-ddd3-4d58-a924-6d906416b3f7 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:43.082377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3318e85a-cfb3-458b-80eb-18080cae83cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64feb1d9dc7548079660f4afb70a9bb9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:43.119066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3318e85a-cfb3-458b-80eb-18080cae83cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64feb1d9dc7548079660f4afb70a9bb9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:43.130873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3318e85a-cfb3-458b-80eb-18080cae83cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64feb1d9dc7548079660f4afb70a9bb9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:43.132019 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3318e85a-cfb3-458b-80eb-18080cae83cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64feb1d9dc7548079660f4afb70a9bb9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:43.132870 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3318e85a-cfb3-458b-80eb-18080cae83cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64feb1d9dc7548079660f4afb70a9bb9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:43.164190 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15e133-ddd3-4d58-a924-6d906416b3f7 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:43.179214 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908db232-e2aa-4a61-ae68-4280349a9fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:43.179917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908db232-e2aa-4a61-ae68-4280349a9fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:43.180224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908db232-e2aa-4a61-ae68-4280349a9fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:43.180498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908db232-e2aa-4a61-ae68-4280349a9fa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:43.181375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908db232-e2aa-4a61-ae68-4280349a9fa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:43.181718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908db232-e2aa-4a61-ae68-4280349a9fa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:43.183270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908db232-e2aa-4a61-ae68-4280349a9fa7 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:43.213496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 873/1754] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:42 2022] DELETE /identity/v3/users/64feb1d9dc7548079660f4afb70a9bb9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:43.215342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97c720-3b21-4d74-a134-b94634d04f80 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:43.215637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97c720-3b21-4d74-a134-b94634d04f80 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:43.215911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97c720-3b21-4d74-a134-b94634d04f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:43.231330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 882/1755] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:43.231330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908db232-e2aa-4a61-ae68-4280349a9fa7 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:43.233255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-908db232-e2aa-4a61-ae68-4280349a9fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:43.237760 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8e97c720-3b21-4d74-a134-b94634d04f80 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:43.239917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8e97c720-3b21-4d74-a134-b94634d04f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:43.262037 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908db232-e2aa-4a61-ae68-4280349a9fa7 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:43.405496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd597c0-f43c-42b3-85d4-53f7952ca985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:43.406106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd597c0-f43c-42b3-85d4-53f7952ca985 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:43.406546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd597c0-f43c-42b3-85d4-53f7952ca985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:43.406836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd597c0-f43c-42b3-85d4-53f7952ca985 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:43.407558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd597c0-f43c-42b3-85d4-53f7952ca985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:43.409442 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd597c0-f43c-42b3-85d4-53f7952ca985 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:43.447525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 883/1756] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:43.452375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18980981-89c3-4131-b58e-2e8865f8521e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:43.452665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18980981-89c3-4131-b58e-2e8865f8521e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:43.452944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18980981-89c3-4131-b58e-2e8865f8521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:43.463366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 874/1757] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:43.463366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97c720-3b21-4d74-a134-b94634d04f80 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:43.474431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8e97c720-3b21-4d74-a134-b94634d04f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:43.501096 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-18980981-89c3-4131-b58e-2e8865f8521e None None] MFA Rules not processed for user `418178b7e70f47d291e239a1297ccf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:43.502368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-18980981-89c3-4131-b58e-2e8865f8521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:43.518078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97c720-3b21-4d74-a134-b94634d04f80 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:43.549094 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae61eb-b970-48c0-9e2a-9e9d8084f546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:43.549770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae61eb-b970-48c0-9e2a-9e9d8084f546 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:43.554343 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae61eb-b970-48c0-9e2a-9e9d8084f546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:43.554695 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae61eb-b970-48c0-9e2a-9e9d8084f546 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:43.555434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae61eb-b970-48c0-9e2a-9e9d8084f546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:43.569810 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae61eb-b970-48c0-9e2a-9e9d8084f546 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:43.675494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 884/1758] 10.222.0.36 () {58 vars in 1015 bytes} [Tue May 3 09:11:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:43.677861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18980981-89c3-4131-b58e-2e8865f8521e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:43.678182 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 875/1759] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:43 2022] POST /identity/v3/projects => generated 405 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:43.679288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae61eb-b970-48c0-9e2a-9e9d8084f546 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:43.712723 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18980981-89c3-4131-b58e-2e8865f8521e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:43.845270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae61eb-b970-48c0-9e2a-9e9d8084f546 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:43.874053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96533411-6a87-4d57-bbe2-c3a3d07e9e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:43.877139 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533411-6a87-4d57-bbe2-c3a3d07e9e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:43.877663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533411-6a87-4d57-bbe2-c3a3d07e9e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:43.879241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533411-6a87-4d57-bbe2-c3a3d07e9e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:43.880600 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96533411-6a87-4d57-bbe2-c3a3d07e9e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:43.882561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96533411-6a87-4d57-bbe2-c3a3d07e9e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:43.884264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436b924-6e10-4c70-88d5-e91300b8abb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:43.886401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436b924-6e10-4c70-88d5-e91300b8abb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:43.888675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96533411-6a87-4d57-bbe2-c3a3d07e9e66 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:43.889638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436b924-6e10-4c70-88d5-e91300b8abb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:43.894945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436b924-6e10-4c70-88d5-e91300b8abb7 admin admin] PATH_INFO: `/v3/projects/6f39b40165e74c61a6fcc539f26136f5/users/b1df8f11fb674313ab7f27cc50444180/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:43.896145 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436b924-6e10-4c70-88d5-e91300b8abb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f39b40165e74c61a6fcc539f26136f5, user_id=b1df8f11fb674313ab7f27cc50444180, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:43.901601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436b924-6e10-4c70-88d5-e91300b8abb7 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:43.936521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 885/1760] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:43 2022] PUT /identity/v3/projects/6f39b40165e74c61a6fcc539f26136f5/users/b1df8f11fb674313ab7f27cc50444180/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:43.957774 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436b924-6e10-4c70-88d5-e91300b8abb7 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:43.964329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 876/1761] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:43.970892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e14fc-9fc2-47c2-9601-b2b5fa22af5b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:43.973884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e14fc-9fc2-47c2-9601-b2b5fa22af5b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:43.974593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e14fc-9fc2-47c2-9601-b2b5fa22af5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:44.053083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-de8e14fc-9fc2-47c2-9601-b2b5fa22af5b None None] MFA Rules not processed for user `b1df8f11fb674313ab7f27cc50444180`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:44.054808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-de8e14fc-9fc2-47c2-9601-b2b5fa22af5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:44.116717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436b924-6e10-4c70-88d5-e91300b8abb7 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:44.145664 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e43f0-d763-470e-8cfe-971da4f33181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:44.146359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e43f0-d763-470e-8cfe-971da4f33181 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:44.146635 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e43f0-d763-470e-8cfe-971da4f33181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:44.149756 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e43f0-d763-470e-8cfe-971da4f33181 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:44.156617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e43f0-d763-470e-8cfe-971da4f33181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:44.156617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e43f0-d763-470e-8cfe-971da4f33181 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:44.210837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 877/1762] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:44.211912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e14fc-9fc2-47c2-9601-b2b5fa22af5b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:44.236527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e14fc-9fc2-47c2-9601-b2b5fa22af5b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:44.248888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3fe05-592f-4fcb-a539-ae6c6e258e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:44.251934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3fe05-592f-4fcb-a539-ae6c6e258e9f admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:44.253508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3fe05-592f-4fcb-a539-ae6c6e258e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:44.253800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3fe05-592f-4fcb-a539-ae6c6e258e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:44.254546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3fe05-592f-4fcb-a539-ae6c6e258e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:44.272034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3fe05-592f-4fcb-a539-ae6c6e258e9f admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:44.280124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 886/1763] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:43 2022] POST /identity/v3/users => generated 303 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:44.280998 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e43f0-d763-470e-8cfe-971da4f33181 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:44.298426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-052e43f0-d763-470e-8cfe-971da4f33181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:44.344797 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 878/1764] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:44 2022] POST /identity/v3/projects => generated 409 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:44.345854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3fe05-592f-4fcb-a539-ae6c6e258e9f admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:44.349661 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-41d3fe05-592f-4fcb-a539-ae6c6e258e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:44.466856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e43f0-d763-470e-8cfe-971da4f33181 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:44.502022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3fe05-592f-4fcb-a539-ae6c6e258e9f admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:44.515337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:44.516798 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:44.516919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:44.517347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] PATH_INFO: `/v3/projects/eeb06fb3546349d596ce96d1ccfef6c5` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:44.519725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb06fb3546349d596ce96d1ccfef6c5)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:44.523723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:44.685026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb06fb3546349d596ce96d1ccfef6c5', 'request_id': 'req-155b271c-7bc0-44e6-bc4e-f399461c5d06'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:44.705961 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb06fb3546349d596ce96d1ccfef6c5', 'request_id': 'req-155b271c-7bc0-44e6-bc4e-f399461c5d06'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:44.721812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab3572-43a4-4054-b105-3cfdb3f8183a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:44.731194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab3572-43a4-4054-b105-3cfdb3f8183a service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:44.736209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab3572-43a4-4054-b105-3cfdb3f8183a service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:44.736209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab3572-43a4-4054-b105-3cfdb3f8183a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:44.736959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb06fb3546349d596ce96d1ccfef6c5', 'request_id': 'req-155b271c-7bc0-44e6-bc4e-f399461c5d06'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:44.753806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] The token cache is being invalidate because project eeb06fb3546349d596ce96d1ccfef6c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:44.754171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:44.754857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:44.757597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 879/1765] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:44 2022] DELETE /identity/v3/projects/eeb06fb3546349d596ce96d1ccfef6c5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:44.768116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:44.768116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:44.779739 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab3572-43a4-4054-b105-3cfdb3f8183a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:44.790231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab3572-43a4-4054-b105-3cfdb3f8183a service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:44.837098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 887/1766] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:44.841482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab3572-43a4-4054-b105-3cfdb3f8183a service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:44.910004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab3572-43a4-4054-b105-3cfdb3f8183a service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:44.914213 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b271c-7bc0-44e6-bc4e-f399461c5d06 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:44.922975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119682f-c9f3-4a32-a2fb-212a721235d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:44.923549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119682f-c9f3-4a32-a2fb-212a721235d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:44.923877 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119682f-c9f3-4a32-a2fb-212a721235d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:44.924190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119682f-c9f3-4a32-a2fb-212a721235d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:44.943535 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3119682f-c9f3-4a32-a2fb-212a721235d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:45.229165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119682f-c9f3-4a32-a2fb-212a721235d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:45.229692 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3666f7-7ccc-403a-8285-cf70183926b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:45.230423 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3666f7-7ccc-403a-8285-cf70183926b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:45.230704 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3666f7-7ccc-403a-8285-cf70183926b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:45.230848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119682f-c9f3-4a32-a2fb-212a721235d6 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:45.230971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3666f7-7ccc-403a-8285-cf70183926b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:45.237145 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3666f7-7ccc-403a-8285-cf70183926b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:45.242569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3666f7-7ccc-403a-8285-cf70183926b6 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:45.285442 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 880/1767] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:45.289733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119682f-c9f3-4a32-a2fb-212a721235d6 service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:45.294179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3119682f-c9f3-4a32-a2fb-212a721235d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:45.299656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 888/1768] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:45.301211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd17093-befb-4977-bd00-ec218dcf9387 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:45.303882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd17093-befb-4977-bd00-ec218dcf9387 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:45.304201 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd17093-befb-4977-bd00-ec218dcf9387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:45.346432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119682f-c9f3-4a32-a2fb-212a721235d6 service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:45.378420 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd733f-21f7-4dcc-986b-b2fa69e0b9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:45.379592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd733f-21f7-4dcc-986b-b2fa69e0b9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:45.379874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd733f-21f7-4dcc-986b-b2fa69e0b9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:45.380276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd733f-21f7-4dcc-986b-b2fa69e0b9c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:45.380865 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd733f-21f7-4dcc-986b-b2fa69e0b9c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:45.382794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd733f-21f7-4dcc-986b-b2fa69e0b9c2 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:45.406980 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-3fd17093-befb-4977-bd00-ec218dcf9387 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:45.408236 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3fd17093-befb-4977-bd00-ec218dcf9387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:45.434957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 881/1769] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:45 2022] POST /identity/v3/users => generated 305 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:45.436574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd733f-21f7-4dcc-986b-b2fa69e0b9c2 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:45.443425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5cfd733f-21f7-4dcc-986b-b2fa69e0b9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:45.457621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 889/1770] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:45.458416 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd17093-befb-4977-bd00-ec218dcf9387 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:45.459919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd733f-21f7-4dcc-986b-b2fa69e0b9c2 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:45.468812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66772b-9f03-42c7-8f89-b2f42e047d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:45.470316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66772b-9f03-42c7-8f89-b2f42e047d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:45.471433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66772b-9f03-42c7-8f89-b2f42e047d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:45.472124 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66772b-9f03-42c7-8f89-b2f42e047d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:45.473180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66772b-9f03-42c7-8f89-b2f42e047d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:45.476722 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd17093-befb-4977-bd00-ec218dcf9387 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:45.486450 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66772b-9f03-42c7-8f89-b2f42e047d9e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:45.500196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1da78e-3a27-4549-8bae-4eb6bb939bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:45.501211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1da78e-3a27-4549-8bae-4eb6bb939bad admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:45.501672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1da78e-3a27-4549-8bae-4eb6bb939bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:45.502124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1da78e-3a27-4549-8bae-4eb6bb939bad admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:45.503146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1da78e-3a27-4549-8bae-4eb6bb939bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:45.506353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1da78e-3a27-4549-8bae-4eb6bb939bad admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:45.537360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 882/1771] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:45.538673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66772b-9f03-42c7-8f89-b2f42e047d9e admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:45.554224 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66772b-9f03-42c7-8f89-b2f42e047d9e admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:45.558333 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016e313-ac72-497d-8908-591c702f6edb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:45.562453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016e313-ac72-497d-8908-591c702f6edb service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:45.562453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016e313-ac72-497d-8908-591c702f6edb service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:45.562453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016e313-ac72-497d-8908-591c702f6edb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:45.563241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 890/1772] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:45.563654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a016e313-ac72-497d-8908-591c702f6edb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:45.567584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd178926-f048-4d54-9693-61088b901f5b None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:45.569997 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd178926-f048-4d54-9693-61088b901f5b None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:45.569997 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd178926-f048-4d54-9693-61088b901f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:45.616033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-bd178926-f048-4d54-9693-61088b901f5b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:45.619550 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-bd178926-f048-4d54-9693-61088b901f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:45.646151 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 891/1773] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:45.649067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd178926-f048-4d54-9693-61088b901f5b None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:45.676522 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd178926-f048-4d54-9693-61088b901f5b None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:45.686641 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86942d6e-e6ab-48cb-b226-77f9a6f2fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:45.688775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86942d6e-e6ab-48cb-b226-77f9a6f2fa53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:45.688939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86942d6e-e6ab-48cb-b226-77f9a6f2fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:45.689199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86942d6e-e6ab-48cb-b226-77f9a6f2fa53 admin admin] PATH_INFO: `/v3/projects/7b3205bb11c94d05a89f1427a9735c31/users/8534939be6b94a26b5f6f5a7b138b16a/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:45.717045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016e313-ac72-497d-8908-591c702f6edb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:45.723182 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016e313-ac72-497d-8908-591c702f6edb service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:45.733419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86942d6e-e6ab-48cb-b226-77f9a6f2fa53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3205bb11c94d05a89f1427a9735c31, user_id=8534939be6b94a26b5f6f5a7b138b16a, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:45.736076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86942d6e-e6ab-48cb-b226-77f9a6f2fa53 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:45.747638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 883/1774] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:45.750917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016e313-ac72-497d-8908-591c702f6edb service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:45.778307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 892/1775] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:45 2022] PUT /identity/v3/projects/7b3205bb11c94d05a89f1427a9735c31/users/8534939be6b94a26b5f6f5a7b138b16a/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:45.779326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86942d6e-e6ab-48cb-b226-77f9a6f2fa53 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:45.792347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016e313-ac72-497d-8908-591c702f6edb service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:46.010368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86942d6e-e6ab-48cb-b226-77f9a6f2fa53 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:46.032601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91193f8-b04c-4233-8b6c-9ca1de935bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:46.033334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91193f8-b04c-4233-8b6c-9ca1de935bea admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:46.033624 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91193f8-b04c-4233-8b6c-9ca1de935bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:46.034136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91193f8-b04c-4233-8b6c-9ca1de935bea admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:46.034890 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91193f8-b04c-4233-8b6c-9ca1de935bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:46.035250 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91193f8-b04c-4233-8b6c-9ca1de935bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:46.043325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91193f8-b04c-4233-8b6c-9ca1de935bea admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:46.061380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45bbcf-d871-4b7e-be88-ac481a43fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:46.061963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45bbcf-d871-4b7e-be88-ac481a43fccb admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:46.063688 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45bbcf-d871-4b7e-be88-ac481a43fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:46.066121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45bbcf-d871-4b7e-be88-ac481a43fccb admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:46.067312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45bbcf-d871-4b7e-be88-ac481a43fccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:46.074313 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45bbcf-d871-4b7e-be88-ac481a43fccb admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:46.084609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 893/1776] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:46.088913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4ce8-41d4-4072-9447-211239112959 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:46.089398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4ce8-41d4-4072-9447-211239112959 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:46.089908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4ce8-41d4-4072-9447-211239112959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:46.104376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 884/1777] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:46.106206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45bbcf-d871-4b7e-be88-ac481a43fccb admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:46.119101 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45bbcf-d871-4b7e-be88-ac481a43fccb admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:46.138973 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472619a-485c-4d8f-97eb-ad1cf5d34df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:46.139675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472619a-485c-4d8f-97eb-ad1cf5d34df2 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:46.139962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472619a-485c-4d8f-97eb-ad1cf5d34df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:46.143315 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472619a-485c-4d8f-97eb-ad1cf5d34df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:46.145000 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472619a-485c-4d8f-97eb-ad1cf5d34df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:46.149895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472619a-485c-4d8f-97eb-ad1cf5d34df2 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:46.166010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-976c4ce8-41d4-4072-9447-211239112959 None None] MFA Rules not processed for user `8534939be6b94a26b5f6f5a7b138b16a`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:46.169016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-976c4ce8-41d4-4072-9447-211239112959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:46.266242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 885/1778] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:46 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:46.268664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472619a-485c-4d8f-97eb-ad1cf5d34df2 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:46.451257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 894/1779] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:46.453258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c4ce8-41d4-4072-9447-211239112959 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:46.503270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c4ce8-41d4-4072-9447-211239112959 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:46.548434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472619a-485c-4d8f-97eb-ad1cf5d34df2 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:46.579159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21633e07-0182-4cca-ba0f-57889109d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:46.580080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21633e07-0182-4cca-ba0f-57889109d015 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:46.582335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21633e07-0182-4cca-ba0f-57889109d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:46.583466 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21633e07-0182-4cca-ba0f-57889109d015 admin admin] PATH_INFO: `/v3/projects/9ab231d3531843ed82d47ffb4671874a/users/203b1cc9b7be474497f8b134b212e5bb/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:46.641627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21633e07-0182-4cca-ba0f-57889109d015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab231d3531843ed82d47ffb4671874a, user_id=203b1cc9b7be474497f8b134b212e5bb, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:46.644339 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21633e07-0182-4cca-ba0f-57889109d015 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:46.688126 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 886/1780] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:46 2022] PUT /identity/v3/projects/9ab231d3531843ed82d47ffb4671874a/users/203b1cc9b7be474497f8b134b212e5bb/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:46.688126 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21633e07-0182-4cca-ba0f-57889109d015 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:46.710413 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d7411-003d-4762-88e3-01e30fa0de84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:46.711096 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d7411-003d-4762-88e3-01e30fa0de84 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:46.711385 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d7411-003d-4762-88e3-01e30fa0de84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:46.711661 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d7411-003d-4762-88e3-01e30fa0de84 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:46.712381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d7411-003d-4762-88e3-01e30fa0de84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:46.714314 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d7411-003d-4762-88e3-01e30fa0de84 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:46.772803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 895/1781] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:46 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:46.775979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a820a7-3113-4405-949b-6bde3b574baa None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:46.776525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a820a7-3113-4405-949b-6bde3b574baa None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:46.776851 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a820a7-3113-4405-949b-6bde3b574baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:46.870248 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21633e07-0182-4cca-ba0f-57889109d015 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:46.881077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78733d5a-097b-47bd-a0b5-1cf87eeca979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:46.881867 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78733d5a-097b-47bd-a0b5-1cf87eeca979 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:46.882186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78733d5a-097b-47bd-a0b5-1cf87eeca979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:46.882433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78733d5a-097b-47bd-a0b5-1cf87eeca979 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:46.883267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78733d5a-097b-47bd-a0b5-1cf87eeca979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:46.885823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78733d5a-097b-47bd-a0b5-1cf87eeca979 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:46.931387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 887/1782] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:46 2022] POST /identity/v3/projects => generated 405 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:46.938292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-18a820a7-3113-4405-949b-6bde3b574baa None None] MFA Rules not processed for user `203b1cc9b7be474497f8b134b212e5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:46.940124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-18a820a7-3113-4405-949b-6bde3b574baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:46.942184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78733d5a-097b-47bd-a0b5-1cf87eeca979 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:47.040942 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78733d5a-097b-47bd-a0b5-1cf87eeca979 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:47.056516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de2251-8c3d-40bd-ace2-e08fd0eb42ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:47.057425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de2251-8c3d-40bd-ace2-e08fd0eb42ac admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:47.057796 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de2251-8c3d-40bd-ace2-e08fd0eb42ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:47.058282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de2251-8c3d-40bd-ace2-e08fd0eb42ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:47.061269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de2251-8c3d-40bd-ace2-e08fd0eb42ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:47.066055 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de2251-8c3d-40bd-ace2-e08fd0eb42ac admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:47.105401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 888/1783] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:47.108392 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de2251-8c3d-40bd-ace2-e08fd0eb42ac admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:47.144113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 896/1784] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:47.146010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a820a7-3113-4405-949b-6bde3b574baa None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:47.147164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de2251-8c3d-40bd-ace2-e08fd0eb42ac admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:47.175523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b43673-5b86-498b-8e57-e8064ed79e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:47.176295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b43673-5b86-498b-8e57-e8064ed79e5d admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:47.176579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b43673-5b86-498b-8e57-e8064ed79e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:47.176936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b43673-5b86-498b-8e57-e8064ed79e5d admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:47.177596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b43673-5b86-498b-8e57-e8064ed79e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:47.178715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a820a7-3113-4405-949b-6bde3b574baa None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:47.179550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b43673-5b86-498b-8e57-e8064ed79e5d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:47.196486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a702431-c142-42ac-8714-6da16e3bdbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:47.197622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a702431-c142-42ac-8714-6da16e3bdbce admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:47.197913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a702431-c142-42ac-8714-6da16e3bdbce admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:47.198232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a702431-c142-42ac-8714-6da16e3bdbce admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:47.201402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a702431-c142-42ac-8714-6da16e3bdbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:47.203634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a702431-c142-42ac-8714-6da16e3bdbce admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:47.242151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 889/1785] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:47 2022] POST /identity/v3/users => generated 309 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:47.242151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b43673-5b86-498b-8e57-e8064ed79e5d admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:47.263787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 897/1786] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:47.264841 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a702431-c142-42ac-8714-6da16e3bdbce admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:47.265095 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b43673-5b86-498b-8e57-e8064ed79e5d admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:47.273145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438e0f6-ca49-44e0-86ff-2704ad81a93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:47.274496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438e0f6-ca49-44e0-86ff-2704ad81a93c admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:47.274764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438e0f6-ca49-44e0-86ff-2704ad81a93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:47.275277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438e0f6-ca49-44e0-86ff-2704ad81a93c admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:47.276362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438e0f6-ca49-44e0-86ff-2704ad81a93c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:47.279380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438e0f6-ca49-44e0-86ff-2704ad81a93c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:47.306523 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a702431-c142-42ac-8714-6da16e3bdbce admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:47.323368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e880632-71ba-4201-9144-d3ee9d42cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:47.351137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e880632-71ba-4201-9144-d3ee9d42cabe admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:47.351478 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e880632-71ba-4201-9144-d3ee9d42cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:47.351834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e880632-71ba-4201-9144-d3ee9d42cabe admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:47.357575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e880632-71ba-4201-9144-d3ee9d42cabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:47.359490 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e880632-71ba-4201-9144-d3ee9d42cabe admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:47.365227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 890/1787] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:47 2022] POST /identity/v3/projects => generated 407 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:47.365942 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438e0f6-ca49-44e0-86ff-2704ad81a93c admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:47.402701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 898/1788] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:47.404910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e880632-71ba-4201-9144-d3ee9d42cabe admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:47.429344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e880632-71ba-4201-9144-d3ee9d42cabe admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:47.535303 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438e0f6-ca49-44e0-86ff-2704ad81a93c admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:47.544198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abebc7-62c0-4321-a919-83d0b3d33da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:47.567255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abebc7-62c0-4321-a919-83d0b3d33da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:47.568129 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abebc7-62c0-4321-a919-83d0b3d33da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:47.570096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abebc7-62c0-4321-a919-83d0b3d33da9 admin admin] PATH_INFO: `/v3/projects/124879ba6f4f4b80b0136a5df50e368c/users/c1ca6fe67513446bbbf8bd9443c3ad56/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:47.620594 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abebc7-62c0-4321-a919-83d0b3d33da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124879ba6f4f4b80b0136a5df50e368c, user_id=c1ca6fe67513446bbbf8bd9443c3ad56, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:47.629159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abebc7-62c0-4321-a919-83d0b3d33da9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:47.679531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 891/1789] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:47 2022] PUT /identity/v3/projects/124879ba6f4f4b80b0136a5df50e368c/users/c1ca6fe67513446bbbf8bd9443c3ad56/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:47.681508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abebc7-62c0-4321-a919-83d0b3d33da9 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:47.700908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec253ec-08ea-4579-ad39-e9412b9a9c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:47.702375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec253ec-08ea-4579-ad39-e9412b9a9c97 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:47.702667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec253ec-08ea-4579-ad39-e9412b9a9c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:47.703764 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec253ec-08ea-4579-ad39-e9412b9a9c97 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:47.705992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec253ec-08ea-4579-ad39-e9412b9a9c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:47.720961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec253ec-08ea-4579-ad39-e9412b9a9c97 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:47.791386 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 899/1790] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:47 2022] POST /identity/v3/users => generated 310 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:47.798339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb0d6f-68d2-43eb-b77e-9b5b47844cf9 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:47.805347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb0d6f-68d2-43eb-b77e-9b5b47844cf9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:47.807034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb0d6f-68d2-43eb-b77e-9b5b47844cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:47.877633 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abebc7-62c0-4321-a919-83d0b3d33da9 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:47.888465 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079c4a9-77f5-4646-8a91-f3c46148004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:47.889655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079c4a9-77f5-4646-8a91-f3c46148004e admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:47.890064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079c4a9-77f5-4646-8a91-f3c46148004e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:47.890406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079c4a9-77f5-4646-8a91-f3c46148004e admin admin] PATH_INFO: `/v3/projects/96fc859ed1694d5093d8a80fef452570/users/ce5b6c8973fa4f5fb589dcdbb683ad1c/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:47.892715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-a5cb0d6f-68d2-43eb-b77e-9b5b47844cf9 None None] MFA Rules not processed for user `c1ca6fe67513446bbbf8bd9443c3ad56`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:47.894051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a5cb0d6f-68d2-43eb-b77e-9b5b47844cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:47.916713 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079c4a9-77f5-4646-8a91-f3c46148004e admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fc859ed1694d5093d8a80fef452570, user_id=ce5b6c8973fa4f5fb589dcdbb683ad1c, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:47.920641 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079c4a9-77f5-4646-8a91-f3c46148004e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:47.954336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 892/1791] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:47 2022] PUT /identity/v3/projects/96fc859ed1694d5093d8a80fef452570/users/ce5b6c8973fa4f5fb589dcdbb683ad1c/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:47.954336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079c4a9-77f5-4646-8a91-f3c46148004e admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:48.220599 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 900/1792] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:48.226890 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb0d6f-68d2-43eb-b77e-9b5b47844cf9 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:48.256444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb0d6f-68d2-43eb-b77e-9b5b47844cf9 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:48.267159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079c4a9-77f5-4646-8a91-f3c46148004e admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:48.277150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bab8f6-c318-40bb-a13d-67fe567c8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:48.278731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bab8f6-c318-40bb-a13d-67fe567c8e07 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:48.279214 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bab8f6-c318-40bb-a13d-67fe567c8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:48.279699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bab8f6-c318-40bb-a13d-67fe567c8e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:48.279815 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fc6aa-dde4-4368-a60e-37d8c71e163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:48.280861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bab8f6-c318-40bb-a13d-67fe567c8e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:48.283232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fc6aa-dde4-4368-a60e-37d8c71e163f admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:48.283532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fc6aa-dde4-4368-a60e-37d8c71e163f admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:48.283828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fc6aa-dde4-4368-a60e-37d8c71e163f admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:48.285949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fc6aa-dde4-4368-a60e-37d8c71e163f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:48.288417 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bab8f6-c318-40bb-a13d-67fe567c8e07 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:48.289544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fc6aa-dde4-4368-a60e-37d8c71e163f admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:48.332480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 901/1793] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:48.333926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bab8f6-c318-40bb-a13d-67fe567c8e07 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:48.338258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 893/1794] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:48.339252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fc6aa-dde4-4368-a60e-37d8c71e163f admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:48.363634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bab8f6-c318-40bb-a13d-67fe567c8e07 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:48.379123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fc6aa-dde4-4368-a60e-37d8c71e163f admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:48.383367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc173a68-20d8-4c12-853b-1f0c4f2e4c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:48.384046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc173a68-20d8-4c12-853b-1f0c4f2e4c1e admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:48.384440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc173a68-20d8-4c12-853b-1f0c4f2e4c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:48.384735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc173a68-20d8-4c12-853b-1f0c4f2e4c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:48.385431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc173a68-20d8-4c12-853b-1f0c4f2e4c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:48.386046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8fad1-fd17-4b64-8693-e240c1f5a244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:48.388284 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8fad1-fd17-4b64-8693-e240c1f5a244 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:48.388568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8fad1-fd17-4b64-8693-e240c1f5a244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:48.388846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8fad1-fd17-4b64-8693-e240c1f5a244 admin admin] PATH_INFO: `/v3/projects/96fc859ed1694d5093d8a80fef452570/users/ce5b6c8973fa4f5fb589dcdbb683ad1c/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:48.393847 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8fad1-fd17-4b64-8693-e240c1f5a244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fc859ed1694d5093d8a80fef452570, user_id=ce5b6c8973fa4f5fb589dcdbb683ad1c, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:48.396461 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc173a68-20d8-4c12-853b-1f0c4f2e4c1e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:48.397374 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8fad1-fd17-4b64-8693-e240c1f5a244 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:48.416229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 894/1795] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:48 2022] PUT /identity/v3/projects/96fc859ed1694d5093d8a80fef452570/users/ce5b6c8973fa4f5fb589dcdbb683ad1c/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:48.416229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8fad1-fd17-4b64-8693-e240c1f5a244 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:48.462385 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 902/1796] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:48 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:48.463238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc173a68-20d8-4c12-853b-1f0c4f2e4c1e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:48.468491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-dc173a68-20d8-4c12-853b-1f0c4f2e4c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:48.646693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8fad1-fd17-4b64-8693-e240c1f5a244 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:48.656211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba703ca-68a6-4ad0-bc94-e35f8ecf514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:48.660369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba703ca-68a6-4ad0-bc94-e35f8ecf514b admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:48.660779 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba703ca-68a6-4ad0-bc94-e35f8ecf514b admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:48.661473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba703ca-68a6-4ad0-bc94-e35f8ecf514b admin admin] PATH_INFO: `/v3/projects/6305859c33924ed083fecb0ac92ec30f/users/5c8e559f4d7f4712b14567eaa5e5e813/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:48.662148 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc173a68-20d8-4c12-853b-1f0c4f2e4c1e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:48.668524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:48.669892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:48.670464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:48.670953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] PATH_INFO: `/v3/users/335e2dbbe6b44a90837ef49b33b4bf20` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:48.672539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=335e2dbbe6b44a90837ef49b33b4bf20)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:48.674858 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:48.711847 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba703ca-68a6-4ad0-bc94-e35f8ecf514b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6305859c33924ed083fecb0ac92ec30f, user_id=5c8e559f4d7f4712b14567eaa5e5e813, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:48.715137 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba703ca-68a6-4ad0-bc94-e35f8ecf514b admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:48.743827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 895/1797] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:48 2022] PUT /identity/v3/projects/6305859c33924ed083fecb0ac92ec30f/users/5c8e559f4d7f4712b14567eaa5e5e813/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:48.747370 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8726a5-f756-4820-9b60-7887c098498d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:48.747727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8726a5-f756-4820-9b60-7887c098498d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:48.748164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8726a5-f756-4820-9b60-7887c098498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:48.765643 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335e2dbbe6b44a90837ef49b33b4bf20'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:48.800185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-1f8726a5-f756-4820-9b60-7887c098498d None None] MFA Rules not processed for user `ce5b6c8973fa4f5fb589dcdbb683ad1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:48.802988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335e2dbbe6b44a90837ef49b33b4bf20'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:48.805030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1f8726a5-f756-4820-9b60-7887c098498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:48.805378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335e2dbbe6b44a90837ef49b33b4bf20'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:48.807724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335e2dbbe6b44a90837ef49b33b4bf20'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:48.846061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335e2dbbe6b44a90837ef49b33b4bf20'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:48.883302 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 903/1798] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:48 2022] DELETE /identity/v3/users/335e2dbbe6b44a90837ef49b33b4bf20 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:48.883302 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:48.886233 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:48.951402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 896/1799] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:48.954081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0199494-2db6-4d58-8654-6dfc25459718 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:48.954947 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0199494-2db6-4d58-8654-6dfc25459718 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:48.955378 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0199494-2db6-4d58-8654-6dfc25459718 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:48.957338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 897/1800] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 09:11:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:11:48.958317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0199494-2db6-4d58-8654-6dfc25459718 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:48.960180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d0199494-2db6-4d58-8654-6dfc25459718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:49.022621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada09452-614e-4dbc-8f66-7a555bf09788 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:49.034834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53975b9a-35d8-4803-9e77-3eec6a17b352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:49.038572 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53975b9a-35d8-4803-9e77-3eec6a17b352 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:49.039333 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53975b9a-35d8-4803-9e77-3eec6a17b352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:49.040409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53975b9a-35d8-4803-9e77-3eec6a17b352 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:49.041883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53975b9a-35d8-4803-9e77-3eec6a17b352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:49.046005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53975b9a-35d8-4803-9e77-3eec6a17b352 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:49.092405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0199494-2db6-4d58-8654-6dfc25459718 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:49.104252 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 904/1801] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:48 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:49.106933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c108dc5-e686-4e6e-b919-cebed6c64e99 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:49.107172 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d80c0-ea2c-4f8a-be0c-f0bc930b57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:49.108281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d80c0-ea2c-4f8a-be0c-f0bc930b57e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:49.108750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c108dc5-e686-4e6e-b919-cebed6c64e99 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:49.109300 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d80c0-ea2c-4f8a-be0c-f0bc930b57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:49.109581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d80c0-ea2c-4f8a-be0c-f0bc930b57e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:49.110539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c108dc5-e686-4e6e-b919-cebed6c64e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:49.112335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d80c0-ea2c-4f8a-be0c-f0bc930b57e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:49.115049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d80c0-ea2c-4f8a-be0c-f0bc930b57e7 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:49.152643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 898/1802] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:49.155891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d80c0-ea2c-4f8a-be0c-f0bc930b57e7 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:49.161149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6a7d80c0-ea2c-4f8a-be0c-f0bc930b57e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:49.165734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-1c108dc5-e686-4e6e-b919-cebed6c64e99 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:49.171214 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-1c108dc5-e686-4e6e-b919-cebed6c64e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:49.208778 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 905/1803] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:49.209944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c108dc5-e686-4e6e-b919-cebed6c64e99 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:49.250034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c108dc5-e686-4e6e-b919-cebed6c64e99 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:49.276882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ba67e-3897-4cb8-9332-3c6d8de4daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:49.277809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ba67e-3897-4cb8-9332-3c6d8de4daa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:49.278065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ba67e-3897-4cb8-9332-3c6d8de4daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:49.278391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ba67e-3897-4cb8-9332-3c6d8de4daa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:49.279177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ba67e-3897-4cb8-9332-3c6d8de4daa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:49.280828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ba67e-3897-4cb8-9332-3c6d8de4daa6 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:49.316324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 906/1804] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:49.317283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ba67e-3897-4cb8-9332-3c6d8de4daa6 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:49.342746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ba67e-3897-4cb8-9332-3c6d8de4daa6 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:49.349882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d80c0-ea2c-4f8a-be0c-f0bc930b57e7 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:49.354057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a580dcc-04c0-41a9-aabd-42e6f1180dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:49.355125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a580dcc-04c0-41a9-aabd-42e6f1180dee admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:49.355535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a580dcc-04c0-41a9-aabd-42e6f1180dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:49.355815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a580dcc-04c0-41a9-aabd-42e6f1180dee admin admin] PATH_INFO: `/v3/projects/6305859c33924ed083fecb0ac92ec30f/users/5c8e559f4d7f4712b14567eaa5e5e813/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:49.362815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a580dcc-04c0-41a9-aabd-42e6f1180dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6305859c33924ed083fecb0ac92ec30f, user_id=5c8e559f4d7f4712b14567eaa5e5e813, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:49.365943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a580dcc-04c0-41a9-aabd-42e6f1180dee admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:49.369667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688836be-8670-4f3d-89ec-a57685246459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:49.370483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688836be-8670-4f3d-89ec-a57685246459 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:49.371469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688836be-8670-4f3d-89ec-a57685246459 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:49.371686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688836be-8670-4f3d-89ec-a57685246459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:49.400206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 907/1805] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:49 2022] PUT /identity/v3/projects/6305859c33924ed083fecb0ac92ec30f/users/5c8e559f4d7f4712b14567eaa5e5e813/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:49.401914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15905a67-eaa4-4f78-b601-b0b0457941fb None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:49.402213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15905a67-eaa4-4f78-b601-b0b0457941fb None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:49.402559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15905a67-eaa4-4f78-b601-b0b0457941fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:49.505579 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-15905a67-eaa4-4f78-b601-b0b0457941fb None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:49.507000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-15905a67-eaa4-4f78-b601-b0b0457941fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:49.523132 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688836be-8670-4f3d-89ec-a57685246459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:49.526076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688836be-8670-4f3d-89ec-a57685246459 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:49.571246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 899/1806] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:49 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:49.592285 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688836be-8670-4f3d-89ec-a57685246459 service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:49.592285 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-688836be-8670-4f3d-89ec-a57685246459 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:49.699574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688836be-8670-4f3d-89ec-a57685246459 service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:49.810098 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900f38c-e8b2-4164-abf3-7d62c36e754f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:49.814023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900f38c-e8b2-4164-abf3-7d62c36e754f service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:49.814426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900f38c-e8b2-4164-abf3-7d62c36e754f service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:49.814958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900f38c-e8b2-4164-abf3-7d62c36e754f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:49.868783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 908/1807] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:49.869913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15905a67-eaa4-4f78-b601-b0b0457941fb None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:50.023057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900f38c-e8b2-4164-abf3-7d62c36e754f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:50.025040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900f38c-e8b2-4164-abf3-7d62c36e754f service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:50.041452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 900/1808] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:50.043433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b073a6c-c0d4-4521-8c3a-33cca6d73fdc None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:50.044380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b073a6c-c0d4-4521-8c3a-33cca6d73fdc None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:50.044808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b073a6c-c0d4-4521-8c3a-33cca6d73fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:50.087899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-3b073a6c-c0d4-4521-8c3a-33cca6d73fdc None None] MFA Rules not processed for user `5c8e559f4d7f4712b14567eaa5e5e813`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:50.089283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3b073a6c-c0d4-4521-8c3a-33cca6d73fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:50.118697 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15905a67-eaa4-4f78-b601-b0b0457941fb None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:50.131885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de99a1-cdfe-4391-9065-49f39a64b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:50.135162 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de99a1-cdfe-4391-9065-49f39a64b154 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:50.135274 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de99a1-cdfe-4391-9065-49f39a64b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:50.135536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de99a1-cdfe-4391-9065-49f39a64b154 admin admin] PATH_INFO: `/v3/projects/5671e01b3e494b7c84a253aacae775d4/users/9fbcdfd26f4646a698555b02dee5a466/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:50.198966 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de99a1-cdfe-4391-9065-49f39a64b154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5671e01b3e494b7c84a253aacae775d4, user_id=9fbcdfd26f4646a698555b02dee5a466, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:50.202022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de99a1-cdfe-4391-9065-49f39a64b154 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:50.239164 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 909/1809] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:49 2022] PUT /identity/v3/projects/5671e01b3e494b7c84a253aacae775d4/users/9fbcdfd26f4646a698555b02dee5a466/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:50.240372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de99a1-cdfe-4391-9065-49f39a64b154 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:50.245990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f8de99a1-cdfe-4391-9065-49f39a64b154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:50.286272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 901/1810] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:50.286272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b073a6c-c0d4-4521-8c3a-33cca6d73fdc None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:50.309951 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b073a6c-c0d4-4521-8c3a-33cca6d73fdc None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:50.433568 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de99a1-cdfe-4391-9065-49f39a64b154 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:50.438067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca292c92-de8c-4b97-ba8a-27ee1e9189be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:50.438807 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca292c92-de8c-4b97-ba8a-27ee1e9189be admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:50.439223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca292c92-de8c-4b97-ba8a-27ee1e9189be admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:50.439590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca292c92-de8c-4b97-ba8a-27ee1e9189be admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:50.440453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca292c92-de8c-4b97-ba8a-27ee1e9189be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:50.447813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca292c92-de8c-4b97-ba8a-27ee1e9189be admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:50.451933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:50.453481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:50.454242 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:50.454862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] PATH_INFO: `/v3/users/8534939be6b94a26b5f6f5a7b138b16a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:50.456467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8534939be6b94a26b5f6f5a7b138b16a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:50.461167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:50.490739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 902/1811] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:50.501815 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca292c92-de8c-4b97-ba8a-27ee1e9189be admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:50.517132 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ca292c92-de8c-4b97-ba8a-27ee1e9189be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:50.617050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8534939be6b94a26b5f6f5a7b138b16a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:50.639302 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8534939be6b94a26b5f6f5a7b138b16a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:50.640450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8534939be6b94a26b5f6f5a7b138b16a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:50.646970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8534939be6b94a26b5f6f5a7b138b16a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:50.680525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8534939be6b94a26b5f6f5a7b138b16a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:50.687859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca292c92-de8c-4b97-ba8a-27ee1e9189be admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:50.693039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e65309-e09f-46d1-9a92-d6287ba17977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:50.693706 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65309-e09f-46d1-9a92-d6287ba17977 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:50.695133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65309-e09f-46d1-9a92-d6287ba17977 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:50.697170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65309-e09f-46d1-9a92-d6287ba17977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:50.700452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-84e65309-e09f-46d1-9a92-d6287ba17977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:50.703612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 910/1812] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:50 2022] DELETE /identity/v3/users/8534939be6b94a26b5f6f5a7b138b16a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:50.703612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:50.703612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:50.840130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb2d98-b2f4-4ee7-976a-060e9d5ea267 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:50.846532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e65309-e09f-46d1-9a92-d6287ba17977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:50.849752 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e65309-e09f-46d1-9a92-d6287ba17977 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:50.851577 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e33a45-f764-4971-ae40-956e17080fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:50.852783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33a45-f764-4971-ae40-956e17080fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:50.853235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33a45-f764-4971-ae40-956e17080fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:50.853749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33a45-f764-4971-ae40-956e17080fd0 admin admin] PATH_INFO: `/v3/projects/5671e01b3e494b7c84a253aacae775d4/users/9fbcdfd26f4646a698555b02dee5a466/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:50.860440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e33a45-f764-4971-ae40-956e17080fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5671e01b3e494b7c84a253aacae775d4, user_id=9fbcdfd26f4646a698555b02dee5a466, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:50.861575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 903/1813] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:50 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:50.862627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e65309-e09f-46d1-9a92-d6287ba17977 service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:50.864168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-84e65309-e09f-46d1-9a92-d6287ba17977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:50.878617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e33a45-f764-4971-ae40-956e17080fd0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:50.916136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 911/1814] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:50 2022] PUT /identity/v3/projects/5671e01b3e494b7c84a253aacae775d4/users/9fbcdfd26f4646a698555b02dee5a466/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:50.916136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b56b24-75a2-4efe-bba2-1a13228f1de7 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:50.916136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b56b24-75a2-4efe-bba2-1a13228f1de7 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:50.916136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b56b24-75a2-4efe-bba2-1a13228f1de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:50.967058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e2b56b24-75a2-4efe-bba2-1a13228f1de7 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:50.968710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e2b56b24-75a2-4efe-bba2-1a13228f1de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:51.018281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e65309-e09f-46d1-9a92-d6287ba17977 service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:51.094660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d9ff0-35ab-47f0-9cdd-2fa5a44c9bb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:51.095930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d9ff0-35ab-47f0-9cdd-2fa5a44c9bb0 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:51.096359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d9ff0-35ab-47f0-9cdd-2fa5a44c9bb0 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:51.096717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d9ff0-35ab-47f0-9cdd-2fa5a44c9bb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:51.099413 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2f0d9ff0-35ab-47f0-9cdd-2fa5a44c9bb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:51.118271 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d9ff0-35ab-47f0-9cdd-2fa5a44c9bb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:51.122247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d9ff0-35ab-47f0-9cdd-2fa5a44c9bb0 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:51.136955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 904/1815] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:51.138484 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d59ab5-83fc-472f-a089-c4b95a43fa0b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:51.138812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d59ab5-83fc-472f-a089-c4b95a43fa0b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:51.139224 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d59ab5-83fc-472f-a089-c4b95a43fa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:51.140135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 912/1816] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:51.172484 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-86d59ab5-83fc-472f-a089-c4b95a43fa0b None None] MFA Rules not processed for user `9fbcdfd26f4646a698555b02dee5a466`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:51.175311 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-86d59ab5-83fc-472f-a089-c4b95a43fa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:51.217256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b56b24-75a2-4efe-bba2-1a13228f1de7 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:51.219338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e2b56b24-75a2-4efe-bba2-1a13228f1de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:51.264634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 905/1817] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:51.276418 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d59ab5-83fc-472f-a089-c4b95a43fa0b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:51.279072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-86d59ab5-83fc-472f-a089-c4b95a43fa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:51.377594 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d59ab5-83fc-472f-a089-c4b95a43fa0b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:51.381615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e70f-3b01-4385-8af6-0d11541865c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:51.382512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e70f-3b01-4385-8af6-0d11541865c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:51.383150 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e70f-3b01-4385-8af6-0d11541865c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:51.383535 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e70f-3b01-4385-8af6-0d11541865c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:51.386293 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b56b24-75a2-4efe-bba2-1a13228f1de7 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:51.396155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5d492-5bbb-450b-ad48-5ca04cc66673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:51.396759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5d492-5bbb-450b-ad48-5ca04cc66673 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:51.397050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5d492-5bbb-450b-ad48-5ca04cc66673 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:51.397329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5d492-5bbb-450b-ad48-5ca04cc66673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:51.410226 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8e70f-3b01-4385-8af6-0d11541865c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:51.411813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8e70f-3b01-4385-8af6-0d11541865c1 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:51.422100 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5d492-5bbb-450b-ad48-5ca04cc66673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:51.426227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5d492-5bbb-450b-ad48-5ca04cc66673 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:51.440973 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 906/1818] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:11:51.441907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e70f-3b01-4385-8af6-0d11541865c1 service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:51.443300 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-71f8e70f-3b01-4385-8af6-0d11541865c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:51.455953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e70f-3b01-4385-8af6-0d11541865c1 service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:51.462317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f534a4-89e5-4547-baf0-f1606e05e8e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:51.462967 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f534a4-89e5-4547-baf0-f1606e05e8e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:51.463244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f534a4-89e5-4547-baf0-f1606e05e8e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:51.463511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f534a4-89e5-4547-baf0-f1606e05e8e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:51.466337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-50f534a4-89e5-4547-baf0-f1606e05e8e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:51.467203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 913/1819] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:51.572874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f534a4-89e5-4547-baf0-f1606e05e8e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:51.575244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f534a4-89e5-4547-baf0-f1606e05e8e9 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:51.594390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5d492-5bbb-450b-ad48-5ca04cc66673 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:51.596957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 907/1820] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:51 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:51.607733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5d492-5bbb-450b-ad48-5ca04cc66673 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:51.616829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:51.617502 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:51.617835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:51.618117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] PATH_INFO: `/v3/users/c1ca6fe67513446bbbf8bd9443c3ad56` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:51.631021 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ca6fe67513446bbbf8bd9443c3ad56)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:51.633030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:51.732598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ca6fe67513446bbbf8bd9443c3ad56'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:51.747699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ca6fe67513446bbbf8bd9443c3ad56'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:51.748614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ca6fe67513446bbbf8bd9443c3ad56'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:51.749882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ca6fe67513446bbbf8bd9443c3ad56'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:51.767744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ca6fe67513446bbbf8bd9443c3ad56'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:51.790553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 914/1821] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:51 2022] DELETE /identity/v3/users/c1ca6fe67513446bbbf8bd9443c3ad56 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:51.796724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909cab7-6027-49eb-926e-4d0943ed5ca1 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:51.797655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909cab7-6027-49eb-926e-4d0943ed5ca1 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:51.798076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909cab7-6027-49eb-926e-4d0943ed5ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:51.825149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-3909cab7-6027-49eb-926e-4d0943ed5ca1 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:51.829139 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3909cab7-6027-49eb-926e-4d0943ed5ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:51.987395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 908/1822] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:52.001640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:52.003733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:52.111330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb73b4-0e47-48df-b5f6-9f31726f7f59 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:52.111775 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb73b4-0e47-48df-b5f6-9f31726f7f59 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:52.112294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb73b4-0e47-48df-b5f6-9f31726f7f59 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:52.113976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 909/1823] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 09:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:11:52.130475 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60347626-3376-4191-bfe0-12103e2b59c8 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:52.130911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60347626-3376-4191-bfe0-12103e2b59c8 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:52.131306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60347626-3376-4191-bfe0-12103e2b59c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:52.156148 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa4e77-5aad-427e-ae16-4e1c7399534f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:52.162535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c745a-de1d-4891-969e-d47dbdf84d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:52.164273 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c745a-de1d-4891-969e-d47dbdf84d39 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:52.165008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c745a-de1d-4891-969e-d47dbdf84d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:52.165451 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c745a-de1d-4891-969e-d47dbdf84d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:52.171618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-60347626-3376-4191-bfe0-12103e2b59c8 None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:52.173047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-60347626-3376-4191-bfe0-12103e2b59c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:52.189178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c745a-de1d-4891-969e-d47dbdf84d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:52.190956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c745a-de1d-4891-969e-d47dbdf84d39 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:52.203505 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 915/1824] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:52.205384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c745a-de1d-4891-969e-d47dbdf84d39 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:52.215410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3f1c745a-de1d-4891-969e-d47dbdf84d39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:52.247994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c745a-de1d-4891-969e-d47dbdf84d39 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:52.253578 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:52.254967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:52.255464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:52.255928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] PATH_INFO: `/v3/projects/5a15dc06e95c4d93a9e372ae251c5128` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:52.258107 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a15dc06e95c4d93a9e372ae251c5128)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:52.260812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:52.312162 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 910/1825] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 09:11:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:52.337216 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a15dc06e95c4d93a9e372ae251c5128', 'request_id': 'req-f60ecb9f-e237-4f44-bd18-25098be360ce'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:52.353176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60347626-3376-4191-bfe0-12103e2b59c8 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:52.355273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-60347626-3376-4191-bfe0-12103e2b59c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:52.357599 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a15dc06e95c4d93a9e372ae251c5128', 'request_id': 'req-f60ecb9f-e237-4f44-bd18-25098be360ce'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:52.367708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a15dc06e95c4d93a9e372ae251c5128', 'request_id': 'req-f60ecb9f-e237-4f44-bd18-25098be360ce'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:52.383012 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60347626-3376-4191-bfe0-12103e2b59c8 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:52.402138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] The token cache is being invalidate because project 5a15dc06e95c4d93a9e372ae251c5128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:52.402425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:52.404001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:52.408623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 916/1826] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:52 2022] DELETE /identity/v3/projects/5a15dc06e95c4d93a9e372ae251c5128 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:52.412419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:52.416649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:52.515339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ecb9f-e237-4f44-bd18-25098be360ce admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:52.521868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:52.522846 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:52.523325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:52.523744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] PATH_INFO: `/v3/users/ebddfcd337074c81820ec60a866731d3` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:52.525152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebddfcd337074c81820ec60a866731d3)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:52.527457 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:52.537744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2cbc-7cfb-4012-b9bd-8d3d0a57773a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:52.538580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2cbc-7cfb-4012-b9bd-8d3d0a57773a service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:52.539055 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2cbc-7cfb-4012-b9bd-8d3d0a57773a service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:52.540388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2cbc-7cfb-4012-b9bd-8d3d0a57773a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:52.546448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-902a2cbc-7cfb-4012-b9bd-8d3d0a57773a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:52.565641 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a2cbc-7cfb-4012-b9bd-8d3d0a57773a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:52.568392 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a2cbc-7cfb-4012-b9bd-8d3d0a57773a service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:52.581296 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 911/1827] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:52.632766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebddfcd337074c81820ec60a866731d3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:52.650781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebddfcd337074c81820ec60a866731d3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:52.651724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebddfcd337074c81820ec60a866731d3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:52.652784 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebddfcd337074c81820ec60a866731d3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:52.669411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebddfcd337074c81820ec60a866731d3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:52.692125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 917/1828] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:52 2022] DELETE /identity/v3/users/ebddfcd337074c81820ec60a866731d3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:52.913098 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2cbc-7cfb-4012-b9bd-8d3d0a57773a service nova] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:52.914775 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-902a2cbc-7cfb-4012-b9bd-8d3d0a57773a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:52.962047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2cbc-7cfb-4012-b9bd-8d3d0a57773a service nova] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:52.979551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:52.982528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:53.080554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c1b5e-bb3f-49a3-8924-18bb47afbcde admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:53.091852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:53.093352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:53.093800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:53.094217 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] PATH_INFO: `/v3/projects/124879ba6f4f4b80b0136a5df50e368c` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:53.095556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=124879ba6f4f4b80b0136a5df50e368c)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:53.096153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:53.097598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:53.098043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:53.098557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] PATH_INFO: `/v3/projects/7b3205bb11c94d05a89f1427a9735c31` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:53.099048 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:53.100606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3205bb11c94d05a89f1427a9735c31)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:53.103780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:53.175765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3205bb11c94d05a89f1427a9735c31', 'request_id': 'req-1c5f68ca-f4c5-4ff1-97af-6948daca2424'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.186560 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124879ba6f4f4b80b0136a5df50e368c', 'request_id': 'req-817bc5a3-7bb6-4959-a847-a2f06c807f54'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.190253 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3205bb11c94d05a89f1427a9735c31', 'request_id': 'req-1c5f68ca-f4c5-4ff1-97af-6948daca2424'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.195133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124879ba6f4f4b80b0136a5df50e368c', 'request_id': 'req-817bc5a3-7bb6-4959-a847-a2f06c807f54'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.198188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3205bb11c94d05a89f1427a9735c31', 'request_id': 'req-1c5f68ca-f4c5-4ff1-97af-6948daca2424'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.213088 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] The token cache is being invalidate because project 7b3205bb11c94d05a89f1427a9735c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:53.213842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.215561 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.216215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124879ba6f4f4b80b0136a5df50e368c', 'request_id': 'req-817bc5a3-7bb6-4959-a847-a2f06c807f54'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.220871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 918/1829] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:52 2022] DELETE /identity/v3/projects/7b3205bb11c94d05a89f1427a9735c31 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:53.221918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:53.223399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:53.244360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] The token cache is being invalidate because project 124879ba6f4f4b80b0136a5df50e368c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:53.244845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.245698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.248287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 912/1830] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:52 2022] DELETE /identity/v3/projects/124879ba6f4f4b80b0136a5df50e368c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:53.249334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:53.250777 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:53.306694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f68ca-f4c5-4ff1-97af-6948daca2424 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:53.315432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:53.316363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:53.327580 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:53.327580 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] PATH_INFO: `/v3/projects/01dd3e397ebb41f5bd9b8098056230e0` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:53.327580 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01dd3e397ebb41f5bd9b8098056230e0)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:53.328587 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:53.350040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bc5a3-7bb6-4959-a847-a2f06c807f54 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:53.354639 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e44b3a-2b13-4030-bc22-3832d9657920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:53.355725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44b3a-2b13-4030-bc22-3832d9657920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:53.356021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44b3a-2b13-4030-bc22-3832d9657920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:53.356321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44b3a-2b13-4030-bc22-3832d9657920 admin admin] PATH_INFO: `/v3/users/ce5b6c8973fa4f5fb589dcdbb683ad1c` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:53.357654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e44b3a-2b13-4030-bc22-3832d9657920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5b6c8973fa4f5fb589dcdbb683ad1c)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:53.359703 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e44b3a-2b13-4030-bc22-3832d9657920 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:53.374804 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01dd3e397ebb41f5bd9b8098056230e0', 'request_id': 'req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.383454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01dd3e397ebb41f5bd9b8098056230e0', 'request_id': 'req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.390444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01dd3e397ebb41f5bd9b8098056230e0', 'request_id': 'req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.403354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] The token cache is being invalidate because project 01dd3e397ebb41f5bd9b8098056230e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:53.403640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.404380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.405990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 919/1831] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:53 2022] DELETE /identity/v3/projects/01dd3e397ebb41f5bd9b8098056230e0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:53.406800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:53.408144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:53.477977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcf8c9-c3e2-4dc8-a2e5-dd5aedb4d0b0 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:53.482801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c5b91-e463-4e0c-8dbb-1ae0e5069642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:53.483705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c5b91-e463-4e0c-8dbb-1ae0e5069642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:53.483986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c5b91-e463-4e0c-8dbb-1ae0e5069642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:53.484294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c5b91-e463-4e0c-8dbb-1ae0e5069642 admin admin] PATH_INFO: `/v3/users/9fbcdfd26f4646a698555b02dee5a466` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:53.485559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c5b91-e463-4e0c-8dbb-1ae0e5069642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fbcdfd26f4646a698555b02dee5a466)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:53.487500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c5b91-e463-4e0c-8dbb-1ae0e5069642 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:53.537668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-5c6c5b91-e463-4e0c-8dbb-1ae0e5069642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fbcdfd26f4646a698555b02dee5a466'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.544286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-5c6c5b91-e463-4e0c-8dbb-1ae0e5069642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fbcdfd26f4646a698555b02dee5a466'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.544959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-5c6c5b91-e463-4e0c-8dbb-1ae0e5069642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fbcdfd26f4646a698555b02dee5a466'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.545570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-5c6c5b91-e463-4e0c-8dbb-1ae0e5069642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fbcdfd26f4646a698555b02dee5a466'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.549377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-36e44b3a-2b13-4030-bc22-3832d9657920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5b6c8973fa4f5fb589dcdbb683ad1c'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.556811 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-36e44b3a-2b13-4030-bc22-3832d9657920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5b6c8973fa4f5fb589dcdbb683ad1c'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.556952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-5c6c5b91-e463-4e0c-8dbb-1ae0e5069642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fbcdfd26f4646a698555b02dee5a466'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.564186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-36e44b3a-2b13-4030-bc22-3832d9657920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5b6c8973fa4f5fb589dcdbb683ad1c'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.564858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-36e44b3a-2b13-4030-bc22-3832d9657920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5b6c8973fa4f5fb589dcdbb683ad1c'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.565598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-36e44b3a-2b13-4030-bc22-3832d9657920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5b6c8973fa4f5fb589dcdbb683ad1c'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:53.570852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 920/1832] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:53 2022] DELETE /identity/v3/users/9fbcdfd26f4646a698555b02dee5a466 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:53.572335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc13193-26a2-4c9d-b40b-d905174ef708 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:53.572741 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc13193-26a2-4c9d-b40b-d905174ef708 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:53.573042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc13193-26a2-4c9d-b40b-d905174ef708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:53.585006 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 913/1833] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:11:53 2022] DELETE /identity/v3/users/ce5b6c8973fa4f5fb589dcdbb683ad1c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:53.596031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-2fc13193-26a2-4c9d-b40b-d905174ef708 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:53.597266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-2fc13193-26a2-4c9d-b40b-d905174ef708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:53.679920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 921/1834] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:53.681844 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf0e49-a83e-4856-a62c-310587908440 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:53.682131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf0e49-a83e-4856-a62c-310587908440 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:53.682399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf0e49-a83e-4856-a62c-310587908440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:53.703041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-1ebf0e49-a83e-4856-a62c-310587908440 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:53.704965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1ebf0e49-a83e-4856-a62c-310587908440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:53.714953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 914/1835] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:53.719884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc13193-26a2-4c9d-b40b-d905174ef708 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:53.732370 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc13193-26a2-4c9d-b40b-d905174ef708 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:53.737811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c917194-5db9-4145-bf15-ab915738125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:53.738473 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c917194-5db9-4145-bf15-ab915738125b admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:53.738753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c917194-5db9-4145-bf15-ab915738125b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:53.739057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c917194-5db9-4145-bf15-ab915738125b admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:53.740124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c917194-5db9-4145-bf15-ab915738125b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:53.740432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c917194-5db9-4145-bf15-ab915738125b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:53.742020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c917194-5db9-4145-bf15-ab915738125b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:53.758208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 922/1836] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:53.762554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf0e49-a83e-4856-a62c-310587908440 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:53.779066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf0e49-a83e-4856-a62c-310587908440 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:53.789820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb5c9-c840-4984-a06b-5153d0f3ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:53.790661 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb5c9-c840-4984-a06b-5153d0f3ce4c admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:53.791666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb5c9-c840-4984-a06b-5153d0f3ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:53.792134 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb5c9-c840-4984-a06b-5153d0f3ce4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:53.793563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcb5c9-c840-4984-a06b-5153d0f3ce4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:53.796396 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcb5c9-c840-4984-a06b-5153d0f3ce4c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:53.825280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 915/1837] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:53 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:53.829411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c917194-5db9-4145-bf15-ab915738125b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:53.839986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c917194-5db9-4145-bf15-ab915738125b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:53.898779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146eb3e-2eff-4955-8673-59e7f97b22da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:53.899451 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146eb3e-2eff-4955-8673-59e7f97b22da admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:53.899732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146eb3e-2eff-4955-8673-59e7f97b22da admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:53.900006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146eb3e-2eff-4955-8673-59e7f97b22da admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:53.900766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146eb3e-2eff-4955-8673-59e7f97b22da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:53.903245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146eb3e-2eff-4955-8673-59e7f97b22da admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:53.923813 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 923/1838] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:53 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:53.927931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb5c9-c840-4984-a06b-5153d0f3ce4c admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:53.938222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb5c9-c840-4984-a06b-5153d0f3ce4c admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:53.942891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97b84f-b397-4bbc-a7f9-58aeb1aca069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:53.943541 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97b84f-b397-4bbc-a7f9-58aeb1aca069 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:53.943822 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97b84f-b397-4bbc-a7f9-58aeb1aca069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:53.944106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97b84f-b397-4bbc-a7f9-58aeb1aca069 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:53.944893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97b84f-b397-4bbc-a7f9-58aeb1aca069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:53.946472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97b84f-b397-4bbc-a7f9-58aeb1aca069 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:53.956744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 916/1839] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:53.960624 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146eb3e-2eff-4955-8673-59e7f97b22da admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:53.971487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146eb3e-2eff-4955-8673-59e7f97b22da admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:53.977603 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f60eb-08cd-47e7-b5ed-0ba85083a6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:53.978494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f60eb-08cd-47e7-b5ed-0ba85083a6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:53.978778 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f60eb-08cd-47e7-b5ed-0ba85083a6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:53.979085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f60eb-08cd-47e7-b5ed-0ba85083a6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:53.980768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f60eb-08cd-47e7-b5ed-0ba85083a6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:53.982480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f60eb-08cd-47e7-b5ed-0ba85083a6f9 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:53.996627 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 924/1840] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:54.000690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97b84f-b397-4bbc-a7f9-58aeb1aca069 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.013506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97b84f-b397-4bbc-a7f9-58aeb1aca069 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.018136 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fc88d-d412-4d9b-9c78-ce1692928e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.019015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fc88d-d412-4d9b-9c78-ce1692928e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.019292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fc88d-d412-4d9b-9c78-ce1692928e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.019568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fc88d-d412-4d9b-9c78-ce1692928e60 admin admin] PATH_INFO: `/v3/projects/27a4b2070d974075aac2c64d0bef89cf/users/93af8d1b55614e28b42bdaa5c332388d/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.021644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f60eb-08cd-47e7-b5ed-0ba85083a6f9 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.023390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e97f60eb-08cd-47e7-b5ed-0ba85083a6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:54.038344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f60eb-08cd-47e7-b5ed-0ba85083a6f9 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.038438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fc88d-d412-4d9b-9c78-ce1692928e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a4b2070d974075aac2c64d0bef89cf, user_id=93af8d1b55614e28b42bdaa5c332388d, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.041896 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fc88d-d412-4d9b-9c78-ce1692928e60 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.042445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070139d-cfb6-44d3-8e44-9ebace6941d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.043891 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070139d-cfb6-44d3-8e44-9ebace6941d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.044788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070139d-cfb6-44d3-8e44-9ebace6941d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.044788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070139d-cfb6-44d3-8e44-9ebace6941d5 admin admin] PATH_INFO: `/v3/projects/5671e01b3e494b7c84a253aacae775d4` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.046084 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070139d-cfb6-44d3-8e44-9ebace6941d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5671e01b3e494b7c84a253aacae775d4)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.048304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070139d-cfb6-44d3-8e44-9ebace6941d5 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.067085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 917/1841] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:53 2022] PUT /identity/v3/projects/27a4b2070d974075aac2c64d0bef89cf/users/93af8d1b55614e28b42bdaa5c332388d/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:54.067085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fc88d-d412-4d9b-9c78-ce1692928e60 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.071948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-160fc88d-d412-4d9b-9c78-ce1692928e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:54.107251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3070139d-cfb6-44d3-8e44-9ebace6941d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5671e01b3e494b7c84a253aacae775d4', 'request_id': 'req-3070139d-cfb6-44d3-8e44-9ebace6941d5'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:54.113837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3070139d-cfb6-44d3-8e44-9ebace6941d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5671e01b3e494b7c84a253aacae775d4', 'request_id': 'req-3070139d-cfb6-44d3-8e44-9ebace6941d5'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:54.119371 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3070139d-cfb6-44d3-8e44-9ebace6941d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5671e01b3e494b7c84a253aacae775d4', 'request_id': 'req-3070139d-cfb6-44d3-8e44-9ebace6941d5'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:54.130684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3070139d-cfb6-44d3-8e44-9ebace6941d5 admin admin] The token cache is being invalidate because project 5671e01b3e494b7c84a253aacae775d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:54.130973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3070139d-cfb6-44d3-8e44-9ebace6941d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:54.131612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3070139d-cfb6-44d3-8e44-9ebace6941d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:54.133210 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 925/1842] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:54 2022] DELETE /identity/v3/projects/5671e01b3e494b7c84a253aacae775d4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:11:54.139193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e8e93-4c42-4973-9724-65470cbe48c3 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.139483 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e8e93-4c42-4973-9724-65470cbe48c3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.139763 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e8e93-4c42-4973-9724-65470cbe48c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.140006 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fc88d-d412-4d9b-9c78-ce1692928e60 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.166409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-d41e8e93-4c42-4973-9724-65470cbe48c3 None None] MFA Rules not processed for user `93af8d1b55614e28b42bdaa5c332388d`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:54.167638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d41e8e93-4c42-4973-9724-65470cbe48c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:54.197739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.198597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.199446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.199721 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] PATH_INFO: `/v3/projects/96fc859ed1694d5093d8a80fef452570` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.200932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96fc859ed1694d5093d8a80fef452570)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.202817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.244632 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 926/1843] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:54.245976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91766e-de89-43e7-92c7-77404c0e74f4 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.246263 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91766e-de89-43e7-92c7-77404c0e74f4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.246547 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91766e-de89-43e7-92c7-77404c0e74f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.250659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96fc859ed1694d5093d8a80fef452570', 'request_id': 'req-ba33e7b1-87dd-462b-9038-1fa4891d1570'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:54.255799 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96fc859ed1694d5093d8a80fef452570', 'request_id': 'req-ba33e7b1-87dd-462b-9038-1fa4891d1570'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:54.263478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96fc859ed1694d5093d8a80fef452570', 'request_id': 'req-ba33e7b1-87dd-462b-9038-1fa4891d1570'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:54.264412 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-df91766e-de89-43e7-92c7-77404c0e74f4 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:54.265610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-df91766e-de89-43e7-92c7-77404c0e74f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:54.274673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] The token cache is being invalidate because project 96fc859ed1694d5093d8a80fef452570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:11:54.274963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:54.275608 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:11:54.281518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 918/1844] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:11:54 2022] DELETE /identity/v3/projects/96fc859ed1694d5093d8a80fef452570 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:54.282627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.284517 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:54.329754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 927/1845] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:54.337194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ac2b6-cdc4-45e3-b5ca-4ca6139d3b3a None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.337487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ac2b6-cdc4-45e3-b5ca-4ca6139d3b3a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.337768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ac2b6-cdc4-45e3-b5ca-4ca6139d3b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.355518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33e7b1-87dd-462b-9038-1fa4891d1570 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.359975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-5a3ac2b6-cdc4-45e3-b5ca-4ca6139d3b3a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:54.360291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c997fd-a869-4402-9c9d-ae6c202eb372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.360944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c997fd-a869-4402-9c9d-ae6c202eb372 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.361221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5a3ac2b6-cdc4-45e3-b5ca-4ca6139d3b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:54.361325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c997fd-a869-4402-9c9d-ae6c202eb372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.361497 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c997fd-a869-4402-9c9d-ae6c202eb372 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.362179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c997fd-a869-4402-9c9d-ae6c202eb372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.364071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c997fd-a869-4402-9c9d-ae6c202eb372 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.369072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 928/1846] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:54.370403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437350e-0cba-4877-8f57-b3ac20e023de None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.370719 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437350e-0cba-4877-8f57-b3ac20e023de None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.371000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437350e-0cba-4877-8f57-b3ac20e023de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.391950 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 919/1847] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:54.393272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f802-ae4e-4e21-a366-23b1d6d92e0a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.393557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f802-ae4e-4e21-a366-23b1d6d92e0a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.393832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f802-ae4e-4e21-a366-23b1d6d92e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.398323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-4437350e-0cba-4877-8f57-b3ac20e023de None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:54.399575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4437350e-0cba-4877-8f57-b3ac20e023de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:54.412543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-2324f802-ae4e-4e21-a366-23b1d6d92e0a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:54.413753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2324f802-ae4e-4e21-a366-23b1d6d92e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:54.476965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 920/1848] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:54.477820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324f802-ae4e-4e21-a366-23b1d6d92e0a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.486776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 929/1849] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:54.487704 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437350e-0cba-4877-8f57-b3ac20e023de None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.499161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437350e-0cba-4877-8f57-b3ac20e023de None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.500980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324f802-ae4e-4e21-a366-23b1d6d92e0a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.506050 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16611445-124c-4170-9df9-4ee76650991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.506808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16611445-124c-4170-9df9-4ee76650991d admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.507098 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16611445-124c-4170-9df9-4ee76650991d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.507586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16611445-124c-4170-9df9-4ee76650991d admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.508382 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16611445-124c-4170-9df9-4ee76650991d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.509785 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2f0ce-38a7-427f-9c9a-a1642e9fd14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.510480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2f0ce-38a7-427f-9c9a-a1642e9fd14e admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.510584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16611445-124c-4170-9df9-4ee76650991d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.510761 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2f0ce-38a7-427f-9c9a-a1642e9fd14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.511038 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2f0ce-38a7-427f-9c9a-a1642e9fd14e admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.512426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2f0ce-38a7-427f-9c9a-a1642e9fd14e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:54.512739 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2f0ce-38a7-427f-9c9a-a1642e9fd14e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.514318 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2f0ce-38a7-427f-9c9a-a1642e9fd14e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.528281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 930/1850] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:54.529477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2f0ce-38a7-427f-9c9a-a1642e9fd14e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.534482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 921/1851] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:54.536228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16611445-124c-4170-9df9-4ee76650991d admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.542917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2f0ce-38a7-427f-9c9a-a1642e9fd14e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.548293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16611445-124c-4170-9df9-4ee76650991d admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.548396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcce49-b517-4e38-9c0d-93604b3c3864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.548613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcce49-b517-4e38-9c0d-93604b3c3864 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.548856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcce49-b517-4e38-9c0d-93604b3c3864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.549143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcce49-b517-4e38-9c0d-93604b3c3864 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.549861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcce49-b517-4e38-9c0d-93604b3c3864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:11:54.550169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcce49-b517-4e38-9c0d-93604b3c3864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.551000 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8b77c-e342-4fb8-9e0a-5cb2445d2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.551740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcce49-b517-4e38-9c0d-93604b3c3864 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.551842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8b77c-e342-4fb8-9e0a-5cb2445d2587 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.552252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8b77c-e342-4fb8-9e0a-5cb2445d2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.552611 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8b77c-e342-4fb8-9e0a-5cb2445d2587 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.553431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8b77c-e342-4fb8-9e0a-5cb2445d2587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.555386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8b77c-e342-4fb8-9e0a-5cb2445d2587 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.564838 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 931/1852] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:11:54.565743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcce49-b517-4e38-9c0d-93604b3c3864 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.577401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcce49-b517-4e38-9c0d-93604b3c3864 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.582358 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57181b98-2e63-41d5-97c4-7d4f0b21d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.583005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57181b98-2e63-41d5-97c4-7d4f0b21d180 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.583103 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 922/1853] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:54.583287 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57181b98-2e63-41d5-97c4-7d4f0b21d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.583562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57181b98-2e63-41d5-97c4-7d4f0b21d180 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.584007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8b77c-e342-4fb8-9e0a-5cb2445d2587 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.584380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57181b98-2e63-41d5-97c4-7d4f0b21d180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.586139 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57181b98-2e63-41d5-97c4-7d4f0b21d180 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.596511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 932/1854] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:54.597463 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57181b98-2e63-41d5-97c4-7d4f0b21d180 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.606841 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57181b98-2e63-41d5-97c4-7d4f0b21d180 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.646930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8b77c-e342-4fb8-9e0a-5cb2445d2587 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.651740 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e36fc-4562-4da5-976f-7be815e588b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.652402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e36fc-4562-4da5-976f-7be815e588b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.652678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e36fc-4562-4da5-976f-7be815e588b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.652945 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e36fc-4562-4da5-976f-7be815e588b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.653630 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e36fc-4562-4da5-976f-7be815e588b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.655664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e36fc-4562-4da5-976f-7be815e588b8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.666273 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c19c9c-e179-4d9b-8cad-df6f2a59ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.666944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c19c9c-e179-4d9b-8cad-df6f2a59ec40 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.667268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c19c9c-e179-4d9b-8cad-df6f2a59ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.667633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c19c9c-e179-4d9b-8cad-df6f2a59ec40 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.668200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c19c9c-e179-4d9b-8cad-df6f2a59ec40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.670082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c19c9c-e179-4d9b-8cad-df6f2a59ec40 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.690468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 923/1855] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:54.690468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e36fc-4562-4da5-976f-7be815e588b8 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.691129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 933/1856] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:54.691917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c19c9c-e179-4d9b-8cad-df6f2a59ec40 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.701811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c19c9c-e179-4d9b-8cad-df6f2a59ec40 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.748739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e36fc-4562-4da5-976f-7be815e588b8 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.754243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2e2ed-0a50-4b56-9a41-557d81963c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.755000 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2e2ed-0a50-4b56-9a41-557d81963c32 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.755432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2e2ed-0a50-4b56-9a41-557d81963c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.755768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2e2ed-0a50-4b56-9a41-557d81963c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.756629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2e2ed-0a50-4b56-9a41-557d81963c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.758036 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc066ff-cdb4-4766-81ee-76c7c671ee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.758315 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2e2ed-0a50-4b56-9a41-557d81963c32 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.758706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc066ff-cdb4-4766-81ee-76c7c671ee6d admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.758990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc066ff-cdb4-4766-81ee-76c7c671ee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.759265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc066ff-cdb4-4766-81ee-76c7c671ee6d admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.759958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc066ff-cdb4-4766-81ee-76c7c671ee6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.762552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc066ff-cdb4-4766-81ee-76c7c671ee6d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.768683 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 924/1857] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:54.771820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2e2ed-0a50-4b56-9a41-557d81963c32 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.778933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2e2ed-0a50-4b56-9a41-557d81963c32 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.783584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6cbef-0435-46e0-b801-c54142d3f881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.783746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 934/1858] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:54.784247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6cbef-0435-46e0-b801-c54142d3f881 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.784526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6cbef-0435-46e0-b801-c54142d3f881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.784604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc066ff-cdb4-4766-81ee-76c7c671ee6d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.784812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6cbef-0435-46e0-b801-c54142d3f881 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.785502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6cbef-0435-46e0-b801-c54142d3f881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.787087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6cbef-0435-46e0-b801-c54142d3f881 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.794638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc066ff-cdb4-4766-81ee-76c7c671ee6d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.797887 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 925/1859] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:54.798758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6cbef-0435-46e0-b801-c54142d3f881 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.799484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86009c-acb3-43e7-ab5a-b9eacc566369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.800465 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86009c-acb3-43e7-ab5a-b9eacc566369 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.800819 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86009c-acb3-43e7-ab5a-b9eacc566369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.801213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86009c-acb3-43e7-ab5a-b9eacc566369 admin admin] PATH_INFO: `/v3/projects/c1d4f0e1625843ac9a85e6d61c3ce109/users/d298467a07b9439aa59afe939c158ade/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.809947 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6cbef-0435-46e0-b801-c54142d3f881 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.814474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c5e91-ee4d-4890-9d2f-362d3796e15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.815105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c5e91-ee4d-4890-9d2f-362d3796e15a admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.815388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c5e91-ee4d-4890-9d2f-362d3796e15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.815660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c5e91-ee4d-4890-9d2f-362d3796e15a admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.816404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c5e91-ee4d-4890-9d2f-362d3796e15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.816664 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86009c-acb3-43e7-ab5a-b9eacc566369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d4f0e1625843ac9a85e6d61c3ce109, user_id=d298467a07b9439aa59afe939c158ade, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.817962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c5e91-ee4d-4890-9d2f-362d3796e15a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.819270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86009c-acb3-43e7-ab5a-b9eacc566369 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.828420 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 926/1860] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:54.829034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c5e91-ee4d-4890-9d2f-362d3796e15a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.833444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 935/1861] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:54 2022] PUT /identity/v3/projects/c1d4f0e1625843ac9a85e6d61c3ce109/users/d298467a07b9439aa59afe939c158ade/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:54.834301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86009c-acb3-43e7-ab5a-b9eacc566369 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.840179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c5e91-ee4d-4890-9d2f-362d3796e15a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.894384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc67fb-d956-4975-8bcb-122d24f00f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.895073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc67fb-d956-4975-8bcb-122d24f00f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.895354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc67fb-d956-4975-8bcb-122d24f00f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.895621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc67fb-d956-4975-8bcb-122d24f00f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.896372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc67fb-d956-4975-8bcb-122d24f00f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.897980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc67fb-d956-4975-8bcb-122d24f00f43 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.898552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86009c-acb3-43e7-ab5a-b9eacc566369 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.903540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1706a-0c89-4004-803e-80c67ebc062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.904221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1706a-0c89-4004-803e-80c67ebc062b admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.904503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1706a-0c89-4004-803e-80c67ebc062b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.904774 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1706a-0c89-4004-803e-80c67ebc062b admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.905495 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1706a-0c89-4004-803e-80c67ebc062b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.907043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1706a-0c89-4004-803e-80c67ebc062b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.907669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 927/1862] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:54.908995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3637-0f15-4c64-8363-c77e1fa2aa0c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.909284 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3637-0f15-4c64-8363-c77e1fa2aa0c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.909563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3637-0f15-4c64-8363-c77e1fa2aa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.917250 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 936/1863] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:54.918402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1706a-0c89-4004-803e-80c67ebc062b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.927382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1706a-0c89-4004-803e-80c67ebc062b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:54.932247 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa47d-2c00-4ac5-9a20-3e759910a790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:54.933712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa47d-2c00-4ac5-9a20-3e759910a790 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:54.934520 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa47d-2c00-4ac5-9a20-3e759910a790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:54.934794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa47d-2c00-4ac5-9a20-3e759910a790 admin admin] PATH_INFO: `/v3/projects/47c882c9694745a9b8ea966ccdaa7788/users/cbc57f4f062d46e49042cd7c7d3d89fa/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:54.936236 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-888a3637-0f15-4c64-8363-c77e1fa2aa0c None None] MFA Rules not processed for user `d298467a07b9439aa59afe939c158ade`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:54.937435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-888a3637-0f15-4c64-8363-c77e1fa2aa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:54.948431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fa47d-2c00-4ac5-9a20-3e759910a790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c882c9694745a9b8ea966ccdaa7788, user_id=cbc57f4f062d46e49042cd7c7d3d89fa, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:54.951076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fa47d-2c00-4ac5-9a20-3e759910a790 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:54.964499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 937/1864] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:54 2022] PUT /identity/v3/projects/47c882c9694745a9b8ea966ccdaa7788/users/cbc57f4f062d46e49042cd7c7d3d89fa/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:54.965248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa47d-2c00-4ac5-9a20-3e759910a790 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:54.999357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 928/1865] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:55.001060 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75575efe-d610-418f-b642-8188b74c279a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.001530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75575efe-d610-418f-b642-8188b74c279a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.001984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75575efe-d610-418f-b642-8188b74c279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.027003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-75575efe-d610-418f-b642-8188b74c279a None None] MFA Rules not processed for user `cbc57f4f062d46e49042cd7c7d3d89fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:55.028217 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-75575efe-d610-418f-b642-8188b74c279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:55.033280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa47d-2c00-4ac5-9a20-3e759910a790 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.038000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068bf4c-c25c-4c24-9db9-10ee52e8c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.038937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068bf4c-c25c-4c24-9db9-10ee52e8c5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.039224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068bf4c-c25c-4c24-9db9-10ee52e8c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.039498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068bf4c-c25c-4c24-9db9-10ee52e8c5c1 admin admin] PATH_INFO: `/v3/projects/a168fb5ed6ef40e0a5c6a132daa2e7ca/users/c713bdbd51604ada8bfb37fcf8815a93/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.054499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068bf4c-c25c-4c24-9db9-10ee52e8c5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a168fb5ed6ef40e0a5c6a132daa2e7ca, user_id=c713bdbd51604ada8bfb37fcf8815a93, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.057171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068bf4c-c25c-4c24-9db9-10ee52e8c5c1 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.072751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 938/1866] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:54 2022] PUT /identity/v3/projects/a168fb5ed6ef40e0a5c6a132daa2e7ca/users/c713bdbd51604ada8bfb37fcf8815a93/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:55.073732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068bf4c-c25c-4c24-9db9-10ee52e8c5c1 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.112644 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 929/1867] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:55.112644 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4c4ae-f279-4a20-b17e-f4a9ad9f445d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.113758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4c4ae-f279-4a20-b17e-f4a9ad9f445d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.114138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4c4ae-f279-4a20-b17e-f4a9ad9f445d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.142391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068bf4c-c25c-4c24-9db9-10ee52e8c5c1 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.146321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-c3b4c4ae-f279-4a20-b17e-f4a9ad9f445d None None] MFA Rules not processed for user `c713bdbd51604ada8bfb37fcf8815a93`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:55.147881 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c3b4c4ae-f279-4a20-b17e-f4a9ad9f445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:55.148254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40816c8-350c-4b6b-9716-2bb045280dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.148980 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40816c8-350c-4b6b-9716-2bb045280dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.149817 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40816c8-350c-4b6b-9716-2bb045280dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.149817 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40816c8-350c-4b6b-9716-2bb045280dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.150377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40816c8-350c-4b6b-9716-2bb045280dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.152371 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40816c8-350c-4b6b-9716-2bb045280dc0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.183919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 939/1868] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:55 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:55.183919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40816c8-350c-4b6b-9716-2bb045280dc0 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.218176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 930/1869] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:55.219083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4c4ae-f279-4a20-b17e-f4a9ad9f445d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.234359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4c4ae-f279-4a20-b17e-f4a9ad9f445d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.248231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40816c8-350c-4b6b-9716-2bb045280dc0 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.252890 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cd096-007f-4e42-a4d4-6d30e9f7c9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.253480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cd096-007f-4e42-a4d4-6d30e9f7c9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.253756 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cd096-007f-4e42-a4d4-6d30e9f7c9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.254027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cd096-007f-4e42-a4d4-6d30e9f7c9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.254767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cd096-007f-4e42-a4d4-6d30e9f7c9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.256638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cd096-007f-4e42-a4d4-6d30e9f7c9f4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.283274 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 940/1870] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:55 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:55.284272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cd096-007f-4e42-a4d4-6d30e9f7c9f4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.293312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a5300-c678-46b8-a803-e2efd61b4ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.294079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a5300-c678-46b8-a803-e2efd61b4ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.294434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a5300-c678-46b8-a803-e2efd61b4ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.294776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a5300-c678-46b8-a803-e2efd61b4ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.295528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a5300-c678-46b8-a803-e2efd61b4ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.297548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a5300-c678-46b8-a803-e2efd61b4ce4 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.316524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 931/1871] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:55 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:55.317508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a5300-c678-46b8-a803-e2efd61b4ce4 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.327556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a5300-c678-46b8-a803-e2efd61b4ce4 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.351791 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cd096-007f-4e42-a4d4-6d30e9f7c9f4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.358544 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a93cb-d184-40e2-bcf1-68d173235722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.359232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a93cb-d184-40e2-bcf1-68d173235722 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.359516 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a93cb-d184-40e2-bcf1-68d173235722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.360277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a93cb-d184-40e2-bcf1-68d173235722 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.360587 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a93cb-d184-40e2-bcf1-68d173235722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.362586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a93cb-d184-40e2-bcf1-68d173235722 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.399663 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 941/1872] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:11:55 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:55.399663 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a93cb-d184-40e2-bcf1-68d173235722 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.409444 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd13fd3-8990-4327-b479-3cbaebb3f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.410394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd13fd3-8990-4327-b479-3cbaebb3f583 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.410823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd13fd3-8990-4327-b479-3cbaebb3f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.411252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd13fd3-8990-4327-b479-3cbaebb3f583 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.411954 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd13fd3-8990-4327-b479-3cbaebb3f583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.413906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd13fd3-8990-4327-b479-3cbaebb3f583 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.445986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 932/1873] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:55 2022] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:55.445986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd13fd3-8990-4327-b479-3cbaebb3f583 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.459990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd13fd3-8990-4327-b479-3cbaebb3f583 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.482480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a93cb-d184-40e2-bcf1-68d173235722 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.495088 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4097d-4e33-4076-8ab1-c04b18c34b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.495088 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4097d-4e33-4076-8ab1-c04b18c34b5b admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.495088 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4097d-4e33-4076-8ab1-c04b18c34b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.495088 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4097d-4e33-4076-8ab1-c04b18c34b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.495585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4097d-4e33-4076-8ab1-c04b18c34b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.495585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4097d-4e33-4076-8ab1-c04b18c34b5b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.503784 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 942/1874] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:55.505121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4097d-4e33-4076-8ab1-c04b18c34b5b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.518831 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4097d-4e33-4076-8ab1-c04b18c34b5b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.534219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092607a-b1b7-4617-89fa-a2aae7fbcea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.534897 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092607a-b1b7-4617-89fa-a2aae7fbcea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.535173 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092607a-b1b7-4617-89fa-a2aae7fbcea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.535464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092607a-b1b7-4617-89fa-a2aae7fbcea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.536180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092607a-b1b7-4617-89fa-a2aae7fbcea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.537759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092607a-b1b7-4617-89fa-a2aae7fbcea4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.547400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5341bf4-d4eb-415f-8974-4fdcac7aeb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.548572 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5341bf4-d4eb-415f-8974-4fdcac7aeb12 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.549034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5341bf4-d4eb-415f-8974-4fdcac7aeb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.549155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 943/1875] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:55.549759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5341bf4-d4eb-415f-8974-4fdcac7aeb12 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.549869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092607a-b1b7-4617-89fa-a2aae7fbcea4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.550712 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5341bf4-d4eb-415f-8974-4fdcac7aeb12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.552823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5341bf4-d4eb-415f-8974-4fdcac7aeb12 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.563906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092607a-b1b7-4617-89fa-a2aae7fbcea4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.570074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9093c-40b7-4f71-aae3-8e4230c37a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.571292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9093c-40b7-4f71-aae3-8e4230c37a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.571682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9093c-40b7-4f71-aae3-8e4230c37a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.571916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9093c-40b7-4f71-aae3-8e4230c37a62 admin admin] PATH_INFO: `/v3/projects/f73e1e1b77da49e6aea914320ca8aae8/users/5af936067dcb4f0da24d0548a8f33e6b/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.595209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9093c-40b7-4f71-aae3-8e4230c37a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73e1e1b77da49e6aea914320ca8aae8, user_id=5af936067dcb4f0da24d0548a8f33e6b, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.598300 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9093c-40b7-4f71-aae3-8e4230c37a62 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.616811 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 933/1876] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:11:55 2022] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:11:55.620889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5341bf4-d4eb-415f-8974-4fdcac7aeb12 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.622925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 944/1877] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:55 2022] PUT /identity/v3/projects/f73e1e1b77da49e6aea914320ca8aae8/users/5af936067dcb4f0da24d0548a8f33e6b/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:55.624052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9093c-40b7-4f71-aae3-8e4230c37a62 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.639722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5341bf4-d4eb-415f-8974-4fdcac7aeb12 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.739331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf01c2-a2b6-4671-861f-78058f2f1c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.740293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf01c2-a2b6-4671-861f-78058f2f1c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.740579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf01c2-a2b6-4671-861f-78058f2f1c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.740855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf01c2-a2b6-4671-861f-78058f2f1c93 admin admin] PATH_INFO: `/v3/projects/b0a840977be541f6a85b4f687f341c39/users/e2bc43f1dc0743a38f187eba10dfa8d6/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.741233 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9093c-40b7-4f71-aae3-8e4230c37a62 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.748298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98f31b-f395-4d53-8cdd-b571b4cb2bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.749344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f31b-f395-4d53-8cdd-b571b4cb2bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.749680 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f31b-f395-4d53-8cdd-b571b4cb2bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.750039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f31b-f395-4d53-8cdd-b571b4cb2bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.751642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98f31b-f395-4d53-8cdd-b571b4cb2bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.756040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98f31b-f395-4d53-8cdd-b571b4cb2bf2 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.771903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 945/1878] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:55.773279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98f31b-f395-4d53-8cdd-b571b4cb2bf2 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.782988 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf01c2-a2b6-4671-861f-78058f2f1c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a840977be541f6a85b4f687f341c39, user_id=e2bc43f1dc0743a38f187eba10dfa8d6, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.786310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98f31b-f395-4d53-8cdd-b571b4cb2bf2 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.788233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf01c2-a2b6-4671-861f-78058f2f1c93 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.803431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564383f1-7eca-418f-a0cf-f5be4209d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.805154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564383f1-7eca-418f-a0cf-f5be4209d22f admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.805154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564383f1-7eca-418f-a0cf-f5be4209d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.805154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564383f1-7eca-418f-a0cf-f5be4209d22f admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.805848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564383f1-7eca-418f-a0cf-f5be4209d22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.807715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564383f1-7eca-418f-a0cf-f5be4209d22f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.812855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 934/1879] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:55 2022] PUT /identity/v3/projects/b0a840977be541f6a85b4f687f341c39/users/e2bc43f1dc0743a38f187eba10dfa8d6/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:55.814036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf01c2-a2b6-4671-861f-78058f2f1c93 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.829907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 946/1880] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:55.831985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564383f1-7eca-418f-a0cf-f5be4209d22f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.853541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564383f1-7eca-418f-a0cf-f5be4209d22f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.938259 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf01c2-a2b6-4671-861f-78058f2f1c93 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.943473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6fa08-f9ae-461a-a20b-c3325ab4f937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.944409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6fa08-f9ae-461a-a20b-c3325ab4f937 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.944700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6fa08-f9ae-461a-a20b-c3325ab4f937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.944966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6fa08-f9ae-461a-a20b-c3325ab4f937 admin admin] PATH_INFO: `/v3/projects/6f4e17b17bf34991b1b56a3f85cd6db0/users/4b499a7a917245219ae39436602cc231/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.949355 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478747b-2ee4-427e-87aa-59e5cc304a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:55.950024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478747b-2ee4-427e-87aa-59e5cc304a2e admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:55.950306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478747b-2ee4-427e-87aa-59e5cc304a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:55.950589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478747b-2ee4-427e-87aa-59e5cc304a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:55.951312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478747b-2ee4-427e-87aa-59e5cc304a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.952953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478747b-2ee4-427e-87aa-59e5cc304a2e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.959626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6fa08-f9ae-461a-a20b-c3325ab4f937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4e17b17bf34991b1b56a3f85cd6db0, user_id=4b499a7a917245219ae39436602cc231, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:55.962172 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6fa08-f9ae-461a-a20b-c3325ab4f937 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:55.962683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 947/1881] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:55.963422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478747b-2ee4-427e-87aa-59e5cc304a2e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:55.973434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478747b-2ee4-427e-87aa-59e5cc304a2e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:55.975724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 935/1882] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:55 2022] PUT /identity/v3/projects/6f4e17b17bf34991b1b56a3f85cd6db0/users/4b499a7a917245219ae39436602cc231/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:55.976560 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6fa08-f9ae-461a-a20b-c3325ab4f937 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:56.035324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90513e-e303-40fb-9963-1fcadd9cedf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:56.036152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90513e-e303-40fb-9963-1fcadd9cedf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:56.036437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90513e-e303-40fb-9963-1fcadd9cedf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:56.036709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90513e-e303-40fb-9963-1fcadd9cedf2 admin admin] PATH_INFO: `/v3/projects/f73e1e1b77da49e6aea914320ca8aae8/users/5af936067dcb4f0da24d0548a8f33e6b/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:56.038706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90513e-e303-40fb-9963-1fcadd9cedf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73e1e1b77da49e6aea914320ca8aae8, user_id=5af936067dcb4f0da24d0548a8f33e6b, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:56.041406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90513e-e303-40fb-9963-1fcadd9cedf2 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:56.049427 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6fa08-f9ae-461a-a20b-c3325ab4f937 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:56.051713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 948/1883] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:55 2022] PUT /identity/v3/projects/f73e1e1b77da49e6aea914320ca8aae8/users/5af936067dcb4f0da24d0548a8f33e6b/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:56.052607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90513e-e303-40fb-9963-1fcadd9cedf2 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:56.110955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d497ba-0171-4489-b587-fb656d56581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:56.112700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d497ba-0171-4489-b587-fb656d56581d admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:56.112978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d497ba-0171-4489-b587-fb656d56581d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:56.113263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d497ba-0171-4489-b587-fb656d56581d admin admin] PATH_INFO: `/v3/projects/b0a840977be541f6a85b4f687f341c39/users/e2bc43f1dc0743a38f187eba10dfa8d6/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:56.115358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d497ba-0171-4489-b587-fb656d56581d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a840977be541f6a85b4f687f341c39, user_id=e2bc43f1dc0743a38f187eba10dfa8d6, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:56.118002 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d497ba-0171-4489-b587-fb656d56581d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:56.126754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90513e-e303-40fb-9963-1fcadd9cedf2 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:56.138776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 936/1884] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:55 2022] PUT /identity/v3/projects/b0a840977be541f6a85b4f687f341c39/users/e2bc43f1dc0743a38f187eba10dfa8d6/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:56.138776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad2c42-02d0-4e12-8f88-a04a62b95ea6 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:56.138776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad2c42-02d0-4e12-8f88-a04a62b95ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:56.138776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad2c42-02d0-4e12-8f88-a04a62b95ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:56.165727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-09ad2c42-02d0-4e12-8f88-a04a62b95ea6 None None] MFA Rules not processed for user `5af936067dcb4f0da24d0548a8f33e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:56.166943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-09ad2c42-02d0-4e12-8f88-a04a62b95ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:56.185405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69f124-63d2-475d-a900-888d09ee6e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:56.186079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69f124-63d2-475d-a900-888d09ee6e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:56.186360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69f124-63d2-475d-a900-888d09ee6e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:56.186637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69f124-63d2-475d-a900-888d09ee6e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:56.187366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69f124-63d2-475d-a900-888d09ee6e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:56.189033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69f124-63d2-475d-a900-888d09ee6e24 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:56.204161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 949/1885] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:11:56.204161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640e747-d2b7-4bca-910e-80f10e765727 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:56.204161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640e747-d2b7-4bca-910e-80f10e765727 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:56.204161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640e747-d2b7-4bca-910e-80f10e765727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:56.233574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b640e747-d2b7-4bca-910e-80f10e765727 None None] MFA Rules not processed for user `e2bc43f1dc0743a38f187eba10dfa8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:56.234886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b640e747-d2b7-4bca-910e-80f10e765727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:56.276712 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 937/1886] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:56.277627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad2c42-02d0-4e12-8f88-a04a62b95ea6 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:56.310199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad2c42-02d0-4e12-8f88-a04a62b95ea6 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:56.314597 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 950/1887] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:56.315616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640e747-d2b7-4bca-910e-80f10e765727 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:56.317215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b640e747-d2b7-4bca-910e-80f10e765727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:56.324292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ceb3e-70e0-462b-89d1-4d778cb775a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:56.325188 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ceb3e-70e0-462b-89d1-4d778cb775a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:56.325628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ceb3e-70e0-462b-89d1-4d778cb775a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:56.325961 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ceb3e-70e0-462b-89d1-4d778cb775a0 admin admin] PATH_INFO: `/v3/projects/6f4e17b17bf34991b1b56a3f85cd6db0/users/4b499a7a917245219ae39436602cc231/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:56.329735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ceb3e-70e0-462b-89d1-4d778cb775a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4e17b17bf34991b1b56a3f85cd6db0, user_id=4b499a7a917245219ae39436602cc231, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:56.337812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ceb3e-70e0-462b-89d1-4d778cb775a0 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:56.368536 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 938/1888] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:11:56 2022] PUT /identity/v3/projects/6f4e17b17bf34991b1b56a3f85cd6db0/users/4b499a7a917245219ae39436602cc231/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:11:56.374916 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9ab32-4694-4d5d-8340-b703fbe3025c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:56.375282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9ab32-4694-4d5d-8340-b703fbe3025c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:56.375782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9ab32-4694-4d5d-8340-b703fbe3025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:56.390312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640e747-d2b7-4bca-910e-80f10e765727 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:56.403833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-b7d9ab32-4694-4d5d-8340-b703fbe3025c None None] MFA Rules not processed for user `4b499a7a917245219ae39436602cc231`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:11:56.405080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b7d9ab32-4694-4d5d-8340-b703fbe3025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:56.438284 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ad7d5-3c2a-48cc-9ae4-0aacc847c4b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:56.438931 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ad7d5-3c2a-48cc-9ae4-0aacc847c4b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:56.439201 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ad7d5-3c2a-48cc-9ae4-0aacc847c4b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:56.439476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ad7d5-3c2a-48cc-9ae4-0aacc847c4b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:56.471698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 939/1889] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:11:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:11:56.472558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9ab32-4694-4d5d-8340-b703fbe3025c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:56.473797 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b7d9ab32-4694-4d5d-8340-b703fbe3025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:56.485506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9ab32-4694-4d5d-8340-b703fbe3025c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:56.489145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f95d1-ed18-483f-baa7-9e9f90b2c1cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:56.489800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f95d1-ed18-483f-baa7-9e9f90b2c1cd service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:56.490083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f95d1-ed18-483f-baa7-9e9f90b2c1cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:56.490359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f95d1-ed18-483f-baa7-9e9f90b2c1cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:56.497143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ad7d5-3c2a-48cc-9ae4-0aacc847c4b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:56.498570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ad7d5-3c2a-48cc-9ae4-0aacc847c4b3 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:56.507929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 951/1890] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:56.551730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f95d1-ed18-483f-baa7-9e9f90b2c1cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:56.553183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f95d1-ed18-483f-baa7-9e9f90b2c1cd service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:56.563269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 940/1891] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:56.624538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ad7d5-3c2a-48cc-9ae4-0aacc847c4b3 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:56.633675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ad7d5-3c2a-48cc-9ae4-0aacc847c4b3 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:56.637876 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92df2f1-63a4-48b8-b863-2fbcdd708cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:56.638547 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92df2f1-63a4-48b8-b863-2fbcdd708cec service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:56.638836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92df2f1-63a4-48b8-b863-2fbcdd708cec service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:56.639111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92df2f1-63a4-48b8-b863-2fbcdd708cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:56.648212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92df2f1-63a4-48b8-b863-2fbcdd708cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:56.649628 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92df2f1-63a4-48b8-b863-2fbcdd708cec service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:56.659510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 952/1892] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:56.682617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f95d1-ed18-483f-baa7-9e9f90b2c1cd service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:56.696947 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f95d1-ed18-483f-baa7-9e9f90b2c1cd service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:56.701579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bad66-dc24-4f6d-aca4-f0149a791e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:56.702173 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bad66-dc24-4f6d-aca4-f0149a791e17 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:56.702445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bad66-dc24-4f6d-aca4-f0149a791e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:56.702715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bad66-dc24-4f6d-aca4-f0149a791e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:56.704745 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-709bad66-dc24-4f6d-aca4-f0149a791e17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:11:56.770300 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bad66-dc24-4f6d-aca4-f0149a791e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:56.771722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bad66-dc24-4f6d-aca4-f0149a791e17 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:56.775346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92df2f1-63a4-48b8-b863-2fbcdd708cec service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:56.781087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 941/1893] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:11:56.784215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92df2f1-63a4-48b8-b863-2fbcdd708cec service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:56.788049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a59608-d862-4f3d-a642-45d746a061a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:56.788707 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a59608-d862-4f3d-a642-45d746a061a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:56.788989 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a59608-d862-4f3d-a642-45d746a061a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:56.789261 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a59608-d862-4f3d-a642-45d746a061a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:56.857816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a59608-d862-4f3d-a642-45d746a061a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:56.859282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a59608-d862-4f3d-a642-45d746a061a2 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:56.868669 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 953/1894] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:11:57.324858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bad66-dc24-4f6d-aca4-f0149a791e17 service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:11:57.334193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bad66-dc24-4f6d-aca4-f0149a791e17 service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:11:57.339918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90031580-5834-4d2c-83fa-b7b0f7a9ddd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:11:57.340863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90031580-5834-4d2c-83fa-b7b0f7a9ddd8 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:11:57.341344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90031580-5834-4d2c-83fa-b7b0f7a9ddd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:11:57.341628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90031580-5834-4d2c-83fa-b7b0f7a9ddd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:11:57.404972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90031580-5834-4d2c-83fa-b7b0f7a9ddd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:11:57.406454 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90031580-5834-4d2c-83fa-b7b0f7a9ddd8 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:11:57.415854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 942/1895] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:11:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:05.326261 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a59608-d862-4f3d-a642-45d746a061a2 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:05.384672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a59608-d862-4f3d-a642-45d746a061a2 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:05.389741 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:05.390597 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:05.390873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:05.391141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] PATH_INFO: `/v3/users/93af8d1b55614e28b42bdaa5c332388d` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:05.392335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] RBAC: Authorizing `identity:delete_user(user_id=93af8d1b55614e28b42bdaa5c332388d)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:05.394218 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:05.442912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93af8d1b55614e28b42bdaa5c332388d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:05.452531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93af8d1b55614e28b42bdaa5c332388d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:05.453406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93af8d1b55614e28b42bdaa5c332388d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:05.454259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93af8d1b55614e28b42bdaa5c332388d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:05.469655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93af8d1b55614e28b42bdaa5c332388d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:05.492186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 954/1896] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:05 2022] DELETE /identity/v3/users/93af8d1b55614e28b42bdaa5c332388d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:05.498427 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6a941-61bd-473d-81be-7b5a023c0292 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:05.498877 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6a941-61bd-473d-81be-7b5a023c0292 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:05.499013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6a941-61bd-473d-81be-7b5a023c0292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:05.518719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-7fc6a941-61bd-473d-81be-7b5a023c0292 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:05.520243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7fc6a941-61bd-473d-81be-7b5a023c0292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:05.595122 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 943/1897] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:05.604732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:05.606230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:05.662068 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3783a-53a0-499b-bd73-26cd053d815b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:05.665744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359280ea-d03c-45f0-9053-986a22da4dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:05.666378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359280ea-d03c-45f0-9053-986a22da4dbe service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:05.666654 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359280ea-d03c-45f0-9053-986a22da4dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:05.666919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359280ea-d03c-45f0-9053-986a22da4dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:05.676443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359280ea-d03c-45f0-9053-986a22da4dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:05.677852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359280ea-d03c-45f0-9053-986a22da4dbe service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:05.687074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 955/1898] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:05.947261 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6a941-61bd-473d-81be-7b5a023c0292 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:05.948717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7fc6a941-61bd-473d-81be-7b5a023c0292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:05.960047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6a941-61bd-473d-81be-7b5a023c0292 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:05.964766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:05.965620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:05.965904 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:05.966172 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] PATH_INFO: `/v3/projects/27a4b2070d974075aac2c64d0bef89cf` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:05.967877 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a4b2070d974075aac2c64d0bef89cf)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:05.969794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:06.019443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a4b2070d974075aac2c64d0bef89cf', 'request_id': 'req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.024750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a4b2070d974075aac2c64d0bef89cf', 'request_id': 'req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.033052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a4b2070d974075aac2c64d0bef89cf', 'request_id': 'req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.043894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] The token cache is being invalidate because project 27a4b2070d974075aac2c64d0bef89cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:06.044208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.044874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.046393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 944/1899] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:05 2022] DELETE /identity/v3/projects/27a4b2070d974075aac2c64d0bef89cf => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:06.050267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359280ea-d03c-45f0-9053-986a22da4dbe service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:06.059718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359280ea-d03c-45f0-9053-986a22da4dbe service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:06.112246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:06.113104 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:06.113382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:06.113652 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] PATH_INFO: `/v3/users/d298467a07b9439aa59afe939c158ade` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:06.114818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d298467a07b9439aa59afe939c158ade)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:06.116752 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:06.158626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd298467a07b9439aa59afe939c158ade'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.165046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd298467a07b9439aa59afe939c158ade'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.165684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd298467a07b9439aa59afe939c158ade'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.166275 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd298467a07b9439aa59afe939c158ade'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.177828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd298467a07b9439aa59afe939c158ade'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.190012 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 956/1900] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:06 2022] DELETE /identity/v3/users/d298467a07b9439aa59afe939c158ade => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:06.450699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:06.452754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:06.467655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e9a58-3dfd-42eb-a648-04a1087e1b0a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:06.524635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:06.525498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:06.525781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:06.526052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] PATH_INFO: `/v3/projects/c1d4f0e1625843ac9a85e6d61c3ce109` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:06.527229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d4f0e1625843ac9a85e6d61c3ce109)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:06.529214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:06.600239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d4f0e1625843ac9a85e6d61c3ce109', 'request_id': 'req-f172cb20-427b-466a-9b5b-c1c89db92d39'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.605668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d4f0e1625843ac9a85e6d61c3ce109', 'request_id': 'req-f172cb20-427b-466a-9b5b-c1c89db92d39'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.614053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d4f0e1625843ac9a85e6d61c3ce109', 'request_id': 'req-f172cb20-427b-466a-9b5b-c1c89db92d39'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.626801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] The token cache is being invalidate because project c1d4f0e1625843ac9a85e6d61c3ce109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:06.626940 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.627542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.633221 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 945/1901] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:06 2022] DELETE /identity/v3/projects/c1d4f0e1625843ac9a85e6d61c3ce109 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:06.637096 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:06.639323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:06.652379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774f4db-afea-43d3-a1fb-78fe8786a96d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:06.715592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f83d3-a023-4416-aed9-6b77824e10d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:06.716673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f83d3-a023-4416-aed9-6b77824e10d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:06.720406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f83d3-a023-4416-aed9-6b77824e10d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:06.720878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f83d3-a023-4416-aed9-6b77824e10d8 admin admin] PATH_INFO: `/v3/users/5af936067dcb4f0da24d0548a8f33e6b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:06.722591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f83d3-a023-4416-aed9-6b77824e10d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af936067dcb4f0da24d0548a8f33e6b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:06.724755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f83d3-a023-4416-aed9-6b77824e10d8 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:06.777241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e60f83d3-a023-4416-aed9-6b77824e10d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af936067dcb4f0da24d0548a8f33e6b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.783878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e60f83d3-a023-4416-aed9-6b77824e10d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af936067dcb4f0da24d0548a8f33e6b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.784629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e60f83d3-a023-4416-aed9-6b77824e10d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af936067dcb4f0da24d0548a8f33e6b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.785188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e60f83d3-a023-4416-aed9-6b77824e10d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af936067dcb4f0da24d0548a8f33e6b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.796979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e60f83d3-a023-4416-aed9-6b77824e10d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af936067dcb4f0da24d0548a8f33e6b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:06.810690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 957/1902] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:06 2022] DELETE /identity/v3/users/5af936067dcb4f0da24d0548a8f33e6b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:07.069639 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:07.071510 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:07.085055 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172cb20-427b-466a-9b5b-c1c89db92d39 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:07.143118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9842c1-1960-4cb3-9901-75fa34ea1056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:07.143999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9842c1-1960-4cb3-9901-75fa34ea1056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:07.144304 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9842c1-1960-4cb3-9901-75fa34ea1056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:07.144574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9842c1-1960-4cb3-9901-75fa34ea1056 admin admin] PATH_INFO: `/v3/projects/f73e1e1b77da49e6aea914320ca8aae8` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:07.145739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9842c1-1960-4cb3-9901-75fa34ea1056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73e1e1b77da49e6aea914320ca8aae8)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:07.147651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9842c1-1960-4cb3-9901-75fa34ea1056 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:07.191598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1b9842c1-1960-4cb3-9901-75fa34ea1056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73e1e1b77da49e6aea914320ca8aae8', 'request_id': 'req-1b9842c1-1960-4cb3-9901-75fa34ea1056'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:07.196831 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1b9842c1-1960-4cb3-9901-75fa34ea1056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73e1e1b77da49e6aea914320ca8aae8', 'request_id': 'req-1b9842c1-1960-4cb3-9901-75fa34ea1056'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:07.203551 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1b9842c1-1960-4cb3-9901-75fa34ea1056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73e1e1b77da49e6aea914320ca8aae8', 'request_id': 'req-1b9842c1-1960-4cb3-9901-75fa34ea1056'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:07.214391 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1b9842c1-1960-4cb3-9901-75fa34ea1056 admin admin] The token cache is being invalidate because project f73e1e1b77da49e6aea914320ca8aae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:07.214697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1b9842c1-1960-4cb3-9901-75fa34ea1056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:07.215330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1b9842c1-1960-4cb3-9901-75fa34ea1056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:07.217453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 946/1903] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:07 2022] DELETE /identity/v3/projects/f73e1e1b77da49e6aea914320ca8aae8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:07.223376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f661b8-fd94-447d-b7e4-3114037c36c1 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:07.223666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f661b8-fd94-447d-b7e4-3114037c36c1 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:07.223946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f661b8-fd94-447d-b7e4-3114037c36c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:07.242010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-d9f661b8-fd94-447d-b7e4-3114037c36c1 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:07.243438 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d9f661b8-fd94-447d-b7e4-3114037c36c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:07.300489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 958/1904] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:07.309137 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984c03f-9b11-4040-ab7f-a4061201503d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:07.309426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984c03f-9b11-4040-ab7f-a4061201503d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:07.309698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984c03f-9b11-4040-ab7f-a4061201503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:07.329003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0984c03f-9b11-4040-ab7f-a4061201503d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:07.330190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0984c03f-9b11-4040-ab7f-a4061201503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:07.338195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 947/1905] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:07.342849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f661b8-fd94-447d-b7e4-3114037c36c1 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:07.352164 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f661b8-fd94-447d-b7e4-3114037c36c1 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:07.356660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b57c7-b0d4-49a6-96bf-c66ace3c5a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:07.357881 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b57c7-b0d4-49a6-96bf-c66ace3c5a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:07.358160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b57c7-b0d4-49a6-96bf-c66ace3c5a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:07.358427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b57c7-b0d4-49a6-96bf-c66ace3c5a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:07.359145 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b57c7-b0d4-49a6-96bf-c66ace3c5a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:07.359451 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b57c7-b0d4-49a6-96bf-c66ace3c5a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:07.361041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b57c7-b0d4-49a6-96bf-c66ace3c5a47 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:07.371969 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 959/1906] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:12:07.376319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984c03f-9b11-4040-ab7f-a4061201503d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:07.385047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984c03f-9b11-4040-ab7f-a4061201503d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:07.389568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed807b-f81b-4bfa-bbd7-c3ca3ebd44d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:07.390192 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed807b-f81b-4bfa-bbd7-c3ca3ebd44d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:07.390467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed807b-f81b-4bfa-bbd7-c3ca3ebd44d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:07.390734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed807b-f81b-4bfa-bbd7-c3ca3ebd44d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:07.391416 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed807b-f81b-4bfa-bbd7-c3ca3ebd44d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:07.393303 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed807b-f81b-4bfa-bbd7-c3ca3ebd44d8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:07.417703 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 948/1907] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:07 2022] POST /identity/v3/projects => generated 371 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:07.422435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b57c7-b0d4-49a6-96bf-c66ace3c5a47 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:07.432565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b57c7-b0d4-49a6-96bf-c66ace3c5a47 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:07.485135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295062d8-a8e6-4bd7-b7d7-cb9f1bf25d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:07.485778 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295062d8-a8e6-4bd7-b7d7-cb9f1bf25d48 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:07.486053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295062d8-a8e6-4bd7-b7d7-cb9f1bf25d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:07.486324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295062d8-a8e6-4bd7-b7d7-cb9f1bf25d48 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:07.486992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295062d8-a8e6-4bd7-b7d7-cb9f1bf25d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:07.488897 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295062d8-a8e6-4bd7-b7d7-cb9f1bf25d48 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:07.509012 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 960/1908] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:07 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:07.513645 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed807b-f81b-4bfa-bbd7-c3ca3ebd44d8 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:07.523819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed807b-f81b-4bfa-bbd7-c3ca3ebd44d8 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:07.528499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb13a69-c7fa-41ab-ab45-89e7c5f053df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:07.529816 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb13a69-c7fa-41ab-ab45-89e7c5f053df admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:07.530000 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb13a69-c7fa-41ab-ab45-89e7c5f053df admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:07.530270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb13a69-c7fa-41ab-ab45-89e7c5f053df admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:07.530991 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb13a69-c7fa-41ab-ab45-89e7c5f053df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:07.532631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb13a69-c7fa-41ab-ab45-89e7c5f053df admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:07.542825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 949/1909] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:07.546807 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295062d8-a8e6-4bd7-b7d7-cb9f1bf25d48 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:07.556394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295062d8-a8e6-4bd7-b7d7-cb9f1bf25d48 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:07.561410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cee749-3907-4c41-8024-35956c6fb39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:07.562066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cee749-3907-4c41-8024-35956c6fb39a admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:07.562345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cee749-3907-4c41-8024-35956c6fb39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:07.562619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cee749-3907-4c41-8024-35956c6fb39a admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:07.563339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cee749-3907-4c41-8024-35956c6fb39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:07.564984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cee749-3907-4c41-8024-35956c6fb39a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:07.575432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 961/1910] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:07.579989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb13a69-c7fa-41ab-ab45-89e7c5f053df admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:07.589548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb13a69-c7fa-41ab-ab45-89e7c5f053df admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:07.594544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e7267-7936-4f61-a003-af8f4a894956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:07.595398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e7267-7936-4f61-a003-af8f4a894956 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:07.595670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e7267-7936-4f61-a003-af8f4a894956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:07.595935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e7267-7936-4f61-a003-af8f4a894956 admin admin] PATH_INFO: `/v3/projects/c97844c5a8c7425d91328e67ad29d64f/users/d48b637afbfa46b1aa6daefd5fd7a587/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:07.610185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e7267-7936-4f61-a003-af8f4a894956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97844c5a8c7425d91328e67ad29d64f, user_id=d48b637afbfa46b1aa6daefd5fd7a587, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:07.612825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e7267-7936-4f61-a003-af8f4a894956 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:07.625658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 950/1911] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:07 2022] PUT /identity/v3/projects/c97844c5a8c7425d91328e67ad29d64f/users/d48b637afbfa46b1aa6daefd5fd7a587/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:07.637597 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af827de-7340-4aa8-9946-d348ee4ac323 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:07.638617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af827de-7340-4aa8-9946-d348ee4ac323 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:07.638728 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af827de-7340-4aa8-9946-d348ee4ac323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:07.667550 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-7af827de-7340-4aa8-9946-d348ee4ac323 None None] MFA Rules not processed for user `d48b637afbfa46b1aa6daefd5fd7a587`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:07.668742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-7af827de-7340-4aa8-9946-d348ee4ac323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:07.731183 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 962/1912] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:07.743493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e7267-7936-4f61-a003-af8f4a894956 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:07.745207 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-948e7267-7936-4f61-a003-af8f4a894956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:07.803403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e7267-7936-4f61-a003-af8f4a894956 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:07.807409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111be167-e9e1-456e-84f6-88afd8e83ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:07.808053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111be167-e9e1-456e-84f6-88afd8e83ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:07.808362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111be167-e9e1-456e-84f6-88afd8e83ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:07.808637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111be167-e9e1-456e-84f6-88afd8e83ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:07.817279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111be167-e9e1-456e-84f6-88afd8e83ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:07.818650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111be167-e9e1-456e-84f6-88afd8e83ac1 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:07.828215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 951/1913] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:07.848790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af827de-7340-4aa8-9946-d348ee4ac323 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:07.920014 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af827de-7340-4aa8-9946-d348ee4ac323 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:07.924780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:07.925676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:07.925957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:07.926230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] PATH_INFO: `/v3/users/d48b637afbfa46b1aa6daefd5fd7a587` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:07.927431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48b637afbfa46b1aa6daefd5fd7a587)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:07.929370 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:07.974971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48b637afbfa46b1aa6daefd5fd7a587'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:07.981463 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48b637afbfa46b1aa6daefd5fd7a587'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:07.982182 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48b637afbfa46b1aa6daefd5fd7a587'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:07.982800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48b637afbfa46b1aa6daefd5fd7a587'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:07.994356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48b637afbfa46b1aa6daefd5fd7a587'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:08.008027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 963/1914] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:07 2022] DELETE /identity/v3/users/d48b637afbfa46b1aa6daefd5fd7a587 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:08.012499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b4df-f3fb-4315-9168-04749a944894 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:08.012896 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b4df-f3fb-4315-9168-04749a944894 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:08.013921 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b4df-f3fb-4315-9168-04749a944894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:08.030478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-9f98b4df-f3fb-4315-9168-04749a944894 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:08.031660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9f98b4df-f3fb-4315-9168-04749a944894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:08.086755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 952/1915] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:08.096042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:08.097451 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:08.151887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7da5db-eae9-43d4-aa24-81a68981638c admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:08.155537 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0656e9a-d66c-4d54-b329-c13aea018a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:08.156246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0656e9a-d66c-4d54-b329-c13aea018a7f service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:08.156526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0656e9a-d66c-4d54-b329-c13aea018a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:08.156870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0656e9a-d66c-4d54-b329-c13aea018a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:08.165814 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0656e9a-d66c-4d54-b329-c13aea018a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:08.167221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0656e9a-d66c-4d54-b329-c13aea018a7f service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:08.176374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 964/1916] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:08.513958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98b4df-f3fb-4315-9168-04749a944894 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:08.515412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9f98b4df-f3fb-4315-9168-04749a944894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:08.528147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98b4df-f3fb-4315-9168-04749a944894 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:08.533156 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:08.534047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:08.534332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:08.534605 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08 admin admin] PATH_INFO: `/v3/projects/c97844c5a8c7425d91328e67ad29d64f` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:08.535787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c97844c5a8c7425d91328e67ad29d64f)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:08.537753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:08.584888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97844c5a8c7425d91328e67ad29d64f', 'request_id': 'req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:08.590081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97844c5a8c7425d91328e67ad29d64f', 'request_id': 'req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:08.598667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97844c5a8c7425d91328e67ad29d64f', 'request_id': 'req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:08.610161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08 admin admin] The token cache is being invalidate because project c97844c5a8c7425d91328e67ad29d64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:08.610442 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:08.611071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-87269e8a-eb34-4e19-ba4a-dccb6a7a9d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:08.612633 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 953/1917] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:08 2022] DELETE /identity/v3/projects/c97844c5a8c7425d91328e67ad29d64f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:08.617283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f694c0-fbf3-43a4-bfee-00e2744b416e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:08.617570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f694c0-fbf3-43a4-bfee-00e2744b416e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:08.617837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f694c0-fbf3-43a4-bfee-00e2744b416e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:08.635456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-91f694c0-fbf3-43a4-bfee-00e2744b416e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:08.636668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-91f694c0-fbf3-43a4-bfee-00e2744b416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:08.693991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 965/1918] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:08.701623 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9c01e-e1f5-49ac-944e-a8a2ad48017a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:08.701914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9c01e-e1f5-49ac-944e-a8a2ad48017a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:08.702199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9c01e-e1f5-49ac-944e-a8a2ad48017a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:08.725858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-40b9c01e-e1f5-49ac-944e-a8a2ad48017a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:08.726734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-40b9c01e-e1f5-49ac-944e-a8a2ad48017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:08.739133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 954/1919] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:08.740365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f694c0-fbf3-43a4-bfee-00e2744b416e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:08.749832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f694c0-fbf3-43a4-bfee-00e2744b416e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:08.754488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bb669-7ee3-4ea7-b1a4-4c6019c29bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:08.755131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bb669-7ee3-4ea7-b1a4-4c6019c29bef admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:08.755408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bb669-7ee3-4ea7-b1a4-4c6019c29bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:08.755678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bb669-7ee3-4ea7-b1a4-4c6019c29bef admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:08.756441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bb669-7ee3-4ea7-b1a4-4c6019c29bef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:08.756742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bb669-7ee3-4ea7-b1a4-4c6019c29bef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:08.758302 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bb669-7ee3-4ea7-b1a4-4c6019c29bef admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:08.769336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 966/1920] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:12:08.773636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9c01e-e1f5-49ac-944e-a8a2ad48017a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:08.783109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9c01e-e1f5-49ac-944e-a8a2ad48017a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:08.787666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250a98a-9d7c-461b-8c75-426b6958f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:08.788340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250a98a-9d7c-461b-8c75-426b6958f6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:08.788616 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250a98a-9d7c-461b-8c75-426b6958f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:08.788885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250a98a-9d7c-461b-8c75-426b6958f6c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:08.789578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250a98a-9d7c-461b-8c75-426b6958f6c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:08.791448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250a98a-9d7c-461b-8c75-426b6958f6c6 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:08.815942 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 955/1921] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:08 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:08.819983 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bb669-7ee3-4ea7-b1a4-4c6019c29bef admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:08.829640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bb669-7ee3-4ea7-b1a4-4c6019c29bef admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:08.882323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18598a-9552-434a-9782-fb3297d72ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:08.882907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18598a-9552-434a-9782-fb3297d72ffb admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:08.883183 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18598a-9552-434a-9782-fb3297d72ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:08.883454 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18598a-9552-434a-9782-fb3297d72ffb admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:08.884161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18598a-9552-434a-9782-fb3297d72ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:08.886048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18598a-9552-434a-9782-fb3297d72ffb admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:08.910152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 967/1922] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:08 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:08.911875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250a98a-9d7c-461b-8c75-426b6958f6c6 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:08.924180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250a98a-9d7c-461b-8c75-426b6958f6c6 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:08.933443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c853d6-f1fa-49b2-8539-8b2ee2528ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:08.934410 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c853d6-f1fa-49b2-8539-8b2ee2528ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:08.934664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c853d6-f1fa-49b2-8539-8b2ee2528ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:08.934934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c853d6-f1fa-49b2-8539-8b2ee2528ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:08.935663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c853d6-f1fa-49b2-8539-8b2ee2528ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:08.937326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c853d6-f1fa-49b2-8539-8b2ee2528ff1 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:08.951882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 956/1923] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:08.952972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18598a-9552-434a-9782-fb3297d72ffb admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:08.963359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18598a-9552-434a-9782-fb3297d72ffb admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:08.972732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933b69e-7e58-4da0-bf6f-5f4a1880ec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:08.973615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933b69e-7e58-4da0-bf6f-5f4a1880ec37 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:08.974092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933b69e-7e58-4da0-bf6f-5f4a1880ec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:08.974519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933b69e-7e58-4da0-bf6f-5f4a1880ec37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:08.975286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933b69e-7e58-4da0-bf6f-5f4a1880ec37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:08.976901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933b69e-7e58-4da0-bf6f-5f4a1880ec37 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:08.987729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 968/1924] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:08.991903 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c853d6-f1fa-49b2-8539-8b2ee2528ff1 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:09.002076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c853d6-f1fa-49b2-8539-8b2ee2528ff1 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:09.007512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f1c00-2fc3-40fd-b506-46b468fe495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:09.008435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f1c00-2fc3-40fd-b506-46b468fe495a admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:09.008715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f1c00-2fc3-40fd-b506-46b468fe495a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:09.008990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f1c00-2fc3-40fd-b506-46b468fe495a admin admin] PATH_INFO: `/v3/projects/4a22da8a01cc4bf1a7d1d1ae67cf5ede/users/c6886e9997b1444e84aa15ac8f150f85/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:09.026187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f1c00-2fc3-40fd-b506-46b468fe495a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a22da8a01cc4bf1a7d1d1ae67cf5ede, user_id=c6886e9997b1444e84aa15ac8f150f85, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:09.029542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f1c00-2fc3-40fd-b506-46b468fe495a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:09.049334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 957/1925] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:08 2022] PUT /identity/v3/projects/4a22da8a01cc4bf1a7d1d1ae67cf5ede/users/c6886e9997b1444e84aa15ac8f150f85/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:09.061340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e5f39-4367-4b35-9c7a-9d7152946ed9 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:09.061621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e5f39-4367-4b35-9c7a-9d7152946ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:09.061888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e5f39-4367-4b35-9c7a-9d7152946ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:09.089271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-a61e5f39-4367-4b35-9c7a-9d7152946ed9 None None] MFA Rules not processed for user `c6886e9997b1444e84aa15ac8f150f85`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:09.090812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a61e5f39-4367-4b35-9c7a-9d7152946ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:09.163235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 969/1926] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:09.173896 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f1c00-2fc3-40fd-b506-46b468fe495a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:09.175655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-822f1c00-2fc3-40fd-b506-46b468fe495a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:09.243506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f1c00-2fc3-40fd-b506-46b468fe495a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:09.247171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0125d2b-854b-45ce-8c6d-75af6dc21914 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1848679bce324613b4a92de808165ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:09.247841 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0125d2b-854b-45ce-8c6d-75af6dc21914 service glance] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:09.248145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0125d2b-854b-45ce-8c6d-75af6dc21914 service glance] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:09.248420 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0125d2b-854b-45ce-8c6d-75af6dc21914 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:09.256312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0125d2b-854b-45ce-8c6d-75af6dc21914 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:09.257725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0125d2b-854b-45ce-8c6d-75af6dc21914 service glance] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:09.266690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 958/1927] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:12:10.704358 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e5f39-4367-4b35-9c7a-9d7152946ed9 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:10.708801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a61e5f39-4367-4b35-9c7a-9d7152946ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:10.870855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e5f39-4367-4b35-9c7a-9d7152946ed9 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:10.876577 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:10.877666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:10.878095 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:10.878587 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] PATH_INFO: `/v3/users/c713bdbd51604ada8bfb37fcf8815a93` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:10.880153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c713bdbd51604ada8bfb37fcf8815a93)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:10.882695 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:10.962655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c713bdbd51604ada8bfb37fcf8815a93'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:10.970756 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c713bdbd51604ada8bfb37fcf8815a93'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:10.971619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c713bdbd51604ada8bfb37fcf8815a93'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:10.972448 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c713bdbd51604ada8bfb37fcf8815a93'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:10.985948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c713bdbd51604ada8bfb37fcf8815a93'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:11.020366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 970/1928] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:10 2022] DELETE /identity/v3/users/c713bdbd51604ada8bfb37fcf8815a93 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:11.024517 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a7f66-8a44-4c8d-b0f5-4c046b4f3bda None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:11.025018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a7f66-8a44-4c8d-b0f5-4c046b4f3bda None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:11.025099 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a7f66-8a44-4c8d-b0f5-4c046b4f3bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:11.054295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a62a7f66-8a44-4c8d-b0f5-4c046b4f3bda None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:11.057700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a62a7f66-8a44-4c8d-b0f5-4c046b4f3bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:11.179090 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 959/1929] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:11.196304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:11.197789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:11.221514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a7f66-8a44-4c8d-b0f5-4c046b4f3bda None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:11.223052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a62a7f66-8a44-4c8d-b0f5-4c046b4f3bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:11.226839 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59900be6-ed12-40bd-ac65-fb072c424661 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:11.250977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:11.252053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:11.252162 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:11.252437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] PATH_INFO: `/v3/users/203b1cc9b7be474497f8b134b212e5bb` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:11.255201 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] RBAC: Authorizing `identity:delete_user(user_id=203b1cc9b7be474497f8b134b212e5bb)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:11.257147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:11.365390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a7f66-8a44-4c8d-b0f5-4c046b4f3bda None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:11.375553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '203b1cc9b7be474497f8b134b212e5bb'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:11.375930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b79b6-c005-4858-8de6-a1f231a5f650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:11.380256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b79b6-c005-4858-8de6-a1f231a5f650 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:11.380702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b79b6-c005-4858-8de6-a1f231a5f650 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:11.381112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b79b6-c005-4858-8de6-a1f231a5f650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:11.396546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '203b1cc9b7be474497f8b134b212e5bb'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:11.397235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '203b1cc9b7be474497f8b134b212e5bb'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:11.397848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '203b1cc9b7be474497f8b134b212e5bb'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:11.398579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b79b6-c005-4858-8de6-a1f231a5f650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:11.401678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b79b6-c005-4858-8de6-a1f231a5f650 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:11.420280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '203b1cc9b7be474497f8b134b212e5bb'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:11.425100 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 960/1930] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:12:11.439033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 971/1931] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:11 2022] DELETE /identity/v3/users/203b1cc9b7be474497f8b134b212e5bb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:11.445122 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80767d98-3641-4873-9306-66c13fa71ffa None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:11.445593 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80767d98-3641-4873-9306-66c13fa71ffa None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:11.446009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80767d98-3641-4873-9306-66c13fa71ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:11.466167 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-80767d98-3641-4873-9306-66c13fa71ffa None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:11.467547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-80767d98-3641-4873-9306-66c13fa71ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:11.549233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 961/1932] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:11.561658 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:11.563218 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:11.649479 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0bf37-56ce-4908-9be8-f2840176d71d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:11.655581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98778c76-9808-4d18-9335-f0d128e91f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:11.656889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98778c76-9808-4d18-9335-f0d128e91f62 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:11.657277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98778c76-9808-4d18-9335-f0d128e91f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:11.657745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98778c76-9808-4d18-9335-f0d128e91f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:11.668403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98778c76-9808-4d18-9335-f0d128e91f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:11.670877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98778c76-9808-4d18-9335-f0d128e91f62 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:11.681149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 972/1933] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:12.141705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f6423-d087-44df-af1f-b2851a50665f None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:12.142248 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f6423-d087-44df-af1f-b2851a50665f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:12.142592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f6423-d087-44df-af1f-b2851a50665f None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:12.144204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 962/1934] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 09:12:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:12:12.154971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02688-2116-45f2-b33f-ae51829faf4f None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:12.155509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02688-2116-45f2-b33f-ae51829faf4f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:12.155509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02688-2116-45f2-b33f-ae51829faf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:12.176970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-24d02688-2116-45f2-b33f-ae51829faf4f None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:12.178169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-24d02688-2116-45f2-b33f-ae51829faf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:12.239546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f6423-d087-44df-af1f-b2851a50665f None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:12.241671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-663f6423-d087-44df-af1f-b2851a50665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:12.259229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f6423-d087-44df-af1f-b2851a50665f None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:12.264935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:12.266319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:12.267781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:12.268286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] PATH_INFO: `/v3/projects/a168fb5ed6ef40e0a5c6a132daa2e7ca` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:12.270298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a168fb5ed6ef40e0a5c6a132daa2e7ca)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:12.272958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:12.312395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 973/1935] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 09:12:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:12.329351 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d02688-2116-45f2-b33f-ae51829faf4f None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:12.332031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-24d02688-2116-45f2-b33f-ae51829faf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:12.348043 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a168fb5ed6ef40e0a5c6a132daa2e7ca', 'request_id': 'req-04c1e775-6884-4642-8377-be3e402d3473'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.353239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d02688-2116-45f2-b33f-ae51829faf4f None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:12.354705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a168fb5ed6ef40e0a5c6a132daa2e7ca', 'request_id': 'req-04c1e775-6884-4642-8377-be3e402d3473'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.365416 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a168fb5ed6ef40e0a5c6a132daa2e7ca', 'request_id': 'req-04c1e775-6884-4642-8377-be3e402d3473'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.390778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] The token cache is being invalidate because project a168fb5ed6ef40e0a5c6a132daa2e7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:12.391244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.392113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.394640 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 963/1936] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:12 2022] DELETE /identity/v3/projects/a168fb5ed6ef40e0a5c6a132daa2e7ca => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:12.398130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:12.399661 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:12.449900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf6b72-46a7-4739-9116-c19060294f92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:12.451142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf6b72-46a7-4739-9116-c19060294f92 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:12.451405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf6b72-46a7-4739-9116-c19060294f92 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:12.451677 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf6b72-46a7-4739-9116-c19060294f92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:12.453527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4baf6b72-46a7-4739-9116-c19060294f92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:12.469733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf6b72-46a7-4739-9116-c19060294f92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:12.471315 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf6b72-46a7-4739-9116-c19060294f92 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:12.482302 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 974/1937] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:12.483135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf6b72-46a7-4739-9116-c19060294f92 service nova] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:12.484538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4baf6b72-46a7-4739-9116-c19060294f92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:12.500837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1e775-6884-4642-8377-be3e402d3473 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:12.506409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:12.507815 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:12.508122 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:12.508406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] PATH_INFO: `/v3/users/4b499a7a917245219ae39436602cc231` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:12.509757 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b499a7a917245219ae39436602cc231)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:12.510092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf6b72-46a7-4739-9116-c19060294f92 service nova] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:12.517373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:12.523694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:12.524755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:12.525040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:12.525317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] PATH_INFO: `/v3/projects/9ab231d3531843ed82d47ffb4671874a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:12.526941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab231d3531843ed82d47ffb4671874a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:12.528952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:12.600063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab231d3531843ed82d47ffb4671874a', 'request_id': 'req-616017f9-8b57-4c5c-b2b7-75f01783a3d0'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.609664 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab231d3531843ed82d47ffb4671874a', 'request_id': 'req-616017f9-8b57-4c5c-b2b7-75f01783a3d0'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.617927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b499a7a917245219ae39436602cc231'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.618559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab231d3531843ed82d47ffb4671874a', 'request_id': 'req-616017f9-8b57-4c5c-b2b7-75f01783a3d0'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.630083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b499a7a917245219ae39436602cc231'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.636355 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] The token cache is being invalidate because project 9ab231d3531843ed82d47ffb4671874a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:12.637094 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.638784 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.641368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 975/1938] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:12 2022] DELETE /identity/v3/projects/9ab231d3531843ed82d47ffb4671874a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:12.642967 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b499a7a917245219ae39436602cc231'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.643810 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b499a7a917245219ae39436602cc231'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.644458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b499a7a917245219ae39436602cc231'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.645574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:12.649711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:12.667475 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 964/1939] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:12 2022] DELETE /identity/v3/users/4b499a7a917245219ae39436602cc231 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:12.754317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616017f9-8b57-4c5c-b2b7-75f01783a3d0 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:12.860215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81555af-52f3-4112-99e9-4aaf3e308083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:12.861393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81555af-52f3-4112-99e9-4aaf3e308083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:12.861393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81555af-52f3-4112-99e9-4aaf3e308083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:12.861648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81555af-52f3-4112-99e9-4aaf3e308083 admin admin] PATH_INFO: `/v3/users/5c8e559f4d7f4712b14567eaa5e5e813` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:12.862884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81555af-52f3-4112-99e9-4aaf3e308083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c8e559f4d7f4712b14567eaa5e5e813)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:12.874388 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81555af-52f3-4112-99e9-4aaf3e308083 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:12.941286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e81555af-52f3-4112-99e9-4aaf3e308083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c8e559f4d7f4712b14567eaa5e5e813'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.949583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e81555af-52f3-4112-99e9-4aaf3e308083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c8e559f4d7f4712b14567eaa5e5e813'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.950574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e81555af-52f3-4112-99e9-4aaf3e308083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c8e559f4d7f4712b14567eaa5e5e813'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.951594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e81555af-52f3-4112-99e9-4aaf3e308083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c8e559f4d7f4712b14567eaa5e5e813'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:12.973601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e81555af-52f3-4112-99e9-4aaf3e308083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c8e559f4d7f4712b14567eaa5e5e813'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:13.001416 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 976/1940] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:12 2022] DELETE /identity/v3/users/5c8e559f4d7f4712b14567eaa5e5e813 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:13.179030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:13.181039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:13.212021 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089983da-06e5-402a-bf7b-26a72b908350 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:13.288977 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:13.289951 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.290306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.290680 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] PATH_INFO: `/v3/projects/6f4e17b17bf34991b1b56a3f85cd6db0` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.291985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f4e17b17bf34991b1b56a3f85cd6db0)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:13.293999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:13.344572 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4e17b17bf34991b1b56a3f85cd6db0', 'request_id': 'req-5da23f16-5485-4034-8fb2-f23a19734706'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:13.350216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4e17b17bf34991b1b56a3f85cd6db0', 'request_id': 'req-5da23f16-5485-4034-8fb2-f23a19734706'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:13.360454 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4e17b17bf34991b1b56a3f85cd6db0', 'request_id': 'req-5da23f16-5485-4034-8fb2-f23a19734706'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:13.375363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] The token cache is being invalidate because project 6f4e17b17bf34991b1b56a3f85cd6db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:13.375544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:13.376210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:13.377778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 965/1941] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:13 2022] DELETE /identity/v3/projects/6f4e17b17bf34991b1b56a3f85cd6db0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:13.382866 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d54e1-0921-4726-93b7-f51c915c2f19 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.383356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d54e1-0921-4726-93b7-f51c915c2f19 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.383432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d54e1-0921-4726-93b7-f51c915c2f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.404131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f95d54e1-0921-4726-93b7-f51c915c2f19 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:13.405378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f95d54e1-0921-4726-93b7-f51c915c2f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:13.410376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:13.411907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:13.476863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 977/1942] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:13.485215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8dd1a-90f4-4f12-a68f-a1500ac97c43 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.485507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8dd1a-90f4-4f12-a68f-a1500ac97c43 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.485800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8dd1a-90f4-4f12-a68f-a1500ac97c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.493659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da23f16-5485-4034-8fb2-f23a19734706 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:13.498317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fe118-ff8d-4bb3-aaaa-40b486249565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:13.499207 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fe118-ff8d-4bb3-aaaa-40b486249565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.499487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fe118-ff8d-4bb3-aaaa-40b486249565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.499760 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fe118-ff8d-4bb3-aaaa-40b486249565 admin admin] PATH_INFO: `/v3/projects/6305859c33924ed083fecb0ac92ec30f` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.500984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fe118-ff8d-4bb3-aaaa-40b486249565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6305859c33924ed083fecb0ac92ec30f)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:13.502908 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fe118-ff8d-4bb3-aaaa-40b486249565 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:13.504715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-93f8dd1a-90f4-4f12-a68f-a1500ac97c43 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:13.505912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-93f8dd1a-90f4-4f12-a68f-a1500ac97c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:13.514498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 978/1943] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:13.519027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8dd1a-90f4-4f12-a68f-a1500ac97c43 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:13.531059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8dd1a-90f4-4f12-a68f-a1500ac97c43 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:13.536364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08648b6-0a5e-4c86-85ac-dd90eff67c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:13.537027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08648b6-0a5e-4c86-85ac-dd90eff67c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.537466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08648b6-0a5e-4c86-85ac-dd90eff67c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.537741 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08648b6-0a5e-4c86-85ac-dd90eff67c2f admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.538567 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08648b6-0a5e-4c86-85ac-dd90eff67c2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:13.538923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08648b6-0a5e-4c86-85ac-dd90eff67c2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:13.540977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08648b6-0a5e-4c86-85ac-dd90eff67c2f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:13.558913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 979/1944] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:12:13.559281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f88fe118-ff8d-4bb3-aaaa-40b486249565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6305859c33924ed083fecb0ac92ec30f', 'request_id': 'req-f88fe118-ff8d-4bb3-aaaa-40b486249565'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:13.559903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08648b6-0a5e-4c86-85ac-dd90eff67c2f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:13.564692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f88fe118-ff8d-4bb3-aaaa-40b486249565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6305859c33924ed083fecb0ac92ec30f', 'request_id': 'req-f88fe118-ff8d-4bb3-aaaa-40b486249565'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:13.569800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08648b6-0a5e-4c86-85ac-dd90eff67c2f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:13.574791 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f88fe118-ff8d-4bb3-aaaa-40b486249565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6305859c33924ed083fecb0ac92ec30f', 'request_id': 'req-f88fe118-ff8d-4bb3-aaaa-40b486249565'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:13.589573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f88fe118-ff8d-4bb3-aaaa-40b486249565 admin admin] The token cache is being invalidate because project 6305859c33924ed083fecb0ac92ec30f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:13.589853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f88fe118-ff8d-4bb3-aaaa-40b486249565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:13.590520 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f88fe118-ff8d-4bb3-aaaa-40b486249565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:13.592666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 966/1945] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:13 2022] DELETE /identity/v3/projects/6305859c33924ed083fecb0ac92ec30f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:13.597325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038da85-8746-422b-82af-04beb785d393 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.597609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038da85-8746-422b-82af-04beb785d393 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.597883 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038da85-8746-422b-82af-04beb785d393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.616306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5038da85-8746-422b-82af-04beb785d393 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:13.617528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5038da85-8746-422b-82af-04beb785d393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:13.631461 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f6c4e-0a38-4805-b132-4821cdba8367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:13.632209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f6c4e-0a38-4805-b132-4821cdba8367 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.632497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f6c4e-0a38-4805-b132-4821cdba8367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.632805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f6c4e-0a38-4805-b132-4821cdba8367 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.633465 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f6c4e-0a38-4805-b132-4821cdba8367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:13.635357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f6c4e-0a38-4805-b132-4821cdba8367 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:13.665002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 980/1946] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:13 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:13.669444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f6c4e-0a38-4805-b132-4821cdba8367 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:13.671047 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e00f6c4e-0a38-4805-b132-4821cdba8367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:13.688235 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 967/1947] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:13.690684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b366-6871-49f1-a7ea-4dd336127f2e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.690971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b366-6871-49f1-a7ea-4dd336127f2e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.691242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b366-6871-49f1-a7ea-4dd336127f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.714424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-9731b366-6871-49f1-a7ea-4dd336127f2e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:13.715637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9731b366-6871-49f1-a7ea-4dd336127f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:13.744460 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f6c4e-0a38-4805-b132-4821cdba8367 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:13.753199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35414807-5b7b-4670-b307-b489baf7f6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:13.753910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35414807-5b7b-4670-b307-b489baf7f6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.754204 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35414807-5b7b-4670-b307-b489baf7f6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.754478 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35414807-5b7b-4670-b307-b489baf7f6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.755199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35414807-5b7b-4670-b307-b489baf7f6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:13.757197 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35414807-5b7b-4670-b307-b489baf7f6e2 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:13.781600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 981/1948] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:13 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:13.785630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35414807-5b7b-4670-b307-b489baf7f6e2 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:13.791933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 968/1949] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:13.795974 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b366-6871-49f1-a7ea-4dd336127f2e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:13.799497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35414807-5b7b-4670-b307-b489baf7f6e2 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:13.805664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b366-6871-49f1-a7ea-4dd336127f2e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:13.805983 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638396a-2a9d-41ec-a05f-c7e1685438fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:13.806834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638396a-2a9d-41ec-a05f-c7e1685438fe admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.807305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638396a-2a9d-41ec-a05f-c7e1685438fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.807650 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638396a-2a9d-41ec-a05f-c7e1685438fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.808981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638396a-2a9d-41ec-a05f-c7e1685438fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:13.810896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638396a-2a9d-41ec-a05f-c7e1685438fe admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:13.811351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a87d02-f0fe-4462-aa17-cf3161c1fa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:13.812069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a87d02-f0fe-4462-aa17-cf3161c1fa01 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.812454 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a87d02-f0fe-4462-aa17-cf3161c1fa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.812713 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a87d02-f0fe-4462-aa17-cf3161c1fa01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.813822 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a87d02-f0fe-4462-aa17-cf3161c1fa01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:13.814132 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a87d02-f0fe-4462-aa17-cf3161c1fa01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:13.815784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a87d02-f0fe-4462-aa17-cf3161c1fa01 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:13.828784 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 982/1950] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:13.829611 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638396a-2a9d-41ec-a05f-c7e1685438fe admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:13.830699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 969/1951] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:12:13.836292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a87d02-f0fe-4462-aa17-cf3161c1fa01 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:13.840027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638396a-2a9d-41ec-a05f-c7e1685438fe admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:13.847738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a87d02-f0fe-4462-aa17-cf3161c1fa01 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:13.850472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9f5db-57cc-4a9f-b608-9d8f284e6217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:13.851216 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9f5db-57cc-4a9f-b608-9d8f284e6217 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.851500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9f5db-57cc-4a9f-b608-9d8f284e6217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.851933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9f5db-57cc-4a9f-b608-9d8f284e6217 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.852772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9f5db-57cc-4a9f-b608-9d8f284e6217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:13.853926 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefe53d-e485-4088-870c-ccd02d05d726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:13.854574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9f5db-57cc-4a9f-b608-9d8f284e6217 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:13.854692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefe53d-e485-4088-870c-ccd02d05d726 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.854906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefe53d-e485-4088-870c-ccd02d05d726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.855190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefe53d-e485-4088-870c-ccd02d05d726 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.856236 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefe53d-e485-4088-870c-ccd02d05d726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:13.858560 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefe53d-e485-4088-870c-ccd02d05d726 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:13.869080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 983/1952] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:13.876683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9f5db-57cc-4a9f-b608-9d8f284e6217 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:13.891333 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9f5db-57cc-4a9f-b608-9d8f284e6217 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:13.896124 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 970/1953] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:13 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:13.897057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ccda5-9dad-4f80-ba4e-1c955973028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:13.897952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ccda5-9dad-4f80-ba4e-1c955973028a admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:13.898230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ccda5-9dad-4f80-ba4e-1c955973028a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:13.898503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ccda5-9dad-4f80-ba4e-1c955973028a admin admin] PATH_INFO: `/v3/projects/952eeb1a63184eb2bf70b2352f28ca1b/users/0b71f8159da64abfa57fc7b2e54dafb9/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:13.899577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefe53d-e485-4088-870c-ccd02d05d726 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:13.901187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5eefe53d-e485-4088-870c-ccd02d05d726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:13.917435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ccda5-9dad-4f80-ba4e-1c955973028a admin admin] RBAC: Authorizing `identity:create_grant(project_id=952eeb1a63184eb2bf70b2352f28ca1b, user_id=0b71f8159da64abfa57fc7b2e54dafb9, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:13.920842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ccda5-9dad-4f80-ba4e-1c955973028a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:13.941348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 984/1954] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:13 2022] PUT /identity/v3/projects/952eeb1a63184eb2bf70b2352f28ca1b/users/0b71f8159da64abfa57fc7b2e54dafb9/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:13.942850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ccda5-9dad-4f80-ba4e-1c955973028a admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:13.995953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefe53d-e485-4088-870c-ccd02d05d726 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:14.030318 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ccda5-9dad-4f80-ba4e-1c955973028a admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:14.036442 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2decb09-4119-4569-bae1-b537e639e4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:14.037798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2decb09-4119-4569-bae1-b537e639e4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.038099 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2decb09-4119-4569-bae1-b537e639e4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.038383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2decb09-4119-4569-bae1-b537e639e4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.039198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2decb09-4119-4569-bae1-b537e639e4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:14.041331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2decb09-4119-4569-bae1-b537e639e4a4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:14.079687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 985/1955] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:13 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:14.079687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe31d1-2976-4205-946c-660b716d9b40 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.079687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe31d1-2976-4205-946c-660b716d9b40 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.079687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe31d1-2976-4205-946c-660b716d9b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.091127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:14.092108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.092419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.093226 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] PATH_INFO: `/v3/users/cbc57f4f062d46e49042cd7c7d3d89fa` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.095673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc57f4f062d46e49042cd7c7d3d89fa)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:14.097546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:14.119432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-a4fe31d1-2976-4205-946c-660b716d9b40 None None] MFA Rules not processed for user `0b71f8159da64abfa57fc7b2e54dafb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:14.120712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a4fe31d1-2976-4205-946c-660b716d9b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:14.205036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc57f4f062d46e49042cd7c7d3d89fa'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:14.239104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc57f4f062d46e49042cd7c7d3d89fa'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:14.248131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc57f4f062d46e49042cd7c7d3d89fa'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:14.253123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc57f4f062d46e49042cd7c7d3d89fa'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:14.254702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc57f4f062d46e49042cd7c7d3d89fa'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:14.269052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 986/1956] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:14.272379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe31d1-2976-4205-946c-660b716d9b40 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:14.285514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe31d1-2976-4205-946c-660b716d9b40 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:14.294999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a7919-82ce-4c79-9efd-3e3d9c3ff024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:14.296634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a7919-82ce-4c79-9efd-3e3d9c3ff024 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.297028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a7919-82ce-4c79-9efd-3e3d9c3ff024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.297773 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a7919-82ce-4c79-9efd-3e3d9c3ff024 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.300164 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a7919-82ce-4c79-9efd-3e3d9c3ff024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:14.301820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a7919-82ce-4c79-9efd-3e3d9c3ff024 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:14.306119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 971/1957] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:13 2022] DELETE /identity/v3/users/cbc57f4f062d46e49042cd7c7d3d89fa => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:14.311435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:14.313334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:14.322099 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 987/1958] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:14.322099 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79957bc7-dccc-4f58-893f-507d218bc320 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.322099 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79957bc7-dccc-4f58-893f-507d218bc320 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.322099 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79957bc7-dccc-4f58-893f-507d218bc320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.347255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-79957bc7-dccc-4f58-893f-507d218bc320 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:14.349678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-79957bc7-dccc-4f58-893f-507d218bc320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:14.445212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a40c1f-9692-458c-b93e-2a9899172840 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:14.450459 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce39f4-632b-4ec2-b1cb-19c73f747d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:14.451479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce39f4-632b-4ec2-b1cb-19c73f747d94 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.454249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 988/1959] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:14.459693 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79957bc7-dccc-4f58-893f-507d218bc320 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:14.461695 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-79957bc7-dccc-4f58-893f-507d218bc320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:14.464027 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce39f4-632b-4ec2-b1cb-19c73f747d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.466120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce39f4-632b-4ec2-b1cb-19c73f747d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.469350 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce39f4-632b-4ec2-b1cb-19c73f747d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:14.471476 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce39f4-632b-4ec2-b1cb-19c73f747d94 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:14.476097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79957bc7-dccc-4f58-893f-507d218bc320 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:14.483187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1ea24-a618-4287-aca7-d99d37b1c590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:14.483974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1ea24-a618-4287-aca7-d99d37b1c590 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.484382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1ea24-a618-4287-aca7-d99d37b1c590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.484748 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1ea24-a618-4287-aca7-d99d37b1c590 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.486495 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1ea24-a618-4287-aca7-d99d37b1c590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:14.488815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1ea24-a618-4287-aca7-d99d37b1c590 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:14.505174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 989/1960] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:14.505893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1ea24-a618-4287-aca7-d99d37b1c590 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:14.512816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-17f1ea24-a618-4287-aca7-d99d37b1c590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:14.534674 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 972/1961] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:14 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:14.534674 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce39f4-632b-4ec2-b1cb-19c73f747d94 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:14.673829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1ea24-a618-4287-aca7-d99d37b1c590 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:14.674067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce39f4-632b-4ec2-b1cb-19c73f747d94 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:14.679480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361be06-a1a9-4bcd-b9db-7be6ccb4ded0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:14.680409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361be06-a1a9-4bcd-b9db-7be6ccb4ded0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.680687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361be06-a1a9-4bcd-b9db-7be6ccb4ded0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.680987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361be06-a1a9-4bcd-b9db-7be6ccb4ded0 admin admin] PATH_INFO: `/v3/projects/5d743b657c3645fdbe3aaf3ad9735c5a/users/eb49ee43f06b4f999dd00e87d52fb31c/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.700415 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361be06-a1a9-4bcd-b9db-7be6ccb4ded0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d743b657c3645fdbe3aaf3ad9735c5a, user_id=eb49ee43f06b4f999dd00e87d52fb31c, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:14.701442 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361be06-a1a9-4bcd-b9db-7be6ccb4ded0 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:14.717120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 973/1962] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:14 2022] PUT /identity/v3/projects/5d743b657c3645fdbe3aaf3ad9735c5a/users/eb49ee43f06b4f999dd00e87d52fb31c/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:14.721863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361be06-a1a9-4bcd-b9db-7be6ccb4ded0 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:14.736610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ec2b6-8d78-40cc-815a-1bd81ed0eceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:14.736610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ec2b6-8d78-40cc-815a-1bd81ed0eceb service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.736610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ec2b6-8d78-40cc-815a-1bd81ed0eceb service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.736610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ec2b6-8d78-40cc-815a-1bd81ed0eceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.746850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ec2b6-8d78-40cc-815a-1bd81ed0eceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:14.748411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ec2b6-8d78-40cc-815a-1bd81ed0eceb service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:14.759480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 990/1963] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:14.760956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc86664-57c5-4283-987e-3d6da6a206e4 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.761242 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc86664-57c5-4283-987e-3d6da6a206e4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.761533 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc86664-57c5-4283-987e-3d6da6a206e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.797062 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-9fc86664-57c5-4283-987e-3d6da6a206e4 None None] MFA Rules not processed for user `eb49ee43f06b4f999dd00e87d52fb31c`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:14.798334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9fc86664-57c5-4283-987e-3d6da6a206e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:14.804621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361be06-a1a9-4bcd-b9db-7be6ccb4ded0 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:14.809709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf5566-0f62-41af-92e5-10e11e669773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:14.813471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf5566-0f62-41af-92e5-10e11e669773 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.813471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf5566-0f62-41af-92e5-10e11e669773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.813471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf5566-0f62-41af-92e5-10e11e669773 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.813471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf5566-0f62-41af-92e5-10e11e669773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:14.813882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf5566-0f62-41af-92e5-10e11e669773 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:14.837464 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 974/1964] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:14 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:14.838488 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf5566-0f62-41af-92e5-10e11e669773 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:14.851097 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf5566-0f62-41af-92e5-10e11e669773 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:14.857689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d9a76-664d-4de1-9e00-14a1cc7d6efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:14.859597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d9a76-664d-4de1-9e00-14a1cc7d6efd admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.859824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d9a76-664d-4de1-9e00-14a1cc7d6efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.860212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d9a76-664d-4de1-9e00-14a1cc7d6efd admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.862750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d9a76-664d-4de1-9e00-14a1cc7d6efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:14.864495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d9a76-664d-4de1-9e00-14a1cc7d6efd admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:14.880281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 975/1965] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:14.881831 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d9a76-664d-4de1-9e00-14a1cc7d6efd admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:14.894495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d9a76-664d-4de1-9e00-14a1cc7d6efd admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:14.897992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 991/1966] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:14.902112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a05512-76ef-4f02-8cf0-0fc01559189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:14.902558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc86664-57c5-4283-987e-3d6da6a206e4 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:14.903022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a05512-76ef-4f02-8cf0-0fc01559189b admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.903286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a05512-76ef-4f02-8cf0-0fc01559189b admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.904169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a05512-76ef-4f02-8cf0-0fc01559189b admin admin] PATH_INFO: `/v3/projects/432e01f276ae423ebd93e8a88637e620/users/cdf2294f60554689971d43ad384c7699/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.915797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc86664-57c5-4283-987e-3d6da6a206e4 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:14.924320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea759f-c748-46b3-ac69-fddea74aba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:14.924631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a05512-76ef-4f02-8cf0-0fc01559189b admin admin] RBAC: Authorizing `identity:create_grant(project_id=432e01f276ae423ebd93e8a88637e620, user_id=cdf2294f60554689971d43ad384c7699, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:14.925540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea759f-c748-46b3-ac69-fddea74aba27 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:14.926110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea759f-c748-46b3-ac69-fddea74aba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:14.926587 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea759f-c748-46b3-ac69-fddea74aba27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:14.927271 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a05512-76ef-4f02-8cf0-0fc01559189b admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:14.927697 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea759f-c748-46b3-ac69-fddea74aba27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:14.930229 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea759f-c748-46b3-ac69-fddea74aba27 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:14.946639 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 976/1967] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:14 2022] PUT /identity/v3/projects/432e01f276ae423ebd93e8a88637e620/users/cdf2294f60554689971d43ad384c7699/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:14.953392 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a05512-76ef-4f02-8cf0-0fc01559189b admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:14.961921 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 992/1968] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:14 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:14.965745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea759f-c748-46b3-ac69-fddea74aba27 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:15.031478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a05512-76ef-4f02-8cf0-0fc01559189b admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:15.036585 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a3394-c5f7-4943-b39d-3f36aade6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:15.037234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3394-c5f7-4943-b39d-3f36aade6db8 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.037516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3394-c5f7-4943-b39d-3f36aade6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.037799 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3394-c5f7-4943-b39d-3f36aade6db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.037901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea759f-c748-46b3-ac69-fddea74aba27 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:15.040208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a3394-c5f7-4943-b39d-3f36aade6db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:15.041766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a3394-c5f7-4943-b39d-3f36aade6db8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:15.048649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79e931-0f13-4d69-90b6-a6592fedb323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:15.049353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79e931-0f13-4d69-90b6-a6592fedb323 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.049624 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79e931-0f13-4d69-90b6-a6592fedb323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.049905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79e931-0f13-4d69-90b6-a6592fedb323 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.050610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79e931-0f13-4d69-90b6-a6592fedb323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:15.054110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 977/1969] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:15.054662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79e931-0f13-4d69-90b6-a6592fedb323 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:15.057595 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a3394-c5f7-4943-b39d-3f36aade6db8 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:15.070523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a3394-c5f7-4943-b39d-3f36aade6db8 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:15.079818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56387fa-eae0-4a59-ba94-54f5fc40e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:15.080577 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 993/1970] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:14 2022] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:15.081979 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56387fa-eae0-4a59-ba94-54f5fc40e24f admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.082438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56387fa-eae0-4a59-ba94-54f5fc40e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.082770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56387fa-eae0-4a59-ba94-54f5fc40e24f admin admin] PATH_INFO: `/v3/projects/432e01f276ae423ebd93e8a88637e620/users/cdf2294f60554689971d43ad384c7699/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.085314 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79e931-0f13-4d69-90b6-a6592fedb323 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:15.086159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56387fa-eae0-4a59-ba94-54f5fc40e24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=432e01f276ae423ebd93e8a88637e620, user_id=cdf2294f60554689971d43ad384c7699, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:15.089115 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56387fa-eae0-4a59-ba94-54f5fc40e24f admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:15.097335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79e931-0f13-4d69-90b6-a6592fedb323 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:15.101571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 978/1971] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:15 2022] PUT /identity/v3/projects/432e01f276ae423ebd93e8a88637e620/users/cdf2294f60554689971d43ad384c7699/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:15.112175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b5d49-54d8-4155-b09d-d72ee49a4b12 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.112451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b5d49-54d8-4155-b09d-d72ee49a4b12 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.112721 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b5d49-54d8-4155-b09d-d72ee49a4b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.146627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-190b5d49-54d8-4155-b09d-d72ee49a4b12 None None] MFA Rules not processed for user `cdf2294f60554689971d43ad384c7699`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:15.147708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-190b5d49-54d8-4155-b09d-d72ee49a4b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:15.180987 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bbfdd-83be-4e0a-8d1b-80cb3455199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:15.181656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bbfdd-83be-4e0a-8d1b-80cb3455199d admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.181949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bbfdd-83be-4e0a-8d1b-80cb3455199d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.182225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bbfdd-83be-4e0a-8d1b-80cb3455199d admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.182956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bbfdd-83be-4e0a-8d1b-80cb3455199d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:15.184937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bbfdd-83be-4e0a-8d1b-80cb3455199d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:15.194925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 994/1972] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:15.195634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bbfdd-83be-4e0a-8d1b-80cb3455199d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:15.197497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-636bbfdd-83be-4e0a-8d1b-80cb3455199d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:15.217934 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bbfdd-83be-4e0a-8d1b-80cb3455199d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:15.220004 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 979/1973] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:15.220924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b5d49-54d8-4155-b09d-d72ee49a4b12 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:15.233443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b5d49-54d8-4155-b09d-d72ee49a4b12 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:15.233588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:15.233943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.234224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.234503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] PATH_INFO: `/v3/projects/47c882c9694745a9b8ea966ccdaa7788` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.235939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c882c9694745a9b8ea966ccdaa7788)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:15.237917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:15.238195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932b443-de8c-4742-a765-d324c9aba7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:15.239080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932b443-de8c-4742-a765-d324c9aba7be admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.239453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932b443-de8c-4742-a765-d324c9aba7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.239640 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932b443-de8c-4742-a765-d324c9aba7be admin admin] PATH_INFO: `/v3/projects/8aae56fc5b234a319d16d7a8b41a3767/users/6cbb6d95417047b6ac4c580ff436ae98/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.255017 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932b443-de8c-4742-a765-d324c9aba7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aae56fc5b234a319d16d7a8b41a3767, user_id=6cbb6d95417047b6ac4c580ff436ae98, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:15.257950 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932b443-de8c-4742-a765-d324c9aba7be admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:15.273137 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 980/1974] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:15 2022] PUT /identity/v3/projects/8aae56fc5b234a319d16d7a8b41a3767/users/6cbb6d95417047b6ac4c580ff436ae98/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:15.274758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932b443-de8c-4742-a765-d324c9aba7be admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:15.280163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1932b443-de8c-4742-a765-d324c9aba7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:15.291361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c882c9694745a9b8ea966ccdaa7788', 'request_id': 'req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:15.300183 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c882c9694745a9b8ea966ccdaa7788', 'request_id': 'req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:15.307522 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c882c9694745a9b8ea966ccdaa7788', 'request_id': 'req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:15.319698 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] The token cache is being invalidate because project 47c882c9694745a9b8ea966ccdaa7788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:15.319974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:15.320662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:15.322447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 995/1975] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:15 2022] DELETE /identity/v3/projects/47c882c9694745a9b8ea966ccdaa7788 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:15.323008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:15.324396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:15.353933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932b443-de8c-4742-a765-d324c9aba7be admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:15.395429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8cea5-8cac-46ff-afc9-646a0e722ed2 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:15.400753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da845c-6861-4736-9659-34f5a1e9de0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:15.401422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da845c-6861-4736-9659-34f5a1e9de0f admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.401705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da845c-6861-4736-9659-34f5a1e9de0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.401981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da845c-6861-4736-9659-34f5a1e9de0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.402829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da845c-6861-4736-9659-34f5a1e9de0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:15.404798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da845c-6861-4736-9659-34f5a1e9de0f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:15.412726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa066ec8-81d8-48ff-b8f3-55590dddff42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:15.413769 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa066ec8-81d8-48ff-b8f3-55590dddff42 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.424124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 996/1976] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:15.424267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa066ec8-81d8-48ff-b8f3-55590dddff42 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.424267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa066ec8-81d8-48ff-b8f3-55590dddff42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.424424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da845c-6861-4736-9659-34f5a1e9de0f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:15.426668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b8da845c-6861-4736-9659-34f5a1e9de0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:15.431901 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-aa066ec8-81d8-48ff-b8f3-55590dddff42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:15.445031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da845c-6861-4736-9659-34f5a1e9de0f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:15.452579 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e59c3-436e-48df-87c1-fb41bf8b821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:15.453532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e59c3-436e-48df-87c1-fb41bf8b821a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.453815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e59c3-436e-48df-87c1-fb41bf8b821a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.454087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e59c3-436e-48df-87c1-fb41bf8b821a admin admin] PATH_INFO: `/v3/users/e2bc43f1dc0743a38f187eba10dfa8d6` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.456022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e59c3-436e-48df-87c1-fb41bf8b821a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2bc43f1dc0743a38f187eba10dfa8d6)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:15.461455 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e59c3-436e-48df-87c1-fb41bf8b821a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:15.528066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-230e59c3-436e-48df-87c1-fb41bf8b821a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2bc43f1dc0743a38f187eba10dfa8d6'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:15.540809 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa066ec8-81d8-48ff-b8f3-55590dddff42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:15.541358 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-230e59c3-436e-48df-87c1-fb41bf8b821a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2bc43f1dc0743a38f187eba10dfa8d6'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:15.542193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa066ec8-81d8-48ff-b8f3-55590dddff42 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:15.542326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-230e59c3-436e-48df-87c1-fb41bf8b821a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2bc43f1dc0743a38f187eba10dfa8d6'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:15.543140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-230e59c3-436e-48df-87c1-fb41bf8b821a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2bc43f1dc0743a38f187eba10dfa8d6'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:15.555644 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 981/1977] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:15.556563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa066ec8-81d8-48ff-b8f3-55590dddff42 service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:15.572520 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-230e59c3-436e-48df-87c1-fb41bf8b821a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2bc43f1dc0743a38f187eba10dfa8d6'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:15.577390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa066ec8-81d8-48ff-b8f3-55590dddff42 service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:15.586455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff7955-84a5-45d2-ba6f-13c447d4324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:15.587604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff7955-84a5-45d2-ba6f-13c447d4324c admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.587906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff7955-84a5-45d2-ba6f-13c447d4324c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.588328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff7955-84a5-45d2-ba6f-13c447d4324c admin admin] PATH_INFO: `/v3/projects/8aae56fc5b234a319d16d7a8b41a3767/users/6cbb6d95417047b6ac4c580ff436ae98/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.591321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff7955-84a5-45d2-ba6f-13c447d4324c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aae56fc5b234a319d16d7a8b41a3767, user_id=6cbb6d95417047b6ac4c580ff436ae98, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:15.594864 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff7955-84a5-45d2-ba6f-13c447d4324c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:15.602152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 997/1978] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:15 2022] DELETE /identity/v3/users/e2bc43f1dc0743a38f187eba10dfa8d6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:15.617216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 982/1979] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:15 2022] PUT /identity/v3/projects/8aae56fc5b234a319d16d7a8b41a3767/users/6cbb6d95417047b6ac4c580ff436ae98/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:15.637003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25d232-5ffc-4e57-84fd-d2859f324448 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.637292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25d232-5ffc-4e57-84fd-d2859f324448 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.637581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25d232-5ffc-4e57-84fd-d2859f324448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.703038 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-fd25d232-5ffc-4e57-84fd-d2859f324448 None None] MFA Rules not processed for user `6cbb6d95417047b6ac4c580ff436ae98`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:15.712848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-fd25d232-5ffc-4e57-84fd-d2859f324448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:15.791304 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff7955-84a5-45d2-ba6f-13c447d4324c admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:15.795181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a8ff7955-84a5-45d2-ba6f-13c447d4324c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:15.847235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 998/1980] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:15.856358 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25d232-5ffc-4e57-84fd-d2859f324448 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:15.860509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-fd25d232-5ffc-4e57-84fd-d2859f324448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:15.911057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff7955-84a5-45d2-ba6f-13c447d4324c admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:15.916147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:15.917031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.917306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.917577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] PATH_INFO: `/v3/users/0b71f8159da64abfa57fc7b2e54dafb9` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:15.918796 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b71f8159da64abfa57fc7b2e54dafb9)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:15.921322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:15.980016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25d232-5ffc-4e57-84fd-d2859f324448 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:15.986071 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b55609-d25a-452f-91f1-7e043cb74f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:15.986944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b55609-d25a-452f-91f1-7e043cb74f18 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:15.987560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b55609-d25a-452f-91f1-7e043cb74f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:15.987997 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b55609-d25a-452f-91f1-7e043cb74f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:16.034386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b71f8159da64abfa57fc7b2e54dafb9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.034819 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b55609-d25a-452f-91f1-7e043cb74f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:16.036428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b55609-d25a-452f-91f1-7e043cb74f18 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:16.047858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b71f8159da64abfa57fc7b2e54dafb9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.054204 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 999/1981] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:12:16.064857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b71f8159da64abfa57fc7b2e54dafb9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.065818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b71f8159da64abfa57fc7b2e54dafb9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.066558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b71f8159da64abfa57fc7b2e54dafb9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.090104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 983/1982] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:15 2022] DELETE /identity/v3/users/0b71f8159da64abfa57fc7b2e54dafb9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:16.097557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ab685-b89e-4854-a382-c7e0edeceeb3 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:16.100792 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ab685-b89e-4854-a382-c7e0edeceeb3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:16.101192 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ab685-b89e-4854-a382-c7e0edeceeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:16.144417 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:16.146712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-217ab685-b89e-4854-a382-c7e0edeceeb3 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:16.147541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-217ab685-b89e-4854-a382-c7e0edeceeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:16.148474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:16.254094 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1000/1983] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:16.264338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ab685-b89e-4854-a382-c7e0edeceeb3 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:16.266082 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c3b0f-b681-4cff-8944-656ff9847827 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:16.266620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-217ab685-b89e-4854-a382-c7e0edeceeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:16.271375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667ed60-25c3-4223-90e1-f2821a9a7bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:16.272531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667ed60-25c3-4223-90e1-f2821a9a7bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:16.272812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667ed60-25c3-4223-90e1-f2821a9a7bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:16.273246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667ed60-25c3-4223-90e1-f2821a9a7bd0 admin admin] PATH_INFO: `/v3/projects/b0a840977be541f6a85b4f687f341c39` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:16.274472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667ed60-25c3-4223-90e1-f2821a9a7bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a840977be541f6a85b4f687f341c39)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:16.276475 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667ed60-25c3-4223-90e1-f2821a9a7bd0 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:16.332831 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5667ed60-25c3-4223-90e1-f2821a9a7bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a840977be541f6a85b4f687f341c39', 'request_id': 'req-5667ed60-25c3-4223-90e1-f2821a9a7bd0'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.332952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ab685-b89e-4854-a382-c7e0edeceeb3 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:16.339109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5667ed60-25c3-4223-90e1-f2821a9a7bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a840977be541f6a85b4f687f341c39', 'request_id': 'req-5667ed60-25c3-4223-90e1-f2821a9a7bd0'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.350322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5667ed60-25c3-4223-90e1-f2821a9a7bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a840977be541f6a85b4f687f341c39', 'request_id': 'req-5667ed60-25c3-4223-90e1-f2821a9a7bd0'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.367133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5667ed60-25c3-4223-90e1-f2821a9a7bd0 admin admin] The token cache is being invalidate because project b0a840977be541f6a85b4f687f341c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:16.367421 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5667ed60-25c3-4223-90e1-f2821a9a7bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.368109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5667ed60-25c3-4223-90e1-f2821a9a7bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.369692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 984/1984] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:16 2022] DELETE /identity/v3/projects/b0a840977be541f6a85b4f687f341c39 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:16.374588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937001a-9af1-4d5c-8681-11cc9cc66c91 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:16.374878 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937001a-9af1-4d5c-8681-11cc9cc66c91 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:16.375274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937001a-9af1-4d5c-8681-11cc9cc66c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:16.397155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e380379-8317-42b7-a143-fb6f781c8cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:16.397393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-b937001a-9af1-4d5c-8681-11cc9cc66c91 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:16.398223 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e380379-8317-42b7-a143-fb6f781c8cdc service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:16.398499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b937001a-9af1-4d5c-8681-11cc9cc66c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:16.398837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e380379-8317-42b7-a143-fb6f781c8cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:16.399288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e380379-8317-42b7-a143-fb6f781c8cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:16.401331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6e380379-8317-42b7-a143-fb6f781c8cdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:16.468230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 985/1985] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:16.476989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb7cf4-b8df-4a41-80b2-112cb4b90017 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:16.477566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb7cf4-b8df-4a41-80b2-112cb4b90017 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:16.478084 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb7cf4-b8df-4a41-80b2-112cb4b90017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:16.483636 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e380379-8317-42b7-a143-fb6f781c8cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:16.485078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e380379-8317-42b7-a143-fb6f781c8cdc service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:16.496199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1001/1986] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:12:16.501393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-2aeb7cf4-b8df-4a41-80b2-112cb4b90017 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:16.502605 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2aeb7cf4-b8df-4a41-80b2-112cb4b90017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:16.515659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 986/1987] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:16.517262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e380379-8317-42b7-a143-fb6f781c8cdc service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:16.527420 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e380379-8317-42b7-a143-fb6f781c8cdc service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:16.533515 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2194f-e89b-4e3e-8a5d-63dad59f61bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:16.534766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2194f-e89b-4e3e-8a5d-63dad59f61bd admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:16.535049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2194f-e89b-4e3e-8a5d-63dad59f61bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:16.535324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2194f-e89b-4e3e-8a5d-63dad59f61bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:16.536063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2194f-e89b-4e3e-8a5d-63dad59f61bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:16.536401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2194f-e89b-4e3e-8a5d-63dad59f61bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:16.538204 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2194f-e89b-4e3e-8a5d-63dad59f61bd admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:16.560230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1002/1988] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:12:16.561116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb7cf4-b8df-4a41-80b2-112cb4b90017 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:16.571061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb7cf4-b8df-4a41-80b2-112cb4b90017 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:16.583728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afb143-0cef-43f6-bc32-4c434dc8b7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:16.584539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afb143-0cef-43f6-bc32-4c434dc8b7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:16.584924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afb143-0cef-43f6-bc32-4c434dc8b7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:16.585292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afb143-0cef-43f6-bc32-4c434dc8b7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:16.586130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afb143-0cef-43f6-bc32-4c434dc8b7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:16.588169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afb143-0cef-43f6-bc32-4c434dc8b7c8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:16.618785 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 987/1989] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:16 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:16.623124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2194f-e89b-4e3e-8a5d-63dad59f61bd admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:16.643238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2194f-e89b-4e3e-8a5d-63dad59f61bd admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:16.738184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a919a9-5f3a-4c96-9a31-e95c63cc74c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:16.739770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a919a9-5f3a-4c96-9a31-e95c63cc74c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:16.740532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a919a9-5f3a-4c96-9a31-e95c63cc74c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:16.741069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a919a9-5f3a-4c96-9a31-e95c63cc74c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:16.742778 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a919a9-5f3a-4c96-9a31-e95c63cc74c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:16.745891 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a919a9-5f3a-4c96-9a31-e95c63cc74c8 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:16.788978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afb143-0cef-43f6-bc32-4c434dc8b7c8 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:16.791855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e1afb143-0cef-43f6-bc32-4c434dc8b7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:16.799429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1003/1990] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:16 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:16.800616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a919a9-5f3a-4c96-9a31-e95c63cc74c8 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:16.815696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afb143-0cef-43f6-bc32-4c434dc8b7c8 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:16.821722 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a919a9-5f3a-4c96-9a31-e95c63cc74c8 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:16.823640 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:16.824737 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:16.825770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:16.826448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] PATH_INFO: `/v3/users/eb49ee43f06b4f999dd00e87d52fb31c` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:16.827982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb49ee43f06b4f999dd00e87d52fb31c)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:16.830170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:16.836904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b19a7-e03e-4995-bed0-f90d091db543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:16.837615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b19a7-e03e-4995-bed0-f90d091db543 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:16.837900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b19a7-e03e-4995-bed0-f90d091db543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:16.838567 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b19a7-e03e-4995-bed0-f90d091db543 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:16.839426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b19a7-e03e-4995-bed0-f90d091db543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:16.846094 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b19a7-e03e-4995-bed0-f90d091db543 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:16.872563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1004/1991] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:16.876811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b19a7-e03e-4995-bed0-f90d091db543 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:16.896564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b19a7-e03e-4995-bed0-f90d091db543 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:16.917035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400bb41-438e-4452-be09-0700564ba0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:16.919511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400bb41-438e-4452-be09-0700564ba0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:16.920481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400bb41-438e-4452-be09-0700564ba0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:16.920761 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400bb41-438e-4452-be09-0700564ba0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:16.923120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400bb41-438e-4452-be09-0700564ba0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:16.929216 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400bb41-438e-4452-be09-0700564ba0f7 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:16.940237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb49ee43f06b4f999dd00e87d52fb31c'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.958768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1005/1992] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:16.958768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400bb41-438e-4452-be09-0700564ba0f7 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:16.958768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b400bb41-438e-4452-be09-0700564ba0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:16.964658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb49ee43f06b4f999dd00e87d52fb31c'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.975204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb49ee43f06b4f999dd00e87d52fb31c'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.976592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb49ee43f06b4f999dd00e87d52fb31c'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:16.977223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb49ee43f06b4f999dd00e87d52fb31c'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.000263 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400bb41-438e-4452-be09-0700564ba0f7 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:17.005322 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb73ca-b8b5-4726-b590-8945ae744440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:17.006185 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb73ca-b8b5-4726-b590-8945ae744440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:17.006466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb73ca-b8b5-4726-b590-8945ae744440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:17.006734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb73ca-b8b5-4726-b590-8945ae744440 admin admin] PATH_INFO: `/v3/projects/952eeb1a63184eb2bf70b2352f28ca1b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:17.007922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb73ca-b8b5-4726-b590-8945ae744440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=952eeb1a63184eb2bf70b2352f28ca1b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:17.010304 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 988/1993] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:16 2022] DELETE /identity/v3/users/eb49ee43f06b4f999dd00e87d52fb31c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:17.011098 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:17.012343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb73ca-b8b5-4726-b590-8945ae744440 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:17.012503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:17.096199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-2eeb73ca-b8b5-4726-b590-8945ae744440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952eeb1a63184eb2bf70b2352f28ca1b', 'request_id': 'req-2eeb73ca-b8b5-4726-b590-8945ae744440'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.101453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779968e9-01f3-4f0b-9130-03f1e7d7f001 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:17.106565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-2eeb73ca-b8b5-4726-b590-8945ae744440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952eeb1a63184eb2bf70b2352f28ca1b', 'request_id': 'req-2eeb73ca-b8b5-4726-b590-8945ae744440'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.115136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-2eeb73ca-b8b5-4726-b590-8945ae744440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952eeb1a63184eb2bf70b2352f28ca1b', 'request_id': 'req-2eeb73ca-b8b5-4726-b590-8945ae744440'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.135375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-2eeb73ca-b8b5-4726-b590-8945ae744440 admin admin] The token cache is being invalidate because project 952eeb1a63184eb2bf70b2352f28ca1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:17.135730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-2eeb73ca-b8b5-4726-b590-8945ae744440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.136641 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-2eeb73ca-b8b5-4726-b590-8945ae744440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.143097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1006/1994] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:16 2022] DELETE /identity/v3/projects/952eeb1a63184eb2bf70b2352f28ca1b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:17.145593 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbaec4-944e-4aee-a7b1-0284a7315801 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:17.145887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbaec4-944e-4aee-a7b1-0284a7315801 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:17.146164 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbaec4-944e-4aee-a7b1-0284a7315801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:17.171714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-6ffbaec4-944e-4aee-a7b1-0284a7315801 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:17.173275 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6ffbaec4-944e-4aee-a7b1-0284a7315801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:17.195887 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6a43f-6197-45e1-adc5-c79eb5d57c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:17.196870 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6a43f-6197-45e1-adc5-c79eb5d57c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:17.197175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6a43f-6197-45e1-adc5-c79eb5d57c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:17.197446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6a43f-6197-45e1-adc5-c79eb5d57c9c admin admin] PATH_INFO: `/v3/projects/9650bea3c3f646cfb08e220e7830c178/users/233b1bb0ca13414b9a536f9503bbbb3b/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:17.245376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6a43f-6197-45e1-adc5-c79eb5d57c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9650bea3c3f646cfb08e220e7830c178, user_id=233b1bb0ca13414b9a536f9503bbbb3b, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:17.249933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6a43f-6197-45e1-adc5-c79eb5d57c9c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:17.282286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1007/1995] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:17.283290 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbaec4-944e-4aee-a7b1-0284a7315801 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:17.286478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 989/1996] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:17 2022] PUT /identity/v3/projects/9650bea3c3f646cfb08e220e7830c178/users/233b1bb0ca13414b9a536f9503bbbb3b/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:17.286878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6ffbaec4-944e-4aee-a7b1-0284a7315801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:17.287930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6a43f-6197-45e1-adc5-c79eb5d57c9c admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:17.297692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5dd6a43f-6197-45e1-adc5-c79eb5d57c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:17.318634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbaec4-944e-4aee-a7b1-0284a7315801 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:17.400728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6a43f-6197-45e1-adc5-c79eb5d57c9c admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:17.405043 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781129-9325-4cf2-bbf1-533412db5dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:17.405764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781129-9325-4cf2-bbf1-533412db5dec service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:17.406117 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781129-9325-4cf2-bbf1-533412db5dec service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:17.406486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781129-9325-4cf2-bbf1-533412db5dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:17.432365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:17.433638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:17.433933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:17.434211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] PATH_INFO: `/v3/users/cdf2294f60554689971d43ad384c7699` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:17.436202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf2294f60554689971d43ad384c7699)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:17.438250 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:17.472889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781129-9325-4cf2-bbf1-533412db5dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:17.474419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781129-9325-4cf2-bbf1-533412db5dec service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:17.482381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf2294f60554689971d43ad384c7699'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.484484 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 990/1997] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:17.485580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb78a3-2814-4aea-b7dc-034b4133dc79 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:17.485937 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb78a3-2814-4aea-b7dc-034b4133dc79 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:17.486257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb78a3-2814-4aea-b7dc-034b4133dc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:17.489038 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf2294f60554689971d43ad384c7699'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.489724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf2294f60554689971d43ad384c7699'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.490362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf2294f60554689971d43ad384c7699'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.503641 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf2294f60554689971d43ad384c7699'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.513919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-99fb78a3-2814-4aea-b7dc-034b4133dc79 None None] MFA Rules not processed for user `233b1bb0ca13414b9a536f9503bbbb3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:17.515119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-99fb78a3-2814-4aea-b7dc-034b4133dc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:17.521012 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1008/1998] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:17 2022] DELETE /identity/v3/users/cdf2294f60554689971d43ad384c7699 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:17.598700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 991/1999] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:17.603456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:17.605526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:17.679405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569050b-7013-438e-b993-c00b3589bf86 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:17.686605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b3a89-1a92-42b6-af53-d38fcff458a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:17.687284 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b3a89-1a92-42b6-af53-d38fcff458a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:17.687560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b3a89-1a92-42b6-af53-d38fcff458a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:17.687832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b3a89-1a92-42b6-af53-d38fcff458a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:17.688599 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b3a89-1a92-42b6-af53-d38fcff458a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:17.690772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b3a89-1a92-42b6-af53-d38fcff458a0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:17.717846 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1009/2000] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:17 2022] POST /identity/v3/projects => generated 401 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:17.722097 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb78a3-2814-4aea-b7dc-034b4133dc79 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:17.735586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb78a3-2814-4aea-b7dc-034b4133dc79 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:17.813325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846655f3-6e29-40fb-83b0-7796fc6ab9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:17.814096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846655f3-6e29-40fb-83b0-7796fc6ab9cb admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:17.814537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846655f3-6e29-40fb-83b0-7796fc6ab9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:17.814916 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846655f3-6e29-40fb-83b0-7796fc6ab9cb admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:17.815884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846655f3-6e29-40fb-83b0-7796fc6ab9cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:17.818081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846655f3-6e29-40fb-83b0-7796fc6ab9cb admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:17.839027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b3a89-1a92-42b6-af53-d38fcff458a0 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:17.844019 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-096b3a89-1a92-42b6-af53-d38fcff458a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:17.847913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 992/2001] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:17 2022] POST /identity/v3/users => generated 307 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:17.848735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846655f3-6e29-40fb-83b0-7796fc6ab9cb admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:17.859616 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846655f3-6e29-40fb-83b0-7796fc6ab9cb admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:17.867519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b3a89-1a92-42b6-af53-d38fcff458a0 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:17.869016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd9f42-098a-4074-8849-4639fb85da4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:17.870394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9f42-098a-4074-8849-4639fb85da4a admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:17.870912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9f42-098a-4074-8849-4639fb85da4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:17.871502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9f42-098a-4074-8849-4639fb85da4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:17.873296 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd9f42-098a-4074-8849-4639fb85da4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:17.875407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd9f42-098a-4074-8849-4639fb85da4a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:17.878092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:17.879202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:17.879486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:17.879763 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] PATH_INFO: `/v3/projects/5d743b657c3645fdbe3aaf3ad9735c5a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:17.881201 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d743b657c3645fdbe3aaf3ad9735c5a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:17.883370 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:17.908926 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 993/2002] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:17.911760 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd9f42-098a-4074-8849-4639fb85da4a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:17.915301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e8dd9f42-098a-4074-8849-4639fb85da4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:17.931727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd9f42-098a-4074-8849-4639fb85da4a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:17.951470 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d743b657c3645fdbe3aaf3ad9735c5a', 'request_id': 'req-d889337b-3678-4601-bb71-99934cfc3abc'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.961301 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d743b657c3645fdbe3aaf3ad9735c5a', 'request_id': 'req-d889337b-3678-4601-bb71-99934cfc3abc'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.967430 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d743b657c3645fdbe3aaf3ad9735c5a', 'request_id': 'req-d889337b-3678-4601-bb71-99934cfc3abc'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.982965 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] The token cache is being invalidate because project 5d743b657c3645fdbe3aaf3ad9735c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:17.983251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.984261 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:17.988928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1010/2003] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:17 2022] DELETE /identity/v3/projects/5d743b657c3645fdbe3aaf3ad9735c5a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:17.989834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:17.991088 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:18.015520 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:18.016324 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.016604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.016875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] PATH_INFO: `/v3/projects/432e01f276ae423ebd93e8a88637e620` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.018071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432e01f276ae423ebd93e8a88637e620)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:18.019958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:18.084942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889337b-3678-4601-bb71-99934cfc3abc admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:18.095256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432e01f276ae423ebd93e8a88637e620', 'request_id': 'req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.113840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432e01f276ae423ebd93e8a88637e620', 'request_id': 'req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.127333 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432e01f276ae423ebd93e8a88637e620', 'request_id': 'req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.145163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] The token cache is being invalidate because project 432e01f276ae423ebd93e8a88637e620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:18.145449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.147226 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.149053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 994/2004] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:17 2022] DELETE /identity/v3/projects/432e01f276ae423ebd93e8a88637e620 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:18.152840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:18.152840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:18.197064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cdf2d-8ba4-41cf-927a-1637c60229f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:18.198672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cdf2d-8ba4-41cf-927a-1637c60229f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.199209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cdf2d-8ba4-41cf-927a-1637c60229f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.199624 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cdf2d-8ba4-41cf-927a-1637c60229f6 admin admin] PATH_INFO: `/v3/projects/ae612fd39e854eca9331410632504370/users/30bd31c7bc6844388032f871c01830f7/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.232421 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cdf2d-8ba4-41cf-927a-1637c60229f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae612fd39e854eca9331410632504370, user_id=30bd31c7bc6844388032f871c01830f7, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:18.233462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae82f8-ab4a-4ee9-b87f-98d7b7462c30 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:18.236202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cdf2d-8ba4-41cf-927a-1637c60229f6 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:18.241793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:18.242620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.242892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.243169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] PATH_INFO: `/v3/users/6cbb6d95417047b6ac4c580ff436ae98` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.244550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cbb6d95417047b6ac4c580ff436ae98)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:18.246526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:18.250646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1011/2005] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:17 2022] PUT /identity/v3/projects/ae612fd39e854eca9331410632504370/users/30bd31c7bc6844388032f871c01830f7/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:18.251747 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909afd6-713e-4031-b61b-7d2f12a5393e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.252038 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909afd6-713e-4031-b61b-7d2f12a5393e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.252419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909afd6-713e-4031-b61b-7d2f12a5393e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.270170 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e909afd6-713e-4031-b61b-7d2f12a5393e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:18.271096 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e909afd6-713e-4031-b61b-7d2f12a5393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:18.294569 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cbb6d95417047b6ac4c580ff436ae98'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.303344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cbb6d95417047b6ac4c580ff436ae98'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.310810 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cbb6d95417047b6ac4c580ff436ae98'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.311506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cbb6d95417047b6ac4c580ff436ae98'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.312151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cbb6d95417047b6ac4c580ff436ae98'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.334131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 995/2006] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:18 2022] DELETE /identity/v3/users/6cbb6d95417047b6ac4c580ff436ae98 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:18.336987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:18.344245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1012/2007] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:18.344995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:18.353317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8b705-ef02-450a-82d0-9403fd6ecd1f None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.353669 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8b705-ef02-450a-82d0-9403fd6ecd1f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.353949 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8b705-ef02-450a-82d0-9403fd6ecd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.387064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-7df8b705-ef02-450a-82d0-9403fd6ecd1f None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:18.388946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-7df8b705-ef02-450a-82d0-9403fd6ecd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:18.499532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc267bc-164d-455a-b827-cb00ba45992e admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:18.513456 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43433a8d-8a08-49be-b001-8a83f8bc9bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:18.514288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43433a8d-8a08-49be-b001-8a83f8bc9bae admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.514647 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43433a8d-8a08-49be-b001-8a83f8bc9bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.514991 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43433a8d-8a08-49be-b001-8a83f8bc9bae admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.515800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43433a8d-8a08-49be-b001-8a83f8bc9bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:18.516038 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1013/2008] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:18.518217 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43433a8d-8a08-49be-b001-8a83f8bc9bae admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:18.520328 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8b705-ef02-450a-82d0-9403fd6ecd1f None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:18.532554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 996/2009] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:18.533686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43433a8d-8a08-49be-b001-8a83f8bc9bae admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:18.540716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8b705-ef02-450a-82d0-9403fd6ecd1f None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:18.545384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43433a8d-8a08-49be-b001-8a83f8bc9bae admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:18.546452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb592a-5e59-4ff8-8384-1046cec06d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:18.547341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb592a-5e59-4ff8-8384-1046cec06d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.547625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb592a-5e59-4ff8-8384-1046cec06d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.547978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb592a-5e59-4ff8-8384-1046cec06d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.548822 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb592a-5e59-4ff8-8384-1046cec06d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:18.549137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb592a-5e59-4ff8-8384-1046cec06d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:18.550742 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c368d66-7f31-456e-a412-7d0f8e6ec421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:18.550971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb592a-5e59-4ff8-8384-1046cec06d97 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:18.551776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c368d66-7f31-456e-a412-7d0f8e6ec421 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.552131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c368d66-7f31-456e-a412-7d0f8e6ec421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.552570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c368d66-7f31-456e-a412-7d0f8e6ec421 admin admin] PATH_INFO: `/v3/projects/ae612fd39e854eca9331410632504370/users/30bd31c7bc6844388032f871c01830f7/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.554957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c368d66-7f31-456e-a412-7d0f8e6ec421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae612fd39e854eca9331410632504370, user_id=30bd31c7bc6844388032f871c01830f7, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:18.562552 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c368d66-7f31-456e-a412-7d0f8e6ec421 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:18.565160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1014/2010] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:12:18.570346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb592a-5e59-4ff8-8384-1046cec06d97 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:18.592235 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 997/2011] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:18 2022] PUT /identity/v3/projects/ae612fd39e854eca9331410632504370/users/30bd31c7bc6844388032f871c01830f7/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:18.592490 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb592a-5e59-4ff8-8384-1046cec06d97 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:18.598626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482693bf-3872-4f0e-92d9-294bbaec9558 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.599248 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482693bf-3872-4f0e-92d9-294bbaec9558 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.599632 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482693bf-3872-4f0e-92d9-294bbaec9558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.663629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-482693bf-3872-4f0e-92d9-294bbaec9558 None None] MFA Rules not processed for user `30bd31c7bc6844388032f871c01830f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:18.668218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-482693bf-3872-4f0e-92d9-294bbaec9558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:18.706613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77a92c-bf65-47ab-8836-6b949ad7bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:18.707500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77a92c-bf65-47ab-8836-6b949ad7bb88 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.707982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77a92c-bf65-47ab-8836-6b949ad7bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.708435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77a92c-bf65-47ab-8836-6b949ad7bb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.709310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77a92c-bf65-47ab-8836-6b949ad7bb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:18.712268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77a92c-bf65-47ab-8836-6b949ad7bb88 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:18.768060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1015/2012] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:18 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:18.775044 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77a92c-bf65-47ab-8836-6b949ad7bb88 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:18.794516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 998/2013] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:18.808728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482693bf-3872-4f0e-92d9-294bbaec9558 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:18.810688 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-482693bf-3872-4f0e-92d9-294bbaec9558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:18.848034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77a92c-bf65-47ab-8836-6b949ad7bb88 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:18.859346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23788cc2-5b58-4606-838e-964e687a6fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:18.860512 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23788cc2-5b58-4606-838e-964e687a6fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.861072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23788cc2-5b58-4606-838e-964e687a6fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.864137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23788cc2-5b58-4606-838e-964e687a6fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.864137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23788cc2-5b58-4606-838e-964e687a6fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:18.864775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23788cc2-5b58-4606-838e-964e687a6fb1 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:18.877434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482693bf-3872-4f0e-92d9-294bbaec9558 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:18.891573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1016/2014] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:18 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:18.891573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23788cc2-5b58-4606-838e-964e687a6fb1 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:18.891573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-23788cc2-5b58-4606-838e-964e687a6fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:18.907656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23788cc2-5b58-4606-838e-964e687a6fb1 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:18.912919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:18.913759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.914043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.914320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] PATH_INFO: `/v3/projects/8aae56fc5b234a319d16d7a8b41a3767` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.915750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aae56fc5b234a319d16d7a8b41a3767)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:18.917765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:18.943411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512074f7-75d3-4b63-a26c-b36af8b6d5dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:18.944158 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512074f7-75d3-4b63-a26c-b36af8b6d5dd service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:18.944447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512074f7-75d3-4b63-a26c-b36af8b6d5dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:18.944723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512074f7-75d3-4b63-a26c-b36af8b6d5dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:18.966916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aae56fc5b234a319d16d7a8b41a3767', 'request_id': 'req-ea1af08d-d0e8-4c11-b97d-877bddda7081'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.976004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aae56fc5b234a319d16d7a8b41a3767', 'request_id': 'req-ea1af08d-d0e8-4c11-b97d-877bddda7081'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.982582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aae56fc5b234a319d16d7a8b41a3767', 'request_id': 'req-ea1af08d-d0e8-4c11-b97d-877bddda7081'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.995064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] The token cache is being invalidate because project 8aae56fc5b234a319d16d7a8b41a3767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:18.995352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.996019 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:18.998215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1017/2015] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:18 2022] DELETE /identity/v3/projects/8aae56fc5b234a319d16d7a8b41a3767 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:18.998985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.000323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:19.009849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512074f7-75d3-4b63-a26c-b36af8b6d5dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.011287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512074f7-75d3-4b63-a26c-b36af8b6d5dd service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.021482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 999/2016] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:12:19.022869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb973d8-1729-4b47-939b-ea510628265d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.023156 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb973d8-1729-4b47-939b-ea510628265d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.023429 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb973d8-1729-4b47-939b-ea510628265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.042264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-abb973d8-1729-4b47-939b-ea510628265d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:19.043524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-abb973d8-1729-4b47-939b-ea510628265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:19.072629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1af08d-d0e8-4c11-b97d-877bddda7081 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.078600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edd557-d282-482f-9890-616c7ce93269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:19.079263 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edd557-d282-482f-9890-616c7ce93269 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.079542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edd557-d282-482f-9890-616c7ce93269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.079811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edd557-d282-482f-9890-616c7ce93269 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.080567 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edd557-d282-482f-9890-616c7ce93269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.082133 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edd557-d282-482f-9890-616c7ce93269 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.092812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1018/2017] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:19.096370 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edd557-d282-482f-9890-616c7ce93269 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.107801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edd557-d282-482f-9890-616c7ce93269 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.113127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931f16a-2d1a-4409-aeb5-6159d518fe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:19.113938 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931f16a-2d1a-4409-aeb5-6159d518fe24 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.114246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931f16a-2d1a-4409-aeb5-6159d518fe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.114517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931f16a-2d1a-4409-aeb5-6159d518fe24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.115259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931f16a-2d1a-4409-aeb5-6159d518fe24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.117148 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931f16a-2d1a-4409-aeb5-6159d518fe24 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.117269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1000/2018] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:19.118077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb973d8-1729-4b47-939b-ea510628265d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.119405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-abb973d8-1729-4b47-939b-ea510628265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:19.131361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1019/2019] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:19.131361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08090b3b-325c-4a9b-ac4f-c9b798e8b6e2 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.131361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08090b3b-325c-4a9b-ac4f-c9b798e8b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.131361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08090b3b-325c-4a9b-ac4f-c9b798e8b6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.149003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-08090b3b-325c-4a9b-ac4f-c9b798e8b6e2 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:19.150219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-08090b3b-325c-4a9b-ac4f-c9b798e8b6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:19.158746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1020/2020] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:19.160575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08090b3b-325c-4a9b-ac4f-c9b798e8b6e2 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.171844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08090b3b-325c-4a9b-ac4f-c9b798e8b6e2 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.176636 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48b92b-d793-4e0a-831a-b5a362185503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:19.177526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48b92b-d793-4e0a-831a-b5a362185503 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.177971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48b92b-d793-4e0a-831a-b5a362185503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.178241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48b92b-d793-4e0a-831a-b5a362185503 admin admin] PATH_INFO: `/v3/projects/5c191eaf803145cd930fe17a5f8c1f86/users/f8365f293b594248a9264e2ace2f1aad/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.182407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb973d8-1729-4b47-939b-ea510628265d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.186697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f3474-bfc4-4308-8340-81af173b0faa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:19.187330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f3474-bfc4-4308-8340-81af173b0faa service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.187604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f3474-bfc4-4308-8340-81af173b0faa service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.187874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f3474-bfc4-4308-8340-81af173b0faa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.189683 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3b1f3474-bfc4-4308-8340-81af173b0faa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:19.193474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48b92b-d793-4e0a-831a-b5a362185503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c191eaf803145cd930fe17a5f8c1f86, user_id=f8365f293b594248a9264e2ace2f1aad, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.196142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48b92b-d793-4e0a-831a-b5a362185503 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.216382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1021/2021] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:19 2022] PUT /identity/v3/projects/5c191eaf803145cd930fe17a5f8c1f86/users/f8365f293b594248a9264e2ace2f1aad/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:19.217452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48b92b-d793-4e0a-831a-b5a362185503 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.251275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f3474-bfc4-4308-8340-81af173b0faa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.252749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f3474-bfc4-4308-8340-81af173b0faa service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.263434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1001/2022] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:19.264793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fa168-32c7-44ef-9e05-66b3048ffafb None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.265502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fa168-32c7-44ef-9e05-66b3048ffafb None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.265502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fa168-32c7-44ef-9e05-66b3048ffafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.294827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a66fa168-32c7-44ef-9e05-66b3048ffafb None None] MFA Rules not processed for user `f8365f293b594248a9264e2ace2f1aad`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:19.296269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a66fa168-32c7-44ef-9e05-66b3048ffafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:19.303289 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48b92b-d793-4e0a-831a-b5a362185503 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.308601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcbab0-5a9e-46cb-97a3-4bc274cf3ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:19.309271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcbab0-5a9e-46cb-97a3-4bc274cf3ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.309596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcbab0-5a9e-46cb-97a3-4bc274cf3ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.309874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcbab0-5a9e-46cb-97a3-4bc274cf3ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.310606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcbab0-5a9e-46cb-97a3-4bc274cf3ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:19.310916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcbab0-5a9e-46cb-97a3-4bc274cf3ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.312542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcbab0-5a9e-46cb-97a3-4bc274cf3ee4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.324982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1022/2023] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:12:19.329554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcbab0-5a9e-46cb-97a3-4bc274cf3ee4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.346514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcbab0-5a9e-46cb-97a3-4bc274cf3ee4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.354626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a1dfd-eba1-44e4-9e7f-4b99cb1866a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:19.355298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a1dfd-eba1-44e4-9e7f-4b99cb1866a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.356124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a1dfd-eba1-44e4-9e7f-4b99cb1866a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.356124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a1dfd-eba1-44e4-9e7f-4b99cb1866a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.357155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a1dfd-eba1-44e4-9e7f-4b99cb1866a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.359593 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a1dfd-eba1-44e4-9e7f-4b99cb1866a0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.374879 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1002/2024] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:19.387355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fa168-32c7-44ef-9e05-66b3048ffafb None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.389303 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a66fa168-32c7-44ef-9e05-66b3048ffafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:19.396387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1023/2025] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:19 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:19.401235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a1dfd-eba1-44e4-9e7f-4b99cb1866a0 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.472262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fa168-32c7-44ef-9e05-66b3048ffafb None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.476620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a1dfd-eba1-44e4-9e7f-4b99cb1866a0 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.482147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d37f5-b898-442c-aace-5e811e39136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:19.482826 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d37f5-b898-442c-aace-5e811e39136d admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.483561 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d37f5-b898-442c-aace-5e811e39136d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.484124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d37f5-b898-442c-aace-5e811e39136d admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.485192 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d37f5-b898-442c-aace-5e811e39136d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.487298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d37f5-b898-442c-aace-5e811e39136d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.517126 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1024/2026] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:19 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:19.522217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d37f5-b898-442c-aace-5e811e39136d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.536956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a092fa-e644-4621-9af9-00090c479727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:19.537160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d37f5-b898-442c-aace-5e811e39136d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.537636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a092fa-e644-4621-9af9-00090c479727 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.537922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a092fa-e644-4621-9af9-00090c479727 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.538349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a092fa-e644-4621-9af9-00090c479727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.543360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae618a-5829-4608-8052-c142a5fc8f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:19.544242 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae618a-5829-4608-8052-c142a5fc8f46 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.544711 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae618a-5829-4608-8052-c142a5fc8f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.544996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae618a-5829-4608-8052-c142a5fc8f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.545739 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae618a-5829-4608-8052-c142a5fc8f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.547729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae618a-5829-4608-8052-c142a5fc8f46 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.564046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1025/2027] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:19.565525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae618a-5829-4608-8052-c142a5fc8f46 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.577481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae618a-5829-4608-8052-c142a5fc8f46 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.582445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfc595-185c-47b9-a2d6-28b07f47d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:19.583238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfc595-185c-47b9-a2d6-28b07f47d4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.583667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfc595-185c-47b9-a2d6-28b07f47d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.583979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfc595-185c-47b9-a2d6-28b07f47d4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.584956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfc595-185c-47b9-a2d6-28b07f47d4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.586970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfc595-185c-47b9-a2d6-28b07f47d4a7 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.600493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1026/2028] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:19.611859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfc595-185c-47b9-a2d6-28b07f47d4a7 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.626821 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfc595-185c-47b9-a2d6-28b07f47d4a7 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.632782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74a04e-af2e-4ac7-84d4-b09b46eee889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:19.633647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74a04e-af2e-4ac7-84d4-b09b46eee889 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.633926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74a04e-af2e-4ac7-84d4-b09b46eee889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.634202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74a04e-af2e-4ac7-84d4-b09b46eee889 admin admin] PATH_INFO: `/v3/projects/e736efbeaf5f4280880925ad0a747fe7/users/d6d467fd6576432d857b20b4ee042644/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.668551 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a092fa-e644-4621-9af9-00090c479727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.668551 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a092fa-e644-4621-9af9-00090c479727 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.668769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74a04e-af2e-4ac7-84d4-b09b46eee889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e736efbeaf5f4280880925ad0a747fe7, user_id=d6d467fd6576432d857b20b4ee042644, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.670024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74a04e-af2e-4ac7-84d4-b09b46eee889 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.677218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1003/2029] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:12:19.702487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a092fa-e644-4621-9af9-00090c479727 service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.706132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1027/2030] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:19 2022] PUT /identity/v3/projects/e736efbeaf5f4280880925ad0a747fe7/users/d6d467fd6576432d857b20b4ee042644/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:19.712817 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505159d-a464-4d06-a017-6cd6782a67fb None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.713392 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505159d-a464-4d06-a017-6cd6782a67fb None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.713910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505159d-a464-4d06-a017-6cd6782a67fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.719447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a092fa-e644-4621-9af9-00090c479727 service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.739230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-7505159d-a464-4d06-a017-6cd6782a67fb None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:19.740955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-7505159d-a464-4d06-a017-6cd6782a67fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:19.827337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1028/2031] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:19.831414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e09b1e-9827-4487-9d3d-5964c965b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:19.832340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e09b1e-9827-4487-9d3d-5964c965b978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.832619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e09b1e-9827-4487-9d3d-5964c965b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.833176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e09b1e-9827-4487-9d3d-5964c965b978 admin admin] PATH_INFO: `/v3/users/f8365f293b594248a9264e2ace2f1aad` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.834427 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e09b1e-9827-4487-9d3d-5964c965b978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8365f293b594248a9264e2ace2f1aad)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:19.836562 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e09b1e-9827-4487-9d3d-5964c965b978 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:19.860977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505159d-a464-4d06-a017-6cd6782a67fb None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:19.863258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-7505159d-a464-4d06-a017-6cd6782a67fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:19.894920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a9e09b1e-9827-4487-9d3d-5964c965b978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8365f293b594248a9264e2ace2f1aad'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:19.905242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a9e09b1e-9827-4487-9d3d-5964c965b978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8365f293b594248a9264e2ace2f1aad'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:19.920538 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a9e09b1e-9827-4487-9d3d-5964c965b978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8365f293b594248a9264e2ace2f1aad'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:19.923820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a9e09b1e-9827-4487-9d3d-5964c965b978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8365f293b594248a9264e2ace2f1aad'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:19.926238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a9e09b1e-9827-4487-9d3d-5964c965b978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8365f293b594248a9264e2ace2f1aad'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:19.952048 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1004/2032] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:19 2022] DELETE /identity/v3/users/f8365f293b594248a9264e2ace2f1aad => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:19.956701 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd3b7-97ed-4ee0-9758-5c10cf7a7e6c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:19.957599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd3b7-97ed-4ee0-9758-5c10cf7a7e6c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:19.957894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd3b7-97ed-4ee0-9758-5c10cf7a7e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:19.959101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505159d-a464-4d06-a017-6cd6782a67fb None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:19.976648 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-50edd3b7-97ed-4ee0-9758-5c10cf7a7e6c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:19.977954 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-50edd3b7-97ed-4ee0-9758-5c10cf7a7e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:20.024917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d97b0c-2580-4943-80a0-00d2676a8013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:20.025708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d97b0c-2580-4943-80a0-00d2676a8013 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:20.026069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d97b0c-2580-4943-80a0-00d2676a8013 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:20.026381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d97b0c-2580-4943-80a0-00d2676a8013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:20.028393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e3d97b0c-2580-4943-80a0-00d2676a8013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:20.051400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1005/2033] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:20.061618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edd3b7-97ed-4ee0-9758-5c10cf7a7e6c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:20.063176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-50edd3b7-97ed-4ee0-9758-5c10cf7a7e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:20.075010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edd3b7-97ed-4ee0-9758-5c10cf7a7e6c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:20.079572 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4da81a-4eba-47d7-881e-7575b3ccf0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:20.080367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4da81a-4eba-47d7-881e-7575b3ccf0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:20.080727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4da81a-4eba-47d7-881e-7575b3ccf0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:20.081022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4da81a-4eba-47d7-881e-7575b3ccf0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:20.094165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4da81a-4eba-47d7-881e-7575b3ccf0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:20.095597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4da81a-4eba-47d7-881e-7575b3ccf0b6 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:20.102752 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d97b0c-2580-4943-80a0-00d2676a8013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:20.104194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d97b0c-2580-4943-80a0-00d2676a8013 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:20.104886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1006/2034] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:20.114699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1029/2035] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:20.540760 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4da81a-4eba-47d7-881e-7575b3ccf0b6 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:20.542292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9c4da81a-4eba-47d7-881e-7575b3ccf0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:20.563633 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4da81a-4eba-47d7-881e-7575b3ccf0b6 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:20.581095 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958b993-9663-4fef-9d22-b9af85ec9b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:20.582244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958b993-9663-4fef-9d22-b9af85ec9b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:20.583661 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958b993-9663-4fef-9d22-b9af85ec9b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:20.583810 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958b993-9663-4fef-9d22-b9af85ec9b7e admin admin] PATH_INFO: `/v3/projects/5c191eaf803145cd930fe17a5f8c1f86` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:20.585150 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958b993-9663-4fef-9d22-b9af85ec9b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c191eaf803145cd930fe17a5f8c1f86)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:20.587418 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958b993-9663-4fef-9d22-b9af85ec9b7e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:20.657362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a958b993-9663-4fef-9d22-b9af85ec9b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c191eaf803145cd930fe17a5f8c1f86', 'request_id': 'req-a958b993-9663-4fef-9d22-b9af85ec9b7e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:20.664170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a958b993-9663-4fef-9d22-b9af85ec9b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c191eaf803145cd930fe17a5f8c1f86', 'request_id': 'req-a958b993-9663-4fef-9d22-b9af85ec9b7e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:20.677253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a958b993-9663-4fef-9d22-b9af85ec9b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c191eaf803145cd930fe17a5f8c1f86', 'request_id': 'req-a958b993-9663-4fef-9d22-b9af85ec9b7e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:20.693212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a958b993-9663-4fef-9d22-b9af85ec9b7e admin admin] The token cache is being invalidate because project 5c191eaf803145cd930fe17a5f8c1f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:20.693504 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a958b993-9663-4fef-9d22-b9af85ec9b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:20.694164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a958b993-9663-4fef-9d22-b9af85ec9b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:20.696199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1007/2036] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:20 2022] DELETE /identity/v3/projects/5c191eaf803145cd930fe17a5f8c1f86 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:20.702020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df7d3b-cc99-41be-b5f1-6b689151f335 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:20.702509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df7d3b-cc99-41be-b5f1-6b689151f335 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:20.702590 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df7d3b-cc99-41be-b5f1-6b689151f335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:20.722774 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-92df7d3b-cc99-41be-b5f1-6b689151f335 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:20.723978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-92df7d3b-cc99-41be-b5f1-6b689151f335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:20.839181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1030/2037] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:20.848243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d095fb-d849-4840-a622-407ffdcd1907 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:20.849037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d095fb-d849-4840-a622-407ffdcd1907 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:20.854217 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d095fb-d849-4840-a622-407ffdcd1907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:20.886239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-e4d095fb-d849-4840-a622-407ffdcd1907 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:20.887705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e4d095fb-d849-4840-a622-407ffdcd1907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:20.898513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1008/2038] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:20.902938 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df7d3b-cc99-41be-b5f1-6b689151f335 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:20.916633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df7d3b-cc99-41be-b5f1-6b689151f335 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:20.924564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32464c83-7929-4379-aded-71ab0ed9c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:20.925362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464c83-7929-4379-aded-71ab0ed9c1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:20.925736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464c83-7929-4379-aded-71ab0ed9c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:20.926156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464c83-7929-4379-aded-71ab0ed9c1c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:20.927615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32464c83-7929-4379-aded-71ab0ed9c1c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:20.928021 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32464c83-7929-4379-aded-71ab0ed9c1c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:20.929919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32464c83-7929-4379-aded-71ab0ed9c1c4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:20.950660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1031/2039] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:12:20.953849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d095fb-d849-4840-a622-407ffdcd1907 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:20.968279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d095fb-d849-4840-a622-407ffdcd1907 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:20.990731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997bb6f-183d-49da-af76-7659219fbedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:20.993103 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997bb6f-183d-49da-af76-7659219fbedd admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:20.994906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997bb6f-183d-49da-af76-7659219fbedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:20.995216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997bb6f-183d-49da-af76-7659219fbedd admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:20.996149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997bb6f-183d-49da-af76-7659219fbedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.003511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997bb6f-183d-49da-af76-7659219fbedd admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.075838 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32464c83-7929-4379-aded-71ab0ed9c1c4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.077056 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1009/2040] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:20 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:21.083120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf733-629f-4183-9d9e-2d12399d55e0 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.085478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf733-629f-4183-9d9e-2d12399d55e0 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.085936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf733-629f-4183-9d9e-2d12399d55e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.094594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32464c83-7929-4379-aded-71ab0ed9c1c4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.169393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-01baf733-629f-4183-9d9e-2d12399d55e0 None None] MFA Rules not processed for user `d6d467fd6576432d857b20b4ee042644`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:21.170675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-01baf733-629f-4183-9d9e-2d12399d55e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:21.253090 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ce316-651e-4a1c-b633-e3ac1011e4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.253811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ce316-651e-4a1c-b633-e3ac1011e4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.254172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ce316-651e-4a1c-b633-e3ac1011e4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.254382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ce316-651e-4a1c-b633-e3ac1011e4b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.255061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ce316-651e-4a1c-b633-e3ac1011e4b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.268767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ce316-651e-4a1c-b633-e3ac1011e4b9 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.315120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1032/2041] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:21 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:21.319481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ce316-651e-4a1c-b633-e3ac1011e4b9 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.336309 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ce316-651e-4a1c-b633-e3ac1011e4b9 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.342482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c1064-f68f-4336-9b2a-379d315996e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.343156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c1064-f68f-4336-9b2a-379d315996e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.343438 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c1064-f68f-4336-9b2a-379d315996e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.343715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c1064-f68f-4336-9b2a-379d315996e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.344544 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c1064-f68f-4336-9b2a-379d315996e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.346142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c1064-f68f-4336-9b2a-379d315996e6 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.348011 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1010/2042] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:21.352184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf733-629f-4183-9d9e-2d12399d55e0 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.354060 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-01baf733-629f-4183-9d9e-2d12399d55e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:21.359904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1033/2043] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:21.360994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c1064-f68f-4336-9b2a-379d315996e6 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.370976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c1064-f68f-4336-9b2a-379d315996e6 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.375848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf733-629f-4183-9d9e-2d12399d55e0 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.376431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9be18-4d76-4d1f-88cb-1bd2917a4c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.377092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9be18-4d76-4d1f-88cb-1bd2917a4c86 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.377380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9be18-4d76-4d1f-88cb-1bd2917a4c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.377662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9be18-4d76-4d1f-88cb-1bd2917a4c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.378379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9be18-4d76-4d1f-88cb-1bd2917a4c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.380401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9be18-4d76-4d1f-88cb-1bd2917a4c86 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.381556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ee2c8-fc3b-4dda-a21e-faecb0999b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.382274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ee2c8-fc3b-4dda-a21e-faecb0999b4f admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.382561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ee2c8-fc3b-4dda-a21e-faecb0999b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.382832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ee2c8-fc3b-4dda-a21e-faecb0999b4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.383562 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ee2c8-fc3b-4dda-a21e-faecb0999b4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.385570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ee2c8-fc3b-4dda-a21e-faecb0999b4f admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.395408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1034/2044] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:21.400538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9be18-4d76-4d1f-88cb-1bd2917a4c86 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.413042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9be18-4d76-4d1f-88cb-1bd2917a4c86 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.415778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1011/2045] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:21 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:21.419889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ee2c8-fc3b-4dda-a21e-faecb0999b4f admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.420172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bb263-67c6-4e13-93c2-4ee7fdbcfa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.421059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bb263-67c6-4e13-93c2-4ee7fdbcfa51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.421776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bb263-67c6-4e13-93c2-4ee7fdbcfa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.422078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bb263-67c6-4e13-93c2-4ee7fdbcfa51 admin admin] PATH_INFO: `/v3/projects/1e4955dd1480437b9df29d6a9009d05f/users/54f88ee0f9f0441fa5b2bede22187d03/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.440884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bb263-67c6-4e13-93c2-4ee7fdbcfa51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4955dd1480437b9df29d6a9009d05f, user_id=54f88ee0f9f0441fa5b2bede22187d03, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.443714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bb263-67c6-4e13-93c2-4ee7fdbcfa51 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.460277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1035/2046] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:21 2022] PUT /identity/v3/projects/1e4955dd1480437b9df29d6a9009d05f/users/54f88ee0f9f0441fa5b2bede22187d03/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:21.470405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fa6a8-cd6a-41fb-afad-7477502ce515 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.470693 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fa6a8-cd6a-41fb-afad-7477502ce515 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.470972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fa6a8-cd6a-41fb-afad-7477502ce515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.495539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ee2c8-fc3b-4dda-a21e-faecb0999b4f admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.501181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ab7fa6a8-cd6a-41fb-afad-7477502ce515 None None] MFA Rules not processed for user `54f88ee0f9f0441fa5b2bede22187d03`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:21.502394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ab7fa6a8-cd6a-41fb-afad-7477502ce515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:21.552526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9acc1-cb76-4e35-9b92-5e00e07e1380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.553196 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9acc1-cb76-4e35-9b92-5e00e07e1380 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.553473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9acc1-cb76-4e35-9b92-5e00e07e1380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.553879 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9acc1-cb76-4e35-9b92-5e00e07e1380 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.554575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9acc1-cb76-4e35-9b92-5e00e07e1380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.556507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9acc1-cb76-4e35-9b92-5e00e07e1380 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.569775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1036/2047] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:21.574760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fa6a8-cd6a-41fb-afad-7477502ce515 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.583005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1012/2048] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:21 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:21.586507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9acc1-cb76-4e35-9b92-5e00e07e1380 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.591208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fa6a8-cd6a-41fb-afad-7477502ce515 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.595938 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a54ad-e7ce-453c-8e77-0300e73d6d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.596279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9acc1-cb76-4e35-9b92-5e00e07e1380 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.596620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a54ad-e7ce-453c-8e77-0300e73d6d58 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.596903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a54ad-e7ce-453c-8e77-0300e73d6d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.597178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a54ad-e7ce-453c-8e77-0300e73d6d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.597865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a54ad-e7ce-453c-8e77-0300e73d6d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.599771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a54ad-e7ce-453c-8e77-0300e73d6d58 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.600935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf090-726a-48d8-bd03-e549172a1803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.601582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf090-726a-48d8-bd03-e549172a1803 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.601865 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf090-726a-48d8-bd03-e549172a1803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.602140 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf090-726a-48d8-bd03-e549172a1803 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.602872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eaf090-726a-48d8-bd03-e549172a1803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.604493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eaf090-726a-48d8-bd03-e549172a1803 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.615185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1013/2049] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:21.618984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf090-726a-48d8-bd03-e549172a1803 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.630793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf090-726a-48d8-bd03-e549172a1803 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.635783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1037/2050] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:21 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:21.637062 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a54ad-e7ce-453c-8e77-0300e73d6d58 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.689031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca43de-14d8-4e52-ba87-bfd7eb69cf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.689920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca43de-14d8-4e52-ba87-bfd7eb69cf25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.690200 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca43de-14d8-4e52-ba87-bfd7eb69cf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.690472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca43de-14d8-4e52-ba87-bfd7eb69cf25 admin admin] PATH_INFO: `/v3/projects/e20e02f3a459467da24a0669e0b609aa/users/ebd87bbc7f66489b9713292f20f091e0/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.696538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a54ad-e7ce-453c-8e77-0300e73d6d58 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.701694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac15e0-bb07-4bc0-8bac-37f8568c39a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.702347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac15e0-bb07-4bc0-8bac-37f8568c39a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.702883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac15e0-bb07-4bc0-8bac-37f8568c39a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.702883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac15e0-bb07-4bc0-8bac-37f8568c39a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.703545 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac15e0-bb07-4bc0-8bac-37f8568c39a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.705472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac15e0-bb07-4bc0-8bac-37f8568c39a1 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.706556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca43de-14d8-4e52-ba87-bfd7eb69cf25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20e02f3a459467da24a0669e0b609aa, user_id=ebd87bbc7f66489b9713292f20f091e0, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.709415 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca43de-14d8-4e52-ba87-bfd7eb69cf25 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.725249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1014/2051] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:21 2022] PUT /identity/v3/projects/e20e02f3a459467da24a0669e0b609aa/users/ebd87bbc7f66489b9713292f20f091e0/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:21.729237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca43de-14d8-4e52-ba87-bfd7eb69cf25 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.731868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1038/2052] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:21 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:21.735498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac15e0-bb07-4bc0-8bac-37f8568c39a1 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.747641 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac15e0-bb07-4bc0-8bac-37f8568c39a1 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.803224 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca43de-14d8-4e52-ba87-bfd7eb69cf25 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.808945 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4bd38-e01b-4030-b772-f2f18afcc49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.810524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4bd38-e01b-4030-b772-f2f18afcc49d admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.811445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4bd38-e01b-4030-b772-f2f18afcc49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.811552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae972ae7-5449-41d5-beba-d13d89053dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.811757 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4bd38-e01b-4030-b772-f2f18afcc49d admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.812208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae972ae7-5449-41d5-beba-d13d89053dbb admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.812477 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4bd38-e01b-4030-b772-f2f18afcc49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.812582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae972ae7-5449-41d5-beba-d13d89053dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.812745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae972ae7-5449-41d5-beba-d13d89053dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.813464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae972ae7-5449-41d5-beba-d13d89053dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.814215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4bd38-e01b-4030-b772-f2f18afcc49d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.815065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae972ae7-5449-41d5-beba-d13d89053dbb admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.830763 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1039/2053] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:21.830977 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1015/2054] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:21.831836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae972ae7-5449-41d5-beba-d13d89053dbb admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.832257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4bd38-e01b-4030-b772-f2f18afcc49d admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.843731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae972ae7-5449-41d5-beba-d13d89053dbb admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.843912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4bd38-e01b-4030-b772-f2f18afcc49d admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.848795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeab0f-1503-4e69-a361-1367ef0a0e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.848945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232b92a-546d-4fea-8dec-54c67b7a6d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.849685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeab0f-1503-4e69-a361-1367ef0a0e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.849789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232b92a-546d-4fea-8dec-54c67b7a6d55 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.849964 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232b92a-546d-4fea-8dec-54c67b7a6d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.850079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeab0f-1503-4e69-a361-1367ef0a0e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.850232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeab0f-1503-4e69-a361-1367ef0a0e37 admin admin] PATH_INFO: `/v3/projects/e20e02f3a459467da24a0669e0b609aa/users/ebd87bbc7f66489b9713292f20f091e0/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.850324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232b92a-546d-4fea-8dec-54c67b7a6d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.850958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232b92a-546d-4fea-8dec-54c67b7a6d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.852288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdeab0f-1503-4e69-a361-1367ef0a0e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20e02f3a459467da24a0669e0b609aa, user_id=ebd87bbc7f66489b9713292f20f091e0, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.852974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232b92a-546d-4fea-8dec-54c67b7a6d55 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.854903 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdeab0f-1503-4e69-a361-1367ef0a0e37 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.863807 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1040/2055] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:21.868994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1016/2056] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:21 2022] PUT /identity/v3/projects/e20e02f3a459467da24a0669e0b609aa/users/ebd87bbc7f66489b9713292f20f091e0/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:21.869150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232b92a-546d-4fea-8dec-54c67b7a6d55 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:21.882834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232b92a-546d-4fea-8dec-54c67b7a6d55 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:21.947553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b87183-27a9-4157-8ab7-b90b6bdf1fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:21.948566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b87183-27a9-4157-8ab7-b90b6bdf1fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:21.948754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b87183-27a9-4157-8ab7-b90b6bdf1fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:21.949034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b87183-27a9-4157-8ab7-b90b6bdf1fc9 admin admin] PATH_INFO: `/v3/projects/331d7c7669f74fae9b1acd7ed16b4059/users/2844b5e6f70a410b815b3b75b6f10d09/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:21.966766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b87183-27a9-4157-8ab7-b90b6bdf1fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=331d7c7669f74fae9b1acd7ed16b4059, user_id=2844b5e6f70a410b815b3b75b6f10d09, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:21.969545 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b87183-27a9-4157-8ab7-b90b6bdf1fc9 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:21.989597 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1041/2057] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:21 2022] PUT /identity/v3/projects/331d7c7669f74fae9b1acd7ed16b4059/users/2844b5e6f70a410b815b3b75b6f10d09/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:22.004700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689ef54-db77-4556-b817-a98289416d12 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:22.005007 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689ef54-db77-4556-b817-a98289416d12 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:22.005386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689ef54-db77-4556-b817-a98289416d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:22.042864 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-3689ef54-db77-4556-b817-a98289416d12 None None] MFA Rules not processed for user `2844b5e6f70a410b815b3b75b6f10d09`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:22.044618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3689ef54-db77-4556-b817-a98289416d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:22.177929 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1017/2058] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:22.178326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b87183-27a9-4157-8ab7-b90b6bdf1fc9 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:22.329936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b87183-27a9-4157-8ab7-b90b6bdf1fc9 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:22.343294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43a344-9515-4e52-928b-ae45c04a7c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:22.344052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43a344-9515-4e52-928b-ae45c04a7c71 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:22.344297 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43a344-9515-4e52-928b-ae45c04a7c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:22.347686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43a344-9515-4e52-928b-ae45c04a7c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:22.349720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43a344-9515-4e52-928b-ae45c04a7c71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:22.353764 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43a344-9515-4e52-928b-ae45c04a7c71 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:22.409077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1042/2059] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:22 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:22.412846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689ef54-db77-4556-b817-a98289416d12 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:22.431820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689ef54-db77-4556-b817-a98289416d12 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:22.547279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533ca9a-19ca-40aa-9074-11c433673e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:22.548395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533ca9a-19ca-40aa-9074-11c433673e88 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:22.548794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533ca9a-19ca-40aa-9074-11c433673e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:22.549179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533ca9a-19ca-40aa-9074-11c433673e88 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:22.550121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533ca9a-19ca-40aa-9074-11c433673e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:22.552625 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533ca9a-19ca-40aa-9074-11c433673e88 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:22.585440 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1018/2060] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:22 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:22.590261 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43a344-9515-4e52-928b-ae45c04a7c71 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:22.612125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43a344-9515-4e52-928b-ae45c04a7c71 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:22.624819 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35417c-6ec1-4dd6-a540-8b07caed374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:22.626144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35417c-6ec1-4dd6-a540-8b07caed374f admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:22.626144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35417c-6ec1-4dd6-a540-8b07caed374f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:22.626375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35417c-6ec1-4dd6-a540-8b07caed374f admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:22.626932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35417c-6ec1-4dd6-a540-8b07caed374f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:22.628574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35417c-6ec1-4dd6-a540-8b07caed374f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:22.656121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1043/2061] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:22.657666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533ca9a-19ca-40aa-9074-11c433673e88 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:22.671788 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533ca9a-19ca-40aa-9074-11c433673e88 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:22.684277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf940e97-35a6-47de-adee-0d312d26e1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:22.688104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf940e97-35a6-47de-adee-0d312d26e1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:22.688302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf940e97-35a6-47de-adee-0d312d26e1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:22.688584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf940e97-35a6-47de-adee-0d312d26e1b5 admin admin] PATH_INFO: `/v3/projects/3dbe8be45d534e408dd99b255122c52e/users/7623b0c393234ef19ddac614b8a664ee/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:22.711553 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf940e97-35a6-47de-adee-0d312d26e1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbe8be45d534e408dd99b255122c52e, user_id=7623b0c393234ef19ddac614b8a664ee, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:22.714945 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf940e97-35a6-47de-adee-0d312d26e1b5 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:22.738526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1019/2062] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:22 2022] PUT /identity/v3/projects/3dbe8be45d534e408dd99b255122c52e/users/7623b0c393234ef19ddac614b8a664ee/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:22.743020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35417c-6ec1-4dd6-a540-8b07caed374f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:22.768984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35417c-6ec1-4dd6-a540-8b07caed374f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:22.853960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79ea8c-fa9c-4e3f-8bf5-fac9b59894f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:22.859040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79ea8c-fa9c-4e3f-8bf5-fac9b59894f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:22.859332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79ea8c-fa9c-4e3f-8bf5-fac9b59894f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:22.859615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79ea8c-fa9c-4e3f-8bf5-fac9b59894f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:22.860393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79ea8c-fa9c-4e3f-8bf5-fac9b59894f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:22.862500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79ea8c-fa9c-4e3f-8bf5-fac9b59894f6 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:22.876198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1044/2063] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:22.881066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf940e97-35a6-47de-adee-0d312d26e1b5 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:22.895681 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf940e97-35a6-47de-adee-0d312d26e1b5 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:22.901958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305b4c2-0323-4833-b9d1-a067ddb2af47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:22.902923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305b4c2-0323-4833-b9d1-a067ddb2af47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:22.903233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305b4c2-0323-4833-b9d1-a067ddb2af47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:22.903505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305b4c2-0323-4833-b9d1-a067ddb2af47 admin admin] PATH_INFO: `/v3/projects/3dbe8be45d534e408dd99b255122c52e/users/7623b0c393234ef19ddac614b8a664ee/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:22.906874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305b4c2-0323-4833-b9d1-a067ddb2af47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbe8be45d534e408dd99b255122c52e, user_id=7623b0c393234ef19ddac614b8a664ee, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:22.910472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305b4c2-0323-4833-b9d1-a067ddb2af47 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:22.925798 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1020/2064] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:22 2022] PUT /identity/v3/projects/3dbe8be45d534e408dd99b255122c52e/users/7623b0c393234ef19ddac614b8a664ee/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:22.936643 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291e440-627f-44e9-b645-5082e26fa48e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:22.936931 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291e440-627f-44e9-b645-5082e26fa48e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:22.938874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291e440-627f-44e9-b645-5082e26fa48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:22.970105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e291e440-627f-44e9-b645-5082e26fa48e None None] MFA Rules not processed for user `7623b0c393234ef19ddac614b8a664ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:22.971374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e291e440-627f-44e9-b645-5082e26fa48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:22.971692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4bf8-9827-4056-94f4-a42c02a48ed9 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:22.971788 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4bf8-9827-4056-94f4-a42c02a48ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:22.972012 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4bf8-9827-4056-94f4-a42c02a48ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:23.006066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-63cb4bf8-9827-4056-94f4-a42c02a48ed9 None None] MFA Rules not processed for user `ebd87bbc7f66489b9713292f20f091e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:23.007280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-63cb4bf8-9827-4056-94f4-a42c02a48ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:23.099478 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1045/2065] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:23.111198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291e440-627f-44e9-b645-5082e26fa48e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:23.113541 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1021/2066] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:23.116568 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e291e440-627f-44e9-b645-5082e26fa48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:23.126987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4bf8-9827-4056-94f4-a42c02a48ed9 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:23.129562 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-63cb4bf8-9827-4056-94f4-a42c02a48ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:23.177428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291e440-627f-44e9-b645-5082e26fa48e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:23.181231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ccee8-f4b9-4706-bf23-7259142ac5ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:23.181871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ccee8-f4b9-4706-bf23-7259142ac5ad service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:23.182149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ccee8-f4b9-4706-bf23-7259142ac5ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:23.182422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ccee8-f4b9-4706-bf23-7259142ac5ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:23.192757 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4bf8-9827-4056-94f4-a42c02a48ed9 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:23.196728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dc2d4-87a5-484e-a51e-59274782005e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:23.197577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dc2d4-87a5-484e-a51e-59274782005e service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:23.197852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dc2d4-87a5-484e-a51e-59274782005e service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:23.198123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dc2d4-87a5-484e-a51e-59274782005e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:23.260884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dc2d4-87a5-484e-a51e-59274782005e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:23.263167 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dc2d4-87a5-484e-a51e-59274782005e service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:23.265576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ccee8-f4b9-4706-bf23-7259142ac5ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:23.267135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ccee8-f4b9-4706-bf23-7259142ac5ad service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:23.274416 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1022/2067] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:23.281991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1046/2068] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:12:25.923057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dc2d4-87a5-484e-a51e-59274782005e service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:25.931174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dc2d4-87a5-484e-a51e-59274782005e service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:25.935009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14abb98-c42e-4373-a3d8-c38ffc3c56f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:25.935636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14abb98-c42e-4373-a3d8-c38ffc3c56f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:25.935917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14abb98-c42e-4373-a3d8-c38ffc3c56f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:25.936226 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14abb98-c42e-4373-a3d8-c38ffc3c56f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:25.990235 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14abb98-c42e-4373-a3d8-c38ffc3c56f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:25.991568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14abb98-c42e-4373-a3d8-c38ffc3c56f4 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:26.000171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1023/2069] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:26.274712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ccee8-f4b9-4706-bf23-7259142ac5ad service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:26.276180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5b9ccee8-f4b9-4706-bf23-7259142ac5ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:26.343584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ccee8-f4b9-4706-bf23-7259142ac5ad service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:26.348320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:26.349178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:26.349460 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:26.349739 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] PATH_INFO: `/v3/users/233b1bb0ca13414b9a536f9503bbbb3b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:26.350906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=233b1bb0ca13414b9a536f9503bbbb3b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:26.352834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:26.396176 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233b1bb0ca13414b9a536f9503bbbb3b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:26.402619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233b1bb0ca13414b9a536f9503bbbb3b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:26.403904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233b1bb0ca13414b9a536f9503bbbb3b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:26.404560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233b1bb0ca13414b9a536f9503bbbb3b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:26.417620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233b1bb0ca13414b9a536f9503bbbb3b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:26.429752 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1047/2070] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:26 2022] DELETE /identity/v3/users/233b1bb0ca13414b9a536f9503bbbb3b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:26.434563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c639d71-438a-4415-b283-2852b1f10250 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:26.434874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c639d71-438a-4415-b283-2852b1f10250 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:26.435151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c639d71-438a-4415-b283-2852b1f10250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:26.452871 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0c639d71-438a-4415-b283-2852b1f10250 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:26.454042 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0c639d71-438a-4415-b283-2852b1f10250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:26.511068 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1024/2071] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:26.521173 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:26.522654 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:26.580923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da65bf-a0fa-4e02-85c8-10ee91728f57 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:26.584595 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7f7b3-8765-4e44-8e2d-3c43fd8e1cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:26.585241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f7b3-8765-4e44-8e2d-3c43fd8e1cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:26.585519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f7b3-8765-4e44-8e2d-3c43fd8e1cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:26.585791 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f7b3-8765-4e44-8e2d-3c43fd8e1cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:26.595487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7f7b3-8765-4e44-8e2d-3c43fd8e1cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:26.596974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7f7b3-8765-4e44-8e2d-3c43fd8e1cc6 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:26.608267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1048/2072] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:26.864557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c639d71-438a-4415-b283-2852b1f10250 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:26.865952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0c639d71-438a-4415-b283-2852b1f10250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:26.877795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c639d71-438a-4415-b283-2852b1f10250 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:26.882664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:26.883523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:26.883830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:26.884138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] PATH_INFO: `/v3/projects/9650bea3c3f646cfb08e220e7830c178` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:26.885458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9650bea3c3f646cfb08e220e7830c178)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:26.887954 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:26.946778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9650bea3c3f646cfb08e220e7830c178', 'request_id': 'req-e26d16ec-71da-436a-8785-940b9eba9d4e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:26.952478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9650bea3c3f646cfb08e220e7830c178', 'request_id': 'req-e26d16ec-71da-436a-8785-940b9eba9d4e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:26.958948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9650bea3c3f646cfb08e220e7830c178', 'request_id': 'req-e26d16ec-71da-436a-8785-940b9eba9d4e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:26.969374 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] The token cache is being invalidate because project 9650bea3c3f646cfb08e220e7830c178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:26.969656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:26.970269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:26.972065 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1025/2073] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:26 2022] DELETE /identity/v3/projects/9650bea3c3f646cfb08e220e7830c178 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:26.975977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7f7b3-8765-4e44-8e2d-3c43fd8e1cc6 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:26.985902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7f7b3-8765-4e44-8e2d-3c43fd8e1cc6 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:27.042926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c3d7a-a81e-48b1-a27b-fcb3092429f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:27.044250 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c3d7a-a81e-48b1-a27b-fcb3092429f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:27.044529 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c3d7a-a81e-48b1-a27b-fcb3092429f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:27.044802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c3d7a-a81e-48b1-a27b-fcb3092429f5 admin admin] PATH_INFO: `/v3/users/30bd31c7bc6844388032f871c01830f7` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:27.045972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c3d7a-a81e-48b1-a27b-fcb3092429f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30bd31c7bc6844388032f871c01830f7)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:27.047898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c3d7a-a81e-48b1-a27b-fcb3092429f5 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:27.091937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-674c3d7a-a81e-48b1-a27b-fcb3092429f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bd31c7bc6844388032f871c01830f7'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:27.098679 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-674c3d7a-a81e-48b1-a27b-fcb3092429f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bd31c7bc6844388032f871c01830f7'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:27.099343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-674c3d7a-a81e-48b1-a27b-fcb3092429f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bd31c7bc6844388032f871c01830f7'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:27.099941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-674c3d7a-a81e-48b1-a27b-fcb3092429f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bd31c7bc6844388032f871c01830f7'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:27.111603 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-674c3d7a-a81e-48b1-a27b-fcb3092429f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bd31c7bc6844388032f871c01830f7'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:27.125044 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1049/2074] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:26 2022] DELETE /identity/v3/users/30bd31c7bc6844388032f871c01830f7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:27.413726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:27.415174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:27.429101 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d16ec-71da-436a-8785-940b9eba9d4e admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:27.492210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c031281-1d2e-41a3-a150-cc154048d7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:27.493096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c031281-1d2e-41a3-a150-cc154048d7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:27.493378 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c031281-1d2e-41a3-a150-cc154048d7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:27.493650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c031281-1d2e-41a3-a150-cc154048d7c6 admin admin] PATH_INFO: `/v3/projects/ae612fd39e854eca9331410632504370` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:27.494847 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c031281-1d2e-41a3-a150-cc154048d7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae612fd39e854eca9331410632504370)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:27.496820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c031281-1d2e-41a3-a150-cc154048d7c6 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:27.540252 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-8c031281-1d2e-41a3-a150-cc154048d7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae612fd39e854eca9331410632504370', 'request_id': 'req-8c031281-1d2e-41a3-a150-cc154048d7c6'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:27.546042 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-8c031281-1d2e-41a3-a150-cc154048d7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae612fd39e854eca9331410632504370', 'request_id': 'req-8c031281-1d2e-41a3-a150-cc154048d7c6'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:27.552372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-8c031281-1d2e-41a3-a150-cc154048d7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae612fd39e854eca9331410632504370', 'request_id': 'req-8c031281-1d2e-41a3-a150-cc154048d7c6'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:27.563200 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-8c031281-1d2e-41a3-a150-cc154048d7c6 admin admin] The token cache is being invalidate because project ae612fd39e854eca9331410632504370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:27.563425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-8c031281-1d2e-41a3-a150-cc154048d7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:27.564045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-8c031281-1d2e-41a3-a150-cc154048d7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:27.565606 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1026/2075] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:27 2022] DELETE /identity/v3/projects/ae612fd39e854eca9331410632504370 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:27.571334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36443acb-d9ba-468b-9c4c-f52f1cc9732c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:27.571799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36443acb-d9ba-468b-9c4c-f52f1cc9732c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:27.572208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36443acb-d9ba-468b-9c4c-f52f1cc9732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:27.590862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-36443acb-d9ba-468b-9c4c-f52f1cc9732c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:27.592048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-36443acb-d9ba-468b-9c4c-f52f1cc9732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:27.649566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1050/2076] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:27.657771 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27932c-d926-4932-b789-eb281e0d8e7c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:27.658058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27932c-d926-4932-b789-eb281e0d8e7c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:27.658329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27932c-d926-4932-b789-eb281e0d8e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:27.676966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-ae27932c-d926-4932-b789-eb281e0d8e7c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:27.678173 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ae27932c-d926-4932-b789-eb281e0d8e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:27.686319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1027/2077] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:27.690520 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36443acb-d9ba-468b-9c4c-f52f1cc9732c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:27.700031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36443acb-d9ba-468b-9c4c-f52f1cc9732c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:27.704908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4a76-d96f-499f-89c8-1085fec7e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:27.705634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4a76-d96f-499f-89c8-1085fec7e7be admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:27.706040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4a76-d96f-499f-89c8-1085fec7e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:27.706379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4a76-d96f-499f-89c8-1085fec7e7be admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:27.707256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f4a76-d96f-499f-89c8-1085fec7e7be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:27.707586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f4a76-d96f-499f-89c8-1085fec7e7be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:27.709324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f4a76-d96f-499f-89c8-1085fec7e7be admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:27.721484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1051/2078] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:12:27.726041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27932c-d926-4932-b789-eb281e0d8e7c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:27.735790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27932c-d926-4932-b789-eb281e0d8e7c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:27.740800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2f686-530a-4cb7-acff-2132de1bda11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:27.741474 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2f686-530a-4cb7-acff-2132de1bda11 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:27.741756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2f686-530a-4cb7-acff-2132de1bda11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:27.742027 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2f686-530a-4cb7-acff-2132de1bda11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:27.742758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2f686-530a-4cb7-acff-2132de1bda11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:27.744698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2f686-530a-4cb7-acff-2132de1bda11 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:27.770728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1028/2079] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:27 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:27.775033 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4a76-d96f-499f-89c8-1085fec7e7be admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:27.785405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4a76-d96f-499f-89c8-1085fec7e7be admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:27.838155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3428806-b10f-4f94-b449-91952038017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:27.838810 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3428806-b10f-4f94-b449-91952038017a admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:27.839087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3428806-b10f-4f94-b449-91952038017a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:27.839356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3428806-b10f-4f94-b449-91952038017a admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:27.840043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3428806-b10f-4f94-b449-91952038017a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:27.842718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3428806-b10f-4f94-b449-91952038017a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:27.862373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1052/2080] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:27 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:27.866414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2f686-530a-4cb7-acff-2132de1bda11 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:27.880078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2f686-530a-4cb7-acff-2132de1bda11 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:27.884625 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6f504-6310-4c69-b457-4d6a9efd683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:27.885264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6f504-6310-4c69-b457-4d6a9efd683e admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:27.885542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6f504-6310-4c69-b457-4d6a9efd683e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:27.885812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6f504-6310-4c69-b457-4d6a9efd683e admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:27.886528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6f504-6310-4c69-b457-4d6a9efd683e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:27.888653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6f504-6310-4c69-b457-4d6a9efd683e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:27.898532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1029/2081] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:27.902455 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3428806-b10f-4f94-b449-91952038017a admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:27.912855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3428806-b10f-4f94-b449-91952038017a admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:27.917436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106ac2c-e583-433c-9b05-de7fe0aed804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:27.918060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106ac2c-e583-433c-9b05-de7fe0aed804 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:27.918357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106ac2c-e583-433c-9b05-de7fe0aed804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:27.918611 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106ac2c-e583-433c-9b05-de7fe0aed804 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:27.919328 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106ac2c-e583-433c-9b05-de7fe0aed804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:27.920931 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106ac2c-e583-433c-9b05-de7fe0aed804 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:27.930518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1053/2082] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:27.934793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6f504-6310-4c69-b457-4d6a9efd683e admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:27.944418 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6f504-6310-4c69-b457-4d6a9efd683e admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:27.949295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77707b6d-1064-4dc3-87be-19313912e082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:27.950728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77707b6d-1064-4dc3-87be-19313912e082 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:27.951005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77707b6d-1064-4dc3-87be-19313912e082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:27.951273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77707b6d-1064-4dc3-87be-19313912e082 admin admin] PATH_INFO: `/v3/projects/7ccee7d5629b4a498b790cac18f828ef/users/96f1bae2097b4107830b4b6d3a8c5972/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:27.967054 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77707b6d-1064-4dc3-87be-19313912e082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ccee7d5629b4a498b790cac18f828ef, user_id=96f1bae2097b4107830b4b6d3a8c5972, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:27.969720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77707b6d-1064-4dc3-87be-19313912e082 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:27.982070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1030/2083] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:27 2022] PUT /identity/v3/projects/7ccee7d5629b4a498b790cac18f828ef/users/96f1bae2097b4107830b4b6d3a8c5972/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:27.992268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab6605-e46d-4d5b-a5b1-c723e35bbe42 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:27.992560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab6605-e46d-4d5b-a5b1-c723e35bbe42 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:27.992836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab6605-e46d-4d5b-a5b1-c723e35bbe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:28.018607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-8eab6605-e46d-4d5b-a5b1-c723e35bbe42 None None] MFA Rules not processed for user `96f1bae2097b4107830b4b6d3a8c5972`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:28.019797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8eab6605-e46d-4d5b-a5b1-c723e35bbe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:28.080605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1054/2084] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:28.085052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77707b6d-1064-4dc3-87be-19313912e082 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:28.144837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77707b6d-1064-4dc3-87be-19313912e082 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:28.149484 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd70a5c-8b24-4dab-a00c-6dfee45501c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:28.150125 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd70a5c-8b24-4dab-a00c-6dfee45501c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:28.150401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd70a5c-8b24-4dab-a00c-6dfee45501c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:28.150672 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd70a5c-8b24-4dab-a00c-6dfee45501c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:28.151357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd70a5c-8b24-4dab-a00c-6dfee45501c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:28.153367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd70a5c-8b24-4dab-a00c-6dfee45501c2 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:28.177124 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1031/2085] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:28 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:28.181077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab6605-e46d-4d5b-a5b1-c723e35bbe42 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:28.192106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab6605-e46d-4d5b-a5b1-c723e35bbe42 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:28.245862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707db2d-8962-4cf4-bda9-876cb5ff519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:28.247003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707db2d-8962-4cf4-bda9-876cb5ff519b admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:28.247352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707db2d-8962-4cf4-bda9-876cb5ff519b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:28.247574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707db2d-8962-4cf4-bda9-876cb5ff519b admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:28.248326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707db2d-8962-4cf4-bda9-876cb5ff519b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:28.250224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707db2d-8962-4cf4-bda9-876cb5ff519b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:28.270077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1055/2086] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:28 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:28.274077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd70a5c-8b24-4dab-a00c-6dfee45501c2 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:28.285350 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd70a5c-8b24-4dab-a00c-6dfee45501c2 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:28.288824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb957b-b6d1-4d42-a205-bfadc6a835d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:28.289469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb957b-b6d1-4d42-a205-bfadc6a835d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:28.289751 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb957b-b6d1-4d42-a205-bfadc6a835d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:28.290025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb957b-b6d1-4d42-a205-bfadc6a835d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:28.290768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb957b-b6d1-4d42-a205-bfadc6a835d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:28.292362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb957b-b6d1-4d42-a205-bfadc6a835d9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:28.304558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1032/2087] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:28.311661 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707db2d-8962-4cf4-bda9-876cb5ff519b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:28.321630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707db2d-8962-4cf4-bda9-876cb5ff519b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:28.326895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26705b0-f7ab-4393-a1dc-66b554b1127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:28.327757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26705b0-f7ab-4393-a1dc-66b554b1127f admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:28.328035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26705b0-f7ab-4393-a1dc-66b554b1127f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:28.328351 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26705b0-f7ab-4393-a1dc-66b554b1127f admin admin] PATH_INFO: `/v3/projects/62e84688477249a6b88d4ec52cc4367a/users/06ca1478ae9e412ea1b4b88d417cc99e/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:28.342402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26705b0-f7ab-4393-a1dc-66b554b1127f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e84688477249a6b88d4ec52cc4367a, user_id=06ca1478ae9e412ea1b4b88d417cc99e, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:28.345001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26705b0-f7ab-4393-a1dc-66b554b1127f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:28.357730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1056/2088] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:28 2022] PUT /identity/v3/projects/62e84688477249a6b88d4ec52cc4367a/users/06ca1478ae9e412ea1b4b88d417cc99e/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:28.361679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb957b-b6d1-4d42-a205-bfadc6a835d9 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:28.371302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb957b-b6d1-4d42-a205-bfadc6a835d9 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:28.424799 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3bccc-3f22-4647-a530-fa30ddc68a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:28.425530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3bccc-3f22-4647-a530-fa30ddc68a8e admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:28.425815 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3bccc-3f22-4647-a530-fa30ddc68a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:28.426093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3bccc-3f22-4647-a530-fa30ddc68a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:28.426815 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3bccc-3f22-4647-a530-fa30ddc68a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:28.428405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3bccc-3f22-4647-a530-fa30ddc68a8e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:28.438735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1033/2089] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:28.442832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26705b0-f7ab-4393-a1dc-66b554b1127f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:28.454129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26705b0-f7ab-4393-a1dc-66b554b1127f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:28.458726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83833cb-0172-40ee-ad7d-192bbec79fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:28.459591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83833cb-0172-40ee-ad7d-192bbec79fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:28.459873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83833cb-0172-40ee-ad7d-192bbec79fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:28.460178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83833cb-0172-40ee-ad7d-192bbec79fa6 admin admin] PATH_INFO: `/v3/projects/62e84688477249a6b88d4ec52cc4367a/users/06ca1478ae9e412ea1b4b88d417cc99e/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:28.462131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83833cb-0172-40ee-ad7d-192bbec79fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e84688477249a6b88d4ec52cc4367a, user_id=06ca1478ae9e412ea1b4b88d417cc99e, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:28.464792 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83833cb-0172-40ee-ad7d-192bbec79fa6 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:28.474546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1057/2090] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:28 2022] PUT /identity/v3/projects/62e84688477249a6b88d4ec52cc4367a/users/06ca1478ae9e412ea1b4b88d417cc99e/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:28.490846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766d84-57f7-4562-8a25-783818ecdda8 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:28.491131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766d84-57f7-4562-8a25-783818ecdda8 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:28.491405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766d84-57f7-4562-8a25-783818ecdda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:28.517879 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-cb766d84-57f7-4562-8a25-783818ecdda8 None None] MFA Rules not processed for user `06ca1478ae9e412ea1b4b88d417cc99e`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:28.519067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-cb766d84-57f7-4562-8a25-783818ecdda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:28.586157 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1034/2091] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:28.598387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83833cb-0172-40ee-ad7d-192bbec79fa6 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:28.600129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b83833cb-0172-40ee-ad7d-192bbec79fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:28.657500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83833cb-0172-40ee-ad7d-192bbec79fa6 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:28.661287 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f442da6-5cd4-48b1-8f67-d60c04cc6986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:28.661837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f442da6-5cd4-48b1-8f67-d60c04cc6986 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:28.662097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f442da6-5cd4-48b1-8f67-d60c04cc6986 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:28.662365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f442da6-5cd4-48b1-8f67-d60c04cc6986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:28.672908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f442da6-5cd4-48b1-8f67-d60c04cc6986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:28.674341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f442da6-5cd4-48b1-8f67-d60c04cc6986 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:28.684203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1058/2092] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:28.765549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766d84-57f7-4562-8a25-783818ecdda8 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:28.775069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766d84-57f7-4562-8a25-783818ecdda8 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:28.779438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98579198-a71c-4d89-9c3f-40be425fa91a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:28.780074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98579198-a71c-4d89-9c3f-40be425fa91a service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:28.780438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98579198-a71c-4d89-9c3f-40be425fa91a service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:28.780745 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98579198-a71c-4d89-9c3f-40be425fa91a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:28.835690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98579198-a71c-4d89-9c3f-40be425fa91a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:28.837142 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98579198-a71c-4d89-9c3f-40be425fa91a service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:28.846934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1035/2093] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:30.231613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f442da6-5cd4-48b1-8f67-d60c04cc6986 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:30.240116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f442da6-5cd4-48b1-8f67-d60c04cc6986 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:30.243709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed738bcf-4a5a-4bde-b6f6-01dd52c34a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:30.244374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738bcf-4a5a-4bde-b6f6-01dd52c34a84 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:30.244680 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738bcf-4a5a-4bde-b6f6-01dd52c34a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:30.244953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738bcf-4a5a-4bde-b6f6-01dd52c34a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:30.246781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ed738bcf-4a5a-4bde-b6f6-01dd52c34a84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:30.306901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed738bcf-4a5a-4bde-b6f6-01dd52c34a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:30.308683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed738bcf-4a5a-4bde-b6f6-01dd52c34a84 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:30.318123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1059/2094] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:33.331622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98579198-a71c-4d89-9c3f-40be425fa91a service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:33.332917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-98579198-a71c-4d89-9c3f-40be425fa91a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:33.345776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98579198-a71c-4d89-9c3f-40be425fa91a service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:33.354709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74a044-db0b-4a62-8444-a27f88ebf55d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:33.355363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74a044-db0b-4a62-8444-a27f88ebf55d service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:33.356211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74a044-db0b-4a62-8444-a27f88ebf55d service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:33.356491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74a044-db0b-4a62-8444-a27f88ebf55d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:33.358312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ac74a044-db0b-4a62-8444-a27f88ebf55d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:33.421629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74a044-db0b-4a62-8444-a27f88ebf55d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:33.423111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74a044-db0b-4a62-8444-a27f88ebf55d service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:33.433301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1036/2095] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:44.479095 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed738bcf-4a5a-4bde-b6f6-01dd52c34a84 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:44.480542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ed738bcf-4a5a-4bde-b6f6-01dd52c34a84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:44.545275 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed738bcf-4a5a-4bde-b6f6-01dd52c34a84 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:44.550396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:44.551249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:44.551527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:44.551829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] PATH_INFO: `/v3/users/c6886e9997b1444e84aa15ac8f150f85` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:44.553027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6886e9997b1444e84aa15ac8f150f85)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:44.554943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:44.601935 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6886e9997b1444e84aa15ac8f150f85'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:44.608337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6886e9997b1444e84aa15ac8f150f85'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:44.609639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6886e9997b1444e84aa15ac8f150f85'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:44.610237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6886e9997b1444e84aa15ac8f150f85'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:44.621971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6886e9997b1444e84aa15ac8f150f85'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:44.633808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1060/2096] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:44 2022] DELETE /identity/v3/users/c6886e9997b1444e84aa15ac8f150f85 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:44.638135 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f230f3-c49d-4eaa-86f5-8e987fd91bf5 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:44.638606 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f230f3-c49d-4eaa-86f5-8e987fd91bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:44.638696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f230f3-c49d-4eaa-86f5-8e987fd91bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:44.656218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-e6f230f3-c49d-4eaa-86f5-8e987fd91bf5 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:44.657930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e6f230f3-c49d-4eaa-86f5-8e987fd91bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:44.717359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1037/2097] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:44.727374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:44.728779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:44.787055 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b8f94-da46-45d5-a2c2-20b2db5be665 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:44.790791 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b323a2-099d-4b3a-8a0d-5960abdb940a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:44.791432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b323a2-099d-4b3a-8a0d-5960abdb940a service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:44.791717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b323a2-099d-4b3a-8a0d-5960abdb940a service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:44.791995 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b323a2-099d-4b3a-8a0d-5960abdb940a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:44.801994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b323a2-099d-4b3a-8a0d-5960abdb940a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:44.803411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b323a2-099d-4b3a-8a0d-5960abdb940a service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:44.813973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1061/2098] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:44.920352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f230f3-c49d-4eaa-86f5-8e987fd91bf5 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:44.923340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e6f230f3-c49d-4eaa-86f5-8e987fd91bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:44.936371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f230f3-c49d-4eaa-86f5-8e987fd91bf5 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:44.942071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:44.943542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:44.944000 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:44.944586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] PATH_INFO: `/v3/users/54f88ee0f9f0441fa5b2bede22187d03` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:44.945985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f88ee0f9f0441fa5b2bede22187d03)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:44.949489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:45.027015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f88ee0f9f0441fa5b2bede22187d03'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.036806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f88ee0f9f0441fa5b2bede22187d03'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.049874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f88ee0f9f0441fa5b2bede22187d03'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.052031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f88ee0f9f0441fa5b2bede22187d03'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.053063 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f88ee0f9f0441fa5b2bede22187d03'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.079550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1038/2099] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:44 2022] DELETE /identity/v3/users/54f88ee0f9f0441fa5b2bede22187d03 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:45.084278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93580f-d727-4927-aeb6-957e810148e4 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.084566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93580f-d727-4927-aeb6-957e810148e4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.084847 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93580f-d727-4927-aeb6-957e810148e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.105373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ac93580f-d727-4927-aeb6-957e810148e4 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:45.106825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ac93580f-d727-4927-aeb6-957e810148e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:45.148901 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:45.150360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:45.186476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1062/2100] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:45.196367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93580f-d727-4927-aeb6-957e810148e4 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:45.197863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ac93580f-d727-4927-aeb6-957e810148e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:45.221558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203850f-fa1a-4c7d-b310-e8ccdf998dc5 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:45.227454 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:45.228484 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.228631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.228910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1 admin admin] PATH_INFO: `/v3/projects/4a22da8a01cc4bf1a7d1d1ae67cf5ede` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.230112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a22da8a01cc4bf1a7d1d1ae67cf5ede)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:45.232055 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:45.259480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93580f-d727-4927-aeb6-957e810148e4 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:45.263619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf4177-1df6-413b-8032-24c396811230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:45.264509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf4177-1df6-413b-8032-24c396811230 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.265306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf4177-1df6-413b-8032-24c396811230 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.265673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf4177-1df6-413b-8032-24c396811230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.275026 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf4177-1df6-413b-8032-24c396811230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:45.276490 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf4177-1df6-413b-8032-24c396811230 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:45.279963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a22da8a01cc4bf1a7d1d1ae67cf5ede', 'request_id': 'req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.285837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a22da8a01cc4bf1a7d1d1ae67cf5ede', 'request_id': 'req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.287176 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1063/2101] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:12:45.293559 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a22da8a01cc4bf1a7d1d1ae67cf5ede', 'request_id': 'req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.305263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1 admin admin] The token cache is being invalidate because project 4a22da8a01cc4bf1a7d1d1ae67cf5ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:45.305625 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.306362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-625ad0ee-32c4-4aca-ab1e-afb8216e76b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.308283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1039/2102] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:45 2022] DELETE /identity/v3/projects/4a22da8a01cc4bf1a7d1d1ae67cf5ede => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:45.315053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f36d7-8aad-4fb1-9153-521fd302084b None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.315442 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f36d7-8aad-4fb1-9153-521fd302084b None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.315741 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f36d7-8aad-4fb1-9153-521fd302084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.334691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-d40f36d7-8aad-4fb1-9153-521fd302084b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:45.335961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d40f36d7-8aad-4fb1-9153-521fd302084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:45.403767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1064/2103] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:45.413028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001f830-af48-41b2-961e-b1ff72e48d80 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.413347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001f830-af48-41b2-961e-b1ff72e48d80 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.413607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001f830-af48-41b2-961e-b1ff72e48d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.435621 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8001f830-af48-41b2-961e-b1ff72e48d80 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:45.437376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8001f830-af48-41b2-961e-b1ff72e48d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:45.461360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1040/2104] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:45.465887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f36d7-8aad-4fb1-9153-521fd302084b None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:45.475887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f36d7-8aad-4fb1-9153-521fd302084b None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:45.481441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a0cca-93e9-49b5-b66c-6aec8808c1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:45.482111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a0cca-93e9-49b5-b66c-6aec8808c1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.482438 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a0cca-93e9-49b5-b66c-6aec8808c1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.482733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a0cca-93e9-49b5-b66c-6aec8808c1e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.483674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a0cca-93e9-49b5-b66c-6aec8808c1e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:45.483987 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a0cca-93e9-49b5-b66c-6aec8808c1e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:45.485610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a0cca-93e9-49b5-b66c-6aec8808c1e1 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:45.500215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1065/2105] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:12:45.503846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001f830-af48-41b2-961e-b1ff72e48d80 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:45.515325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001f830-af48-41b2-961e-b1ff72e48d80 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:45.521281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6677d7f-97a4-424b-ba76-78eecad1b9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:45.522231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6677d7f-97a4-424b-ba76-78eecad1b9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.522546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6677d7f-97a4-424b-ba76-78eecad1b9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.522885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6677d7f-97a4-424b-ba76-78eecad1b9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.523873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6677d7f-97a4-424b-ba76-78eecad1b9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:45.526663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6677d7f-97a4-424b-ba76-78eecad1b9b2 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:45.558899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1041/2106] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:45 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:45.563827 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a0cca-93e9-49b5-b66c-6aec8808c1e1 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:45.574185 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a0cca-93e9-49b5-b66c-6aec8808c1e1 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:45.594016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6677d7f-97a4-424b-ba76-78eecad1b9b2 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:45.596856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f6677d7f-97a4-424b-ba76-78eecad1b9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:45.635177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f70ea2-e3aa-466a-8ac1-ec48a00d43ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:45.635849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f70ea2-e3aa-466a-8ac1-ec48a00d43ba admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.636155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f70ea2-e3aa-466a-8ac1-ec48a00d43ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.636428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f70ea2-e3aa-466a-8ac1-ec48a00d43ba admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.637168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f70ea2-e3aa-466a-8ac1-ec48a00d43ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:45.639054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f70ea2-e3aa-466a-8ac1-ec48a00d43ba admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:45.665459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1066/2107] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:45 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:45.669467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f70ea2-e3aa-466a-8ac1-ec48a00d43ba admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:45.681804 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f70ea2-e3aa-466a-8ac1-ec48a00d43ba admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:45.688074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d46008-7c37-44f8-a868-d2fbca774844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:45.688755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d46008-7c37-44f8-a868-d2fbca774844 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.689042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d46008-7c37-44f8-a868-d2fbca774844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.689446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d46008-7c37-44f8-a868-d2fbca774844 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.690180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d46008-7c37-44f8-a868-d2fbca774844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:45.690291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6677d7f-97a4-424b-ba76-78eecad1b9b2 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:45.691765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d46008-7c37-44f8-a868-d2fbca774844 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:45.694957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:45.695804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.696328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.696602 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] PATH_INFO: `/v3/projects/1e4955dd1480437b9df29d6a9009d05f` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.697775 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4955dd1480437b9df29d6a9009d05f)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:45.699645 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:45.701962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1067/2108] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:45.706664 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d46008-7c37-44f8-a868-d2fbca774844 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:45.716522 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d46008-7c37-44f8-a868-d2fbca774844 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:45.721800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bd4b5-4164-4e96-85ab-07d01fa39665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:45.722626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bd4b5-4164-4e96-85ab-07d01fa39665 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.722775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bd4b5-4164-4e96-85ab-07d01fa39665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.723005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bd4b5-4164-4e96-85ab-07d01fa39665 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.723726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bd4b5-4164-4e96-85ab-07d01fa39665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:45.725507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bd4b5-4164-4e96-85ab-07d01fa39665 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:45.738563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1068/2109] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:45.742560 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bd4b5-4164-4e96-85ab-07d01fa39665 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:45.754389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bd4b5-4164-4e96-85ab-07d01fa39665 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:45.761604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4955dd1480437b9df29d6a9009d05f', 'request_id': 'req-1814ec43-6a16-49fb-a44a-35c807b183eb'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.767898 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4955dd1480437b9df29d6a9009d05f', 'request_id': 'req-1814ec43-6a16-49fb-a44a-35c807b183eb'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.776066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4955dd1480437b9df29d6a9009d05f', 'request_id': 'req-1814ec43-6a16-49fb-a44a-35c807b183eb'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.790080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] The token cache is being invalidate because project 1e4955dd1480437b9df29d6a9009d05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:45.790380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.791278 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.793262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1042/2110] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:45 2022] DELETE /identity/v3/projects/1e4955dd1480437b9df29d6a9009d05f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:45.797367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:45.798708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:45.818721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdc727-6d55-4f54-aad9-5a521cafa203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:45.819535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdc727-6d55-4f54-aad9-5a521cafa203 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.819815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdc727-6d55-4f54-aad9-5a521cafa203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.820101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdc727-6d55-4f54-aad9-5a521cafa203 admin admin] PATH_INFO: `/v3/projects/056053aa5e064b0faa8bb4a288cbe046/users/e44db0900b884ce9b0ba14ebead7d43b/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.834513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdc727-6d55-4f54-aad9-5a521cafa203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056053aa5e064b0faa8bb4a288cbe046, user_id=e44db0900b884ce9b0ba14ebead7d43b, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:45.837224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdc727-6d55-4f54-aad9-5a521cafa203 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:45.849934 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1069/2111] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:45 2022] PUT /identity/v3/projects/056053aa5e064b0faa8bb4a288cbe046/users/e44db0900b884ce9b0ba14ebead7d43b/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:45.850779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdc727-6d55-4f54-aad9-5a521cafa203 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:45.852355 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-decdc727-6d55-4f54-aad9-5a521cafa203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:45.867975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ec43-6a16-49fb-a44a-35c807b183eb admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:45.913621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdc727-6d55-4f54-aad9-5a521cafa203 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:45.918233 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474acb1f-de20-4e7f-98bf-94a521755c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:45.919094 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474acb1f-de20-4e7f-98bf-94a521755c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.919373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474acb1f-de20-4e7f-98bf-94a521755c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.919645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474acb1f-de20-4e7f-98bf-94a521755c16 admin admin] PATH_INFO: `/v3/users/96f1bae2097b4107830b4b6d3a8c5972` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.920836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474acb1f-de20-4e7f-98bf-94a521755c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f1bae2097b4107830b4b6d3a8c5972)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:45.922176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bea39-a897-47cd-a661-d22208a6387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:45.923037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bea39-a897-47cd-a661-d22208a6387c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:45.923256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474acb1f-de20-4e7f-98bf-94a521755c16 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:45.923362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bea39-a897-47cd-a661-d22208a6387c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:45.923574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bea39-a897-47cd-a661-d22208a6387c admin admin] PATH_INFO: `/v3/users/2844b5e6f70a410b815b3b75b6f10d09` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:45.924790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bea39-a897-47cd-a661-d22208a6387c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2844b5e6f70a410b815b3b75b6f10d09)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:45.926683 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bea39-a897-47cd-a661-d22208a6387c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:45.968927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-474acb1f-de20-4e7f-98bf-94a521755c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f1bae2097b4107830b4b6d3a8c5972'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.971758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0f9bea39-a897-47cd-a661-d22208a6387c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2844b5e6f70a410b815b3b75b6f10d09'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.975395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-474acb1f-de20-4e7f-98bf-94a521755c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f1bae2097b4107830b4b6d3a8c5972'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.976080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-474acb1f-de20-4e7f-98bf-94a521755c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f1bae2097b4107830b4b6d3a8c5972'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.976810 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-474acb1f-de20-4e7f-98bf-94a521755c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f1bae2097b4107830b4b6d3a8c5972'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.978856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0f9bea39-a897-47cd-a661-d22208a6387c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2844b5e6f70a410b815b3b75b6f10d09'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.986060 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0f9bea39-a897-47cd-a661-d22208a6387c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2844b5e6f70a410b815b3b75b6f10d09'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.986701 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0f9bea39-a897-47cd-a661-d22208a6387c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2844b5e6f70a410b815b3b75b6f10d09'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.987332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0f9bea39-a897-47cd-a661-d22208a6387c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2844b5e6f70a410b815b3b75b6f10d09'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:45.989090 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-474acb1f-de20-4e7f-98bf-94a521755c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f1bae2097b4107830b4b6d3a8c5972'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.001801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1070/2112] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:45 2022] DELETE /identity/v3/users/96f1bae2097b4107830b4b6d3a8c5972 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:46.003042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcdd4f-3827-4437-8e98-44bc4195496d None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:46.003328 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcdd4f-3827-4437-8e98-44bc4195496d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:46.003602 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcdd4f-3827-4437-8e98-44bc4195496d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:46.005295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1043/2113] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:45 2022] DELETE /identity/v3/users/2844b5e6f70a410b815b3b75b6f10d09 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:46.006558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcafb23-bb8b-4315-a7ce-fc25997d553e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:46.006847 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcafb23-bb8b-4315-a7ce-fc25997d553e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:46.007125 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcafb23-bb8b-4315-a7ce-fc25997d553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:46.026006 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-6bcafb23-bb8b-4315-a7ce-fc25997d553e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:46.027228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6bcafb23-bb8b-4315-a7ce-fc25997d553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:46.040973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-5bbcdd4f-3827-4437-8e98-44bc4195496d None None] MFA Rules not processed for user `e44db0900b884ce9b0ba14ebead7d43b`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:46.042796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5bbcdd4f-3827-4437-8e98-44bc4195496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:46.095862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1044/2114] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:46.103723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcafb23-bb8b-4315-a7ce-fc25997d553e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:46.105448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6bcafb23-bb8b-4315-a7ce-fc25997d553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:46.113953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1071/2115] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:46.134124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcdd4f-3827-4437-8e98-44bc4195496d None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:46.134124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5bbcdd4f-3827-4437-8e98-44bc4195496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:46.188362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcafb23-bb8b-4315-a7ce-fc25997d553e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:46.192918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183eb0-1d95-469e-9ad2-8bc301b597c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:46.193653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183eb0-1d95-469e-9ad2-8bc301b597c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:46.193934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183eb0-1d95-469e-9ad2-8bc301b597c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:46.194207 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183eb0-1d95-469e-9ad2-8bc301b597c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:46.205405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1183eb0-1d95-469e-9ad2-8bc301b597c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:46.207028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1183eb0-1d95-469e-9ad2-8bc301b597c9 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:46.218249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1045/2116] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:12:46.233986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcdd4f-3827-4437-8e98-44bc4195496d None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:46.239338 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dfb45-e2d1-41f9-bb84-5550a546c6fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:46.241018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dfb45-e2d1-41f9-bb84-5550a546c6fb service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:46.242427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dfb45-e2d1-41f9-bb84-5550a546c6fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:46.242781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dfb45-e2d1-41f9-bb84-5550a546c6fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:46.261024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dfb45-e2d1-41f9-bb84-5550a546c6fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:46.263624 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dfb45-e2d1-41f9-bb84-5550a546c6fb service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:46.275547 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1072/2117] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:46.443030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183eb0-1d95-469e-9ad2-8bc301b597c9 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:46.444517 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c1183eb0-1d95-469e-9ad2-8bc301b597c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:46.465090 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183eb0-1d95-469e-9ad2-8bc301b597c9 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:46.485132 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:46.486110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:46.486452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:46.486876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] PATH_INFO: `/v3/projects/331d7c7669f74fae9b1acd7ed16b4059` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:46.488229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] RBAC: Authorizing `identity:delete_project(project_id=331d7c7669f74fae9b1acd7ed16b4059)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:46.490400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:46.576480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331d7c7669f74fae9b1acd7ed16b4059', 'request_id': 'req-5f515335-af3d-4353-9d75-3461f977818e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.587267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331d7c7669f74fae9b1acd7ed16b4059', 'request_id': 'req-5f515335-af3d-4353-9d75-3461f977818e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.599169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331d7c7669f74fae9b1acd7ed16b4059', 'request_id': 'req-5f515335-af3d-4353-9d75-3461f977818e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.636269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] The token cache is being invalidate because project 331d7c7669f74fae9b1acd7ed16b4059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:46.636656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.637482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.641045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1046/2118] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:46 2022] DELETE /identity/v3/projects/331d7c7669f74fae9b1acd7ed16b4059 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:46.645093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dfb45-e2d1-41f9-bb84-5550a546c6fb service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:46.670087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dfb45-e2d1-41f9-bb84-5550a546c6fb service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:46.695106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:46.696999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:46.765606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:46.766901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:46.767389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:46.768067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] PATH_INFO: `/v3/users/7623b0c393234ef19ddac614b8a664ee` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:46.769665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7623b0c393234ef19ddac614b8a664ee)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:46.773242 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:46.814433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f515335-af3d-4353-9d75-3461f977818e admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:46.819660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:46.820781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:46.821266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:46.821781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] PATH_INFO: `/v3/projects/7ccee7d5629b4a498b790cac18f828ef` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:46.823148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ccee7d5629b4a498b790cac18f828ef)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:46.825278 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:46.829693 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7623b0c393234ef19ddac614b8a664ee'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.837644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7623b0c393234ef19ddac614b8a664ee'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.838315 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7623b0c393234ef19ddac614b8a664ee'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.838925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7623b0c393234ef19ddac614b8a664ee'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.859638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7623b0c393234ef19ddac614b8a664ee'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.880892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1073/2119] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:46 2022] DELETE /identity/v3/users/7623b0c393234ef19ddac614b8a664ee => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:46.900067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ccee7d5629b4a498b790cac18f828ef', 'request_id': 'req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.905904 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ccee7d5629b4a498b790cac18f828ef', 'request_id': 'req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.913966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ccee7d5629b4a498b790cac18f828ef', 'request_id': 'req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.926702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] The token cache is being invalidate because project 7ccee7d5629b4a498b790cac18f828ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:46.926986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.927651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:46.929458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1047/2120] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:46 2022] DELETE /identity/v3/projects/7ccee7d5629b4a498b790cac18f828ef => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:46.935345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:46.937539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:47.006197 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1326a-4976-4a62-8a0f-ef7c4d460fcc admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.011049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3f242-bd6b-47b3-89c8-bf61bd652b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.011933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3f242-bd6b-47b3-89c8-bf61bd652b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.012303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3f242-bd6b-47b3-89c8-bf61bd652b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.013051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3f242-bd6b-47b3-89c8-bf61bd652b2e admin admin] PATH_INFO: `/v3/users/06ca1478ae9e412ea1b4b88d417cc99e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.014410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3f242-bd6b-47b3-89c8-bf61bd652b2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ca1478ae9e412ea1b4b88d417cc99e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.016994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3f242-bd6b-47b3-89c8-bf61bd652b2e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.070923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-49a3f242-bd6b-47b3-89c8-bf61bd652b2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ca1478ae9e412ea1b4b88d417cc99e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.078254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-49a3f242-bd6b-47b3-89c8-bf61bd652b2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ca1478ae9e412ea1b4b88d417cc99e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.078946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-49a3f242-bd6b-47b3-89c8-bf61bd652b2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ca1478ae9e412ea1b4b88d417cc99e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.079574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-49a3f242-bd6b-47b3-89c8-bf61bd652b2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ca1478ae9e412ea1b4b88d417cc99e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.091641 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-49a3f242-bd6b-47b3-89c8-bf61bd652b2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ca1478ae9e412ea1b4b88d417cc99e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.103910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1074/2121] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:46 2022] DELETE /identity/v3/users/06ca1478ae9e412ea1b4b88d417cc99e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:47.154110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.155589 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:47.226828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6c9fb-c4e0-4827-b20a-839e7ec98bea admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.289164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.290030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.290307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.290602 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] PATH_INFO: `/v3/projects/3dbe8be45d534e408dd99b255122c52e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.291774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dbe8be45d534e408dd99b255122c52e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.293686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.339257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dbe8be45d534e408dd99b255122c52e', 'request_id': 'req-b14473a4-53e5-4c7a-a088-ec46450201ad'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.345450 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dbe8be45d534e408dd99b255122c52e', 'request_id': 'req-b14473a4-53e5-4c7a-a088-ec46450201ad'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.355736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dbe8be45d534e408dd99b255122c52e', 'request_id': 'req-b14473a4-53e5-4c7a-a088-ec46450201ad'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.371228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] The token cache is being invalidate because project 3dbe8be45d534e408dd99b255122c52e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:47.371439 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.372310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.376120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1048/2122] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:47 2022] DELETE /identity/v3/projects/3dbe8be45d534e408dd99b255122c52e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:47.379196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03ccfb-58d8-4c9b-8a09-d94b7d22a154 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.379582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03ccfb-58d8-4c9b-8a09-d94b7d22a154 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.379971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03ccfb-58d8-4c9b-8a09-d94b7d22a154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.397004 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.398549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:47.402505 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-9e03ccfb-58d8-4c9b-8a09-d94b7d22a154 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:47.403732 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9e03ccfb-58d8-4c9b-8a09-d94b7d22a154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:47.468638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1075/2123] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:47.474088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14473a4-53e5-4c7a-a088-ec46450201ad admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.477205 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7759-f6ae-4619-8d9f-9aac589f4e78 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.477493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7759-f6ae-4619-8d9f-9aac589f4e78 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.477786 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7759-f6ae-4619-8d9f-9aac589f4e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.483884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca3efe-a443-4a24-9651-7ef0b8727da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.484811 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca3efe-a443-4a24-9651-7ef0b8727da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.485093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca3efe-a443-4a24-9651-7ef0b8727da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.485483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca3efe-a443-4a24-9651-7ef0b8727da8 admin admin] PATH_INFO: `/v3/projects/62e84688477249a6b88d4ec52cc4367a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.486717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca3efe-a443-4a24-9651-7ef0b8727da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e84688477249a6b88d4ec52cc4367a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.489666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca3efe-a443-4a24-9651-7ef0b8727da8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.501456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-d90b7759-f6ae-4619-8d9f-9aac589f4e78 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:47.502951 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d90b7759-f6ae-4619-8d9f-9aac589f4e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:47.515044 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1076/2124] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:47.519803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b7759-f6ae-4619-8d9f-9aac589f4e78 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.538952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b7759-f6ae-4619-8d9f-9aac589f4e78 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.543158 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-c2ca3efe-a443-4a24-9651-7ef0b8727da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e84688477249a6b88d4ec52cc4367a', 'request_id': 'req-c2ca3efe-a443-4a24-9651-7ef0b8727da8'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.552266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-c2ca3efe-a443-4a24-9651-7ef0b8727da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e84688477249a6b88d4ec52cc4367a', 'request_id': 'req-c2ca3efe-a443-4a24-9651-7ef0b8727da8'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.560203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-c2ca3efe-a443-4a24-9651-7ef0b8727da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e84688477249a6b88d4ec52cc4367a', 'request_id': 'req-c2ca3efe-a443-4a24-9651-7ef0b8727da8'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.575140 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-c2ca3efe-a443-4a24-9651-7ef0b8727da8 admin admin] The token cache is being invalidate because project 62e84688477249a6b88d4ec52cc4367a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:47.575412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-c2ca3efe-a443-4a24-9651-7ef0b8727da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.576139 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-c2ca3efe-a443-4a24-9651-7ef0b8727da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:47.578881 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1049/2125] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:47 2022] DELETE /identity/v3/projects/62e84688477249a6b88d4ec52cc4367a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:47.583693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37836386-8d13-410d-8e02-c8454cfa3710 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.584028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37836386-8d13-410d-8e02-c8454cfa3710 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.584337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37836386-8d13-410d-8e02-c8454cfa3710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.601292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c331f9c-decb-40e6-b21b-16e583f2b330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.602049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c331f9c-decb-40e6-b21b-16e583f2b330 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.602333 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c331f9c-decb-40e6-b21b-16e583f2b330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.602607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c331f9c-decb-40e6-b21b-16e583f2b330 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.603298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-37836386-8d13-410d-8e02-c8454cfa3710 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:47.603459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c331f9c-decb-40e6-b21b-16e583f2b330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:47.603770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c331f9c-decb-40e6-b21b-16e583f2b330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.604789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-37836386-8d13-410d-8e02-c8454cfa3710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:47.605590 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c331f9c-decb-40e6-b21b-16e583f2b330 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.614425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1050/2126] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:47.621614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1077/2127] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:12:47.621839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3916e4-88a8-4237-a384-dacbd2c1dee7 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.622339 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3916e4-88a8-4237-a384-dacbd2c1dee7 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.622623 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3916e4-88a8-4237-a384-dacbd2c1dee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.625951 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c331f9c-decb-40e6-b21b-16e583f2b330 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.627684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9c331f9c-decb-40e6-b21b-16e583f2b330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:47.644448 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c331f9c-decb-40e6-b21b-16e583f2b330 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.645810 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-bd3916e4-88a8-4237-a384-dacbd2c1dee7 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:47.647118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-bd3916e4-88a8-4237-a384-dacbd2c1dee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:47.649936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c5785-48f2-4082-b8a1-dfc52e62203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.650771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c5785-48f2-4082-b8a1-dfc52e62203e admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.651188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c5785-48f2-4082-b8a1-dfc52e62203e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.651471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c5785-48f2-4082-b8a1-dfc52e62203e admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.652190 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c5785-48f2-4082-b8a1-dfc52e62203e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.654626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c5785-48f2-4082-b8a1-dfc52e62203e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.677111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1051/2128] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:47.685598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3916e4-88a8-4237-a384-dacbd2c1dee7 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.688127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1078/2129] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:47 2022] POST /identity/v3/projects => generated 393 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:47.691674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c5785-48f2-4082-b8a1-dfc52e62203e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.697029 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3916e4-88a8-4237-a384-dacbd2c1dee7 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.770107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98d4e-3ecc-46da-804b-11ead04f52dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.770107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98d4e-3ecc-46da-804b-11ead04f52dc admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.770369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c5785-48f2-4082-b8a1-dfc52e62203e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.770478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98d4e-3ecc-46da-804b-11ead04f52dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.770478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98d4e-3ecc-46da-804b-11ead04f52dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.770478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98d4e-3ecc-46da-804b-11ead04f52dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:47.770478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98d4e-3ecc-46da-804b-11ead04f52dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.770478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98d4e-3ecc-46da-804b-11ead04f52dc admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.770792 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809b524-5544-4c1d-9d10-50ea4aa97edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.772129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809b524-5544-4c1d-9d10-50ea4aa97edd admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.772129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809b524-5544-4c1d-9d10-50ea4aa97edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.772129 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809b524-5544-4c1d-9d10-50ea4aa97edd admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.772754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809b524-5544-4c1d-9d10-50ea4aa97edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.775094 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809b524-5544-4c1d-9d10-50ea4aa97edd admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.780080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1052/2130] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:12:47.784627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98d4e-3ecc-46da-804b-11ead04f52dc admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.796187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98d4e-3ecc-46da-804b-11ead04f52dc admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.800826 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1079/2131] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:47 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:47.804386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcff8bf-5967-4f46-b46e-ebde6e3d29d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.804840 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809b524-5544-4c1d-9d10-50ea4aa97edd admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.805056 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcff8bf-5967-4f46-b46e-ebde6e3d29d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.805339 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcff8bf-5967-4f46-b46e-ebde6e3d29d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.805603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcff8bf-5967-4f46-b46e-ebde6e3d29d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.806284 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcff8bf-5967-4f46-b46e-ebde6e3d29d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.808462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcff8bf-5967-4f46-b46e-ebde6e3d29d9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.815768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809b524-5544-4c1d-9d10-50ea4aa97edd admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.821869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cb6d0-34d6-4e58-9503-d1cfffc98905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.822589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cb6d0-34d6-4e58-9503-d1cfffc98905 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.823912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cb6d0-34d6-4e58-9503-d1cfffc98905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.824227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cb6d0-34d6-4e58-9503-d1cfffc98905 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.824962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cb6d0-34d6-4e58-9503-d1cfffc98905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.826932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cb6d0-34d6-4e58-9503-d1cfffc98905 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.839280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1053/2132] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:47 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:47.839431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1080/2133] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:47.842641 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcff8bf-5967-4f46-b46e-ebde6e3d29d9 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.843429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cb6d0-34d6-4e58-9503-d1cfffc98905 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.852826 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cb6d0-34d6-4e58-9503-d1cfffc98905 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.902668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcff8bf-5967-4f46-b46e-ebde6e3d29d9 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.907315 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb78d6-7eaf-4992-a0c5-f8089f5fd90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.908028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb78d6-7eaf-4992-a0c5-f8089f5fd90a admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.908280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb78d6-7eaf-4992-a0c5-f8089f5fd90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.908553 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb78d6-7eaf-4992-a0c5-f8089f5fd90a admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.908736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7098f5e-d246-4df1-aad6-91af8f02561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.909246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb78d6-7eaf-4992-a0c5-f8089f5fd90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.909456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7098f5e-d246-4df1-aad6-91af8f02561e admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.909739 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7098f5e-d246-4df1-aad6-91af8f02561e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.910014 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7098f5e-d246-4df1-aad6-91af8f02561e admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.910735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7098f5e-d246-4df1-aad6-91af8f02561e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.911133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb78d6-7eaf-4992-a0c5-f8089f5fd90a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.912396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7098f5e-d246-4df1-aad6-91af8f02561e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.926171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1081/2134] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:47.927270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7098f5e-d246-4df1-aad6-91af8f02561e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.936111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1054/2135] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:47 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:47.937764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb78d6-7eaf-4992-a0c5-f8089f5fd90a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.941983 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7098f5e-d246-4df1-aad6-91af8f02561e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.947447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52911830-c082-42f8-b331-64c28e7df06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.948336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb78d6-7eaf-4992-a0c5-f8089f5fd90a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.948450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52911830-c082-42f8-b331-64c28e7df06b admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.948635 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52911830-c082-42f8-b331-64c28e7df06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.948972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52911830-c082-42f8-b331-64c28e7df06b admin admin] PATH_INFO: `/v3/projects/de174033bed947858b59493c17bfca22/users/a1427d17655f4ddc9f4c646c4023e5c8/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.954891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98f4c5-4c16-4450-ba8c-23a2d2f531d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:47.955589 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98f4c5-4c16-4450-ba8c-23a2d2f531d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.955876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98f4c5-4c16-4450-ba8c-23a2d2f531d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.956179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98f4c5-4c16-4450-ba8c-23a2d2f531d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:47.956910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98f4c5-4c16-4450-ba8c-23a2d2f531d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.958486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98f4c5-4c16-4450-ba8c-23a2d2f531d2 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.966045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52911830-c082-42f8-b331-64c28e7df06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de174033bed947858b59493c17bfca22, user_id=a1427d17655f4ddc9f4c646c4023e5c8, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:47.968766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52911830-c082-42f8-b331-64c28e7df06b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:47.969208 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1055/2136] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:47.973507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98f4c5-4c16-4450-ba8c-23a2d2f531d2 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:47.991306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1082/2137] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:47 2022] PUT /identity/v3/projects/de174033bed947858b59493c17bfca22/users/a1427d17655f4ddc9f4c646c4023e5c8/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:47.991832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98f4c5-4c16-4450-ba8c-23a2d2f531d2 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:47.993028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feecb0-42c7-44f6-acab-e517358c371f None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:47.993510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feecb0-42c7-44f6-acab-e517358c371f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:47.993792 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feecb0-42c7-44f6-acab-e517358c371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.021518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-85feecb0-42c7-44f6-acab-e517358c371f None None] MFA Rules not processed for user `a1427d17655f4ddc9f4c646c4023e5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:48.023000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-85feecb0-42c7-44f6-acab-e517358c371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:48.050882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed4218-5388-4d95-90cb-ef379fc073d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:48.051549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed4218-5388-4d95-90cb-ef379fc073d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:48.051826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed4218-5388-4d95-90cb-ef379fc073d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:48.052123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed4218-5388-4d95-90cb-ef379fc073d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.052851 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed4218-5388-4d95-90cb-ef379fc073d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:48.054444 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed4218-5388-4d95-90cb-ef379fc073d8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:48.066622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1056/2138] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:48.070905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed4218-5388-4d95-90cb-ef379fc073d8 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:48.081581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed4218-5388-4d95-90cb-ef379fc073d8 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:48.087489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6314b7c-b0b7-4587-9f4d-de4fcf4477a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:48.088882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6314b7c-b0b7-4587-9f4d-de4fcf4477a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:48.089222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6314b7c-b0b7-4587-9f4d-de4fcf4477a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:48.089498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6314b7c-b0b7-4587-9f4d-de4fcf4477a7 admin admin] PATH_INFO: `/v3/projects/091cffc0475f4722ad90a4af5f9ae315/users/8a20c8ac5a0346f0815fa5382fa2a2cb/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.104639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1083/2139] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:48.109776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6314b7c-b0b7-4587-9f4d-de4fcf4477a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091cffc0475f4722ad90a4af5f9ae315, user_id=8a20c8ac5a0346f0815fa5382fa2a2cb, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:48.112891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6314b7c-b0b7-4587-9f4d-de4fcf4477a7 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:48.113032 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85feecb0-42c7-44f6-acab-e517358c371f None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:48.114378 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-85feecb0-42c7-44f6-acab-e517358c371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:48.129441 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1057/2140] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:48 2022] PUT /identity/v3/projects/091cffc0475f4722ad90a4af5f9ae315/users/8a20c8ac5a0346f0815fa5382fa2a2cb/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:48.141121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1528d7-fbf7-4160-9686-99dc745e579c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:48.141411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1528d7-fbf7-4160-9686-99dc745e579c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:48.141683 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1528d7-fbf7-4160-9686-99dc745e579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.169669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-4f1528d7-fbf7-4160-9686-99dc745e579c None None] MFA Rules not processed for user `8a20c8ac5a0346f0815fa5382fa2a2cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:48.171605 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4f1528d7-fbf7-4160-9686-99dc745e579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:48.191216 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85feecb0-42c7-44f6-acab-e517358c371f None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:48.251590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1058/2141] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:48.256658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1528d7-fbf7-4160-9686-99dc745e579c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:48.281034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d742a-5d70-404a-a77a-ba490887abf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:48.282081 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d742a-5d70-404a-a77a-ba490887abf7 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:48.282364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d742a-5d70-404a-a77a-ba490887abf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:48.283020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d742a-5d70-404a-a77a-ba490887abf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.327627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1528d7-fbf7-4160-9686-99dc745e579c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:48.332525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b5bb4-966a-4ae1-adfa-9e3cfe302819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:48.333178 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b5bb4-966a-4ae1-adfa-9e3cfe302819 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:48.333458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b5bb4-966a-4ae1-adfa-9e3cfe302819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:48.333732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b5bb4-966a-4ae1-adfa-9e3cfe302819 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.334438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b5bb4-966a-4ae1-adfa-9e3cfe302819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:48.336394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b5bb4-966a-4ae1-adfa-9e3cfe302819 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:48.349492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d742a-5d70-404a-a77a-ba490887abf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:48.350912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d742a-5d70-404a-a77a-ba490887abf7 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:48.361278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1084/2142] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:12:48.367914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1059/2143] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:48 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:48.369002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d742a-5d70-404a-a77a-ba490887abf7 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:48.379443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d742a-5d70-404a-a77a-ba490887abf7 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:48.443123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8434c8-0b15-4eaa-8b44-59d0d3b9c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:48.443786 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8434c8-0b15-4eaa-8b44-59d0d3b9c960 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:48.444061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8434c8-0b15-4eaa-8b44-59d0d3b9c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:48.444358 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8434c8-0b15-4eaa-8b44-59d0d3b9c960 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.445034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8434c8-0b15-4eaa-8b44-59d0d3b9c960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:48.446966 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8434c8-0b15-4eaa-8b44-59d0d3b9c960 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:48.470253 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1085/2144] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:48 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:48.471258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b5bb4-966a-4ae1-adfa-9e3cfe302819 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:48.482222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b5bb4-966a-4ae1-adfa-9e3cfe302819 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:48.487603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019599c8-cece-43f0-8d9b-cf129a664642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:48.488296 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019599c8-cece-43f0-8d9b-cf129a664642 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:48.489013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019599c8-cece-43f0-8d9b-cf129a664642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:48.489116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019599c8-cece-43f0-8d9b-cf129a664642 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.489765 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019599c8-cece-43f0-8d9b-cf129a664642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:48.491379 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019599c8-cece-43f0-8d9b-cf129a664642 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:48.502054 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1060/2145] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:48.506046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8434c8-0b15-4eaa-8b44-59d0d3b9c960 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:48.515712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8434c8-0b15-4eaa-8b44-59d0d3b9c960 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:48.520503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195492d-11df-470d-90e9-4e21ff7fd95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:48.521424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195492d-11df-470d-90e9-4e21ff7fd95a admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:48.521703 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195492d-11df-470d-90e9-4e21ff7fd95a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:48.521976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195492d-11df-470d-90e9-4e21ff7fd95a admin admin] PATH_INFO: `/v3/projects/c8473f0b3f7d4866b569eaa2c11f4187/users/48ea8f625221482491b03a324e6c19a4/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.538286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195492d-11df-470d-90e9-4e21ff7fd95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8473f0b3f7d4866b569eaa2c11f4187, user_id=48ea8f625221482491b03a324e6c19a4, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:48.541197 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195492d-11df-470d-90e9-4e21ff7fd95a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:48.556874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1086/2146] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:48 2022] PUT /identity/v3/projects/c8473f0b3f7d4866b569eaa2c11f4187/users/48ea8f625221482491b03a324e6c19a4/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:48.560968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019599c8-cece-43f0-8d9b-cf129a664642 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:48.571388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019599c8-cece-43f0-8d9b-cf129a664642 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:48.629072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316a54e-b608-4199-8511-d0c4c42119d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:48.629783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316a54e-b608-4199-8511-d0c4c42119d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:48.630169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316a54e-b608-4199-8511-d0c4c42119d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:48.630553 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316a54e-b608-4199-8511-d0c4c42119d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.631274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316a54e-b608-4199-8511-d0c4c42119d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:48.632942 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316a54e-b608-4199-8511-d0c4c42119d0 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:48.643613 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1061/2147] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:48.647432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195492d-11df-470d-90e9-4e21ff7fd95a admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:48.660721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195492d-11df-470d-90e9-4e21ff7fd95a admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:48.666747 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e369f-d0a5-475c-9e2a-8bb48c1d2896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:48.668360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e369f-d0a5-475c-9e2a-8bb48c1d2896 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:48.668766 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e369f-d0a5-475c-9e2a-8bb48c1d2896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:48.669048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e369f-d0a5-475c-9e2a-8bb48c1d2896 admin admin] PATH_INFO: `/v3/projects/c8473f0b3f7d4866b569eaa2c11f4187/users/48ea8f625221482491b03a324e6c19a4/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.673363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e369f-d0a5-475c-9e2a-8bb48c1d2896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8473f0b3f7d4866b569eaa2c11f4187, user_id=48ea8f625221482491b03a324e6c19a4, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:48.676543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e369f-d0a5-475c-9e2a-8bb48c1d2896 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:48.692808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1087/2148] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:48 2022] PUT /identity/v3/projects/c8473f0b3f7d4866b569eaa2c11f4187/users/48ea8f625221482491b03a324e6c19a4/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:12:48.705831 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efc6b8-6de6-46e4-b057-931c28f7e22b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:48.706336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efc6b8-6de6-46e4-b057-931c28f7e22b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:48.706530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efc6b8-6de6-46e4-b057-931c28f7e22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.740018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-27efc6b8-6de6-46e4-b057-931c28f7e22b None None] MFA Rules not processed for user `48ea8f625221482491b03a324e6c19a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:48.741306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-27efc6b8-6de6-46e4-b057-931c28f7e22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:48.831080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1062/2149] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:48.850961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e369f-d0a5-475c-9e2a-8bb48c1d2896 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:48.852893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-166e369f-d0a5-475c-9e2a-8bb48c1d2896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:48.911614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e369f-d0a5-475c-9e2a-8bb48c1d2896 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:48.915163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64302cf4-5062-4f62-9543-c24bc900e8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:48.915794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302cf4-5062-4f62-9543-c24bc900e8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:48.916076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302cf4-5062-4f62-9543-c24bc900e8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:48.916441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302cf4-5062-4f62-9543-c24bc900e8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:48.926240 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64302cf4-5062-4f62-9543-c24bc900e8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:48.927911 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64302cf4-5062-4f62-9543-c24bc900e8f3 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:48.937850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1088/2150] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:49.428891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27efc6b8-6de6-46e4-b057-931c28f7e22b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:49.515791 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27efc6b8-6de6-46e4-b057-931c28f7e22b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:49.524008 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:49.524935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:49.525219 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:49.525494 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] PATH_INFO: `/v3/users/8a20c8ac5a0346f0815fa5382fa2a2cb` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:49.526874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a20c8ac5a0346f0815fa5382fa2a2cb)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:49.528877 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:49.581883 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a20c8ac5a0346f0815fa5382fa2a2cb'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:49.589776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a20c8ac5a0346f0815fa5382fa2a2cb'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:49.597503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a20c8ac5a0346f0815fa5382fa2a2cb'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:49.598526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a20c8ac5a0346f0815fa5382fa2a2cb'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:49.599267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a20c8ac5a0346f0815fa5382fa2a2cb'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:49.617183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1063/2151] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:49 2022] DELETE /identity/v3/users/8a20c8ac5a0346f0815fa5382fa2a2cb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:49.621835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714dd6a-08f1-42e1-ac95-6c6084ab5622 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:49.622142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714dd6a-08f1-42e1-ac95-6c6084ab5622 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:49.622425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714dd6a-08f1-42e1-ac95-6c6084ab5622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:49.644337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-6714dd6a-08f1-42e1-ac95-6c6084ab5622 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:49.645917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6714dd6a-08f1-42e1-ac95-6c6084ab5622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:49.707971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1089/2152] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:49.717309 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:49.718688 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:49.774000 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf6c25-56eb-47cf-b825-a611cd1e2f73 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:49.777693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b398e8-d206-4e69-953b-15f5e9a53103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:49.778340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b398e8-d206-4e69-953b-15f5e9a53103 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:49.778619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b398e8-d206-4e69-953b-15f5e9a53103 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:49.778890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b398e8-d206-4e69-953b-15f5e9a53103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:49.789388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b398e8-d206-4e69-953b-15f5e9a53103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:49.790811 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b398e8-d206-4e69-953b-15f5e9a53103 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:49.801273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1064/2153] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:50.076015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714dd6a-08f1-42e1-ac95-6c6084ab5622 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:50.077614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6714dd6a-08f1-42e1-ac95-6c6084ab5622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:50.102226 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714dd6a-08f1-42e1-ac95-6c6084ab5622 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:50.109708 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:50.110582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:50.110868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:50.111127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] PATH_INFO: `/v3/projects/091cffc0475f4722ad90a4af5f9ae315` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:50.112395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=091cffc0475f4722ad90a4af5f9ae315)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:50.121779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:50.159006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091cffc0475f4722ad90a4af5f9ae315', 'request_id': 'req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.165741 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091cffc0475f4722ad90a4af5f9ae315', 'request_id': 'req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.171879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091cffc0475f4722ad90a4af5f9ae315', 'request_id': 'req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.183025 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] The token cache is being invalidate because project 091cffc0475f4722ad90a4af5f9ae315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:50.183347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.183947 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.185513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1090/2154] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:50 2022] DELETE /identity/v3/projects/091cffc0475f4722ad90a4af5f9ae315 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:50.189325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b398e8-d206-4e69-953b-15f5e9a53103 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:50.199023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b398e8-d206-4e69-953b-15f5e9a53103 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:50.255069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b517e60-0fc5-48d8-a4e9-201bbd24968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:50.255934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b517e60-0fc5-48d8-a4e9-201bbd24968a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:50.256250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b517e60-0fc5-48d8-a4e9-201bbd24968a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:50.256630 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b517e60-0fc5-48d8-a4e9-201bbd24968a admin admin] PATH_INFO: `/v3/users/48ea8f625221482491b03a324e6c19a4` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:50.257837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b517e60-0fc5-48d8-a4e9-201bbd24968a admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ea8f625221482491b03a324e6c19a4)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:50.259811 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b517e60-0fc5-48d8-a4e9-201bbd24968a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:50.304446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7b517e60-0fc5-48d8-a4e9-201bbd24968a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ea8f625221482491b03a324e6c19a4'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.311126 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7b517e60-0fc5-48d8-a4e9-201bbd24968a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ea8f625221482491b03a324e6c19a4'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.317548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7b517e60-0fc5-48d8-a4e9-201bbd24968a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ea8f625221482491b03a324e6c19a4'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.318199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7b517e60-0fc5-48d8-a4e9-201bbd24968a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ea8f625221482491b03a324e6c19a4'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.318795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7b517e60-0fc5-48d8-a4e9-201bbd24968a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ea8f625221482491b03a324e6c19a4'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.335298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1065/2155] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:50 2022] DELETE /identity/v3/users/48ea8f625221482491b03a324e6c19a4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:50.610745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:50.612278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:50.625634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dcf1d-6807-40fb-a8b1-f3d9c8a44914 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:50.680517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:50.681388 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:50.681670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:50.681942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060 admin admin] PATH_INFO: `/v3/projects/c8473f0b3f7d4866b569eaa2c11f4187` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:50.683437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8473f0b3f7d4866b569eaa2c11f4187)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:50.685418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:50.730012 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8473f0b3f7d4866b569eaa2c11f4187', 'request_id': 'req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.739858 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8473f0b3f7d4866b569eaa2c11f4187', 'request_id': 'req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.745114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8473f0b3f7d4866b569eaa2c11f4187', 'request_id': 'req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.756427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060 admin admin] The token cache is being invalidate because project c8473f0b3f7d4866b569eaa2c11f4187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:50.756738 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.757370 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-08158bde-a1f7-48f5-aeb4-bb5b0ea9e060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:50.758922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1091/2156] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:50 2022] DELETE /identity/v3/projects/c8473f0b3f7d4866b569eaa2c11f4187 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:50.763980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b79210-a78b-467f-90a4-9788cdad17c4 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:50.765071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b79210-a78b-467f-90a4-9788cdad17c4 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:50.765178 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b79210-a78b-467f-90a4-9788cdad17c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:50.782656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-30b79210-a78b-467f-90a4-9788cdad17c4 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:50.783845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-30b79210-a78b-467f-90a4-9788cdad17c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:50.839948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1066/2157] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:50.847544 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3556c-34d8-4374-b0a3-3f0ff28bd1bc None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:50.847829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3556c-34d8-4374-b0a3-3f0ff28bd1bc None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:50.848131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3556c-34d8-4374-b0a3-3f0ff28bd1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:50.866638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-a2a3556c-34d8-4374-b0a3-3f0ff28bd1bc None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:50.867801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a2a3556c-34d8-4374-b0a3-3f0ff28bd1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:50.875959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1092/2158] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:50.880146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b79210-a78b-467f-90a4-9788cdad17c4 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:50.890287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b79210-a78b-467f-90a4-9788cdad17c4 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:50.895396 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bcf2b-9602-4627-8013-d36340065934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:50.896694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bcf2b-9602-4627-8013-d36340065934 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:50.897051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bcf2b-9602-4627-8013-d36340065934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:50.897397 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bcf2b-9602-4627-8013-d36340065934 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:50.898215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bcf2b-9602-4627-8013-d36340065934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:50.898585 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bcf2b-9602-4627-8013-d36340065934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:50.900521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bcf2b-9602-4627-8013-d36340065934 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:50.912457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1067/2159] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:12:50.916885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3556c-34d8-4374-b0a3-3f0ff28bd1bc None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:50.927526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3556c-34d8-4374-b0a3-3f0ff28bd1bc None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:50.943615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e915db-7f1c-498d-87c1-4c92bfd2958f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:50.944202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e915db-7f1c-498d-87c1-4c92bfd2958f admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:50.944483 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e915db-7f1c-498d-87c1-4c92bfd2958f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:50.944753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e915db-7f1c-498d-87c1-4c92bfd2958f admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:50.945447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e915db-7f1c-498d-87c1-4c92bfd2958f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:50.947660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e915db-7f1c-498d-87c1-4c92bfd2958f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:50.976973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1093/2160] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:50 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:50.981133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bcf2b-9602-4627-8013-d36340065934 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:50.992696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bcf2b-9602-4627-8013-d36340065934 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:51.075653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558391-1823-4734-abb1-42f2b4514447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:51.076673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558391-1823-4734-abb1-42f2b4514447 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:51.077160 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558391-1823-4734-abb1-42f2b4514447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:51.077616 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558391-1823-4734-abb1-42f2b4514447 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:51.078636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e558391-1823-4734-abb1-42f2b4514447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:51.080848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e558391-1823-4734-abb1-42f2b4514447 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:51.129774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1068/2161] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:50 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:12:51.131376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e915db-7f1c-498d-87c1-4c92bfd2958f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:51.147464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e915db-7f1c-498d-87c1-4c92bfd2958f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:51.153630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278ad67-5c57-45e3-a971-dd18f62284a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:51.154580 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278ad67-5c57-45e3-a971-dd18f62284a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:51.154958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278ad67-5c57-45e3-a971-dd18f62284a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:51.155456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278ad67-5c57-45e3-a971-dd18f62284a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:51.156304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278ad67-5c57-45e3-a971-dd18f62284a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:51.158261 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278ad67-5c57-45e3-a971-dd18f62284a7 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:51.186315 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1094/2162] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:12:51.190882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558391-1823-4734-abb1-42f2b4514447 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:51.201006 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558391-1823-4734-abb1-42f2b4514447 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:51.205829 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1b6f0-24cc-424b-87fe-ffd2a34aeacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:51.206490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1b6f0-24cc-424b-87fe-ffd2a34aeacc admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:51.206776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1b6f0-24cc-424b-87fe-ffd2a34aeacc admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:51.207052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1b6f0-24cc-424b-87fe-ffd2a34aeacc admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:51.207783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1b6f0-24cc-424b-87fe-ffd2a34aeacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:51.209406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1b6f0-24cc-424b-87fe-ffd2a34aeacc admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:51.219868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1069/2163] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:51.223874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278ad67-5c57-45e3-a971-dd18f62284a7 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:51.234295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278ad67-5c57-45e3-a971-dd18f62284a7 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:51.239249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8896bf1-bb8c-407d-902f-798365e5fcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:51.240302 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8896bf1-bb8c-407d-902f-798365e5fcfd admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:51.240649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8896bf1-bb8c-407d-902f-798365e5fcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:51.240988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8896bf1-bb8c-407d-902f-798365e5fcfd admin admin] PATH_INFO: `/v3/projects/f3b4e5faae6c48d39feb3ce88f2c77ae/users/de4a85cebfee4ce9b7bb9f919ef8bb84/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:51.255994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8896bf1-bb8c-407d-902f-798365e5fcfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b4e5faae6c48d39feb3ce88f2c77ae, user_id=de4a85cebfee4ce9b7bb9f919ef8bb84, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:51.259624 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8896bf1-bb8c-407d-902f-798365e5fcfd admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:51.272968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1095/2164] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:51 2022] PUT /identity/v3/projects/f3b4e5faae6c48d39feb3ce88f2c77ae/users/de4a85cebfee4ce9b7bb9f919ef8bb84/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:51.284584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6409d-bbb5-4e16-90f2-53f46a090234 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:51.284874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6409d-bbb5-4e16-90f2-53f46a090234 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:51.285181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6409d-bbb5-4e16-90f2-53f46a090234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:51.312376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-16f6409d-bbb5-4e16-90f2-53f46a090234 None None] MFA Rules not processed for user `de4a85cebfee4ce9b7bb9f919ef8bb84`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:51.313567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-16f6409d-bbb5-4e16-90f2-53f46a090234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:51.373305 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1070/2165] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:51.384198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8896bf1-bb8c-407d-902f-798365e5fcfd admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:51.385842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b8896bf1-bb8c-407d-902f-798365e5fcfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:51.440036 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8896bf1-bb8c-407d-902f-798365e5fcfd admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:51.443715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bd7e7-6305-43c3-9d1b-9988ac1b949e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:51.444375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bd7e7-6305-43c3-9d1b-9988ac1b949e service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:51.444655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bd7e7-6305-43c3-9d1b-9988ac1b949e service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:51.444928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bd7e7-6305-43c3-9d1b-9988ac1b949e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:51.453220 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bd7e7-6305-43c3-9d1b-9988ac1b949e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:51.454656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bd7e7-6305-43c3-9d1b-9988ac1b949e service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:51.463188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1096/2166] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:51.490066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6409d-bbb5-4e16-90f2-53f46a090234 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:51.549190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6409d-bbb5-4e16-90f2-53f46a090234 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:51.553717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:51.554567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:51.554850 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:51.555126 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] PATH_INFO: `/v3/users/de4a85cebfee4ce9b7bb9f919ef8bb84` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:51.556349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4a85cebfee4ce9b7bb9f919ef8bb84)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:51.558506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:51.604013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4a85cebfee4ce9b7bb9f919ef8bb84'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:51.611968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4a85cebfee4ce9b7bb9f919ef8bb84'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:51.618561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4a85cebfee4ce9b7bb9f919ef8bb84'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:51.619272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4a85cebfee4ce9b7bb9f919ef8bb84'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:51.619882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4a85cebfee4ce9b7bb9f919ef8bb84'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:51.635826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1071/2167] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:12:51 2022] DELETE /identity/v3/users/de4a85cebfee4ce9b7bb9f919ef8bb84 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:51.640390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e4661-d712-45a1-a9bb-e55b49c4eb56 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:51.640689 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e4661-d712-45a1-a9bb-e55b49c4eb56 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:51.640986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e4661-d712-45a1-a9bb-e55b49c4eb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:51.658004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-922e4661-d712-45a1-a9bb-e55b49c4eb56 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:51.659185 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-922e4661-d712-45a1-a9bb-e55b49c4eb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:51.716489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1097/2168] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:51.726664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:51.728071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:51.798179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99c954-f706-4134-b1ff-6618e91be62d admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:51.802229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe5fa8-fc78-48ee-a59a-b64683239e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:51.802813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe5fa8-fc78-48ee-a59a-b64683239e56 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:51.803088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe5fa8-fc78-48ee-a59a-b64683239e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:51.803369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe5fa8-fc78-48ee-a59a-b64683239e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:51.812945 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe5fa8-fc78-48ee-a59a-b64683239e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:51.814366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe5fa8-fc78-48ee-a59a-b64683239e56 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:51.823436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1072/2169] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:52.085789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e4661-d712-45a1-a9bb-e55b49c4eb56 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:52.087249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-922e4661-d712-45a1-a9bb-e55b49c4eb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:52.098940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e4661-d712-45a1-a9bb-e55b49c4eb56 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:52.103487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994b60d-83f5-4912-be28-359b34025228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:52.104374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994b60d-83f5-4912-be28-359b34025228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:52.104655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994b60d-83f5-4912-be28-359b34025228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:52.104929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994b60d-83f5-4912-be28-359b34025228 admin admin] PATH_INFO: `/v3/projects/f3b4e5faae6c48d39feb3ce88f2c77ae` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:52.106104 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994b60d-83f5-4912-be28-359b34025228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b4e5faae6c48d39feb3ce88f2c77ae)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:52.108143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994b60d-83f5-4912-be28-359b34025228 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:52.154374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d994b60d-83f5-4912-be28-359b34025228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b4e5faae6c48d39feb3ce88f2c77ae', 'request_id': 'req-d994b60d-83f5-4912-be28-359b34025228'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:52.160985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d994b60d-83f5-4912-be28-359b34025228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b4e5faae6c48d39feb3ce88f2c77ae', 'request_id': 'req-d994b60d-83f5-4912-be28-359b34025228'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:52.166654 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d994b60d-83f5-4912-be28-359b34025228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b4e5faae6c48d39feb3ce88f2c77ae', 'request_id': 'req-d994b60d-83f5-4912-be28-359b34025228'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:52.177912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d994b60d-83f5-4912-be28-359b34025228 admin admin] The token cache is being invalidate because project f3b4e5faae6c48d39feb3ce88f2c77ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:12:52.178194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d994b60d-83f5-4912-be28-359b34025228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:52.178830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d994b60d-83f5-4912-be28-359b34025228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:12:52.180418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1098/2170] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:12:52 2022] DELETE /identity/v3/projects/f3b4e5faae6c48d39feb3ce88f2c77ae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:52.185514 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175820e-0bd4-4a99-ba56-980af6d05bdb None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:52.185849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175820e-0bd4-4a99-ba56-980af6d05bdb None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:52.186126 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175820e-0bd4-4a99-ba56-980af6d05bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:52.204856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-c175820e-0bd4-4a99-ba56-980af6d05bdb None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:52.206040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c175820e-0bd4-4a99-ba56-980af6d05bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:52.274890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1073/2171] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:52.282779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937cec5-aa9e-4153-a885-c06543730725 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:52.283060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937cec5-aa9e-4153-a885-c06543730725 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:52.283331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937cec5-aa9e-4153-a885-c06543730725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:52.302172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-5937cec5-aa9e-4153-a885-c06543730725 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:52.303360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5937cec5-aa9e-4153-a885-c06543730725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:52.312922 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1099/2172] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:12:52.317520 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175820e-0bd4-4a99-ba56-980af6d05bdb None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:52.327540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175820e-0bd4-4a99-ba56-980af6d05bdb None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:52.332914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1027c05-9e58-4149-81f2-ed0004b9ec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:52.333503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027c05-9e58-4149-81f2-ed0004b9ec06 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:52.333783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027c05-9e58-4149-81f2-ed0004b9ec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:52.334053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027c05-9e58-4149-81f2-ed0004b9ec06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:52.334784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1027c05-9e58-4149-81f2-ed0004b9ec06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:12:52.335082 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1027c05-9e58-4149-81f2-ed0004b9ec06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:52.336704 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1027c05-9e58-4149-81f2-ed0004b9ec06 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:52.351544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1074/2173] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:12:52.353172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937cec5-aa9e-4153-a885-c06543730725 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:52.362285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937cec5-aa9e-4153-a885-c06543730725 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:52.366966 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4f6b6-eab3-40ce-8c89-073242e8ac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:52.367614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f6b6-eab3-40ce-8c89-073242e8ac84 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:52.367897 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f6b6-eab3-40ce-8c89-073242e8ac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:52.368218 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f6b6-eab3-40ce-8c89-073242e8ac84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:52.368907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4f6b6-eab3-40ce-8c89-073242e8ac84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:52.370790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4f6b6-eab3-40ce-8c89-073242e8ac84 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:52.396502 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1100/2174] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:52 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:52.400624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1027c05-9e58-4149-81f2-ed0004b9ec06 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:52.410277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1027c05-9e58-4149-81f2-ed0004b9ec06 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:52.465359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cdf9e-80cf-4a70-92db-748ba5d79dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:52.466030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cdf9e-80cf-4a70-92db-748ba5d79dfb admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:52.466312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cdf9e-80cf-4a70-92db-748ba5d79dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:52.466588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cdf9e-80cf-4a70-92db-748ba5d79dfb admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:52.467284 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cdf9e-80cf-4a70-92db-748ba5d79dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:52.469261 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cdf9e-80cf-4a70-92db-748ba5d79dfb admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:52.492068 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1075/2175] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:52 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:52.494210 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4f6b6-eab3-40ce-8c89-073242e8ac84 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:52.504672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4f6b6-eab3-40ce-8c89-073242e8ac84 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:52.509182 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a4541-07b8-453d-b819-a96d4710270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:52.509818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a4541-07b8-453d-b819-a96d4710270a admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:52.510094 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a4541-07b8-453d-b819-a96d4710270a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:52.510363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a4541-07b8-453d-b819-a96d4710270a admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:52.511076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a4541-07b8-453d-b819-a96d4710270a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:52.512670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a4541-07b8-453d-b819-a96d4710270a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:52.523046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1101/2176] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:52.526779 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cdf9e-80cf-4a70-92db-748ba5d79dfb admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:52.536985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cdf9e-80cf-4a70-92db-748ba5d79dfb admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:52.541539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f43a5-be6a-4890-ac8f-8a9505a529c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:52.542170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f43a5-be6a-4890-ac8f-8a9505a529c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:52.542448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f43a5-be6a-4890-ac8f-8a9505a529c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:52.542720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f43a5-be6a-4890-ac8f-8a9505a529c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:52.543431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f43a5-be6a-4890-ac8f-8a9505a529c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:52.545052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f43a5-be6a-4890-ac8f-8a9505a529c4 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:52.554481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1076/2177] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:52.558450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a4541-07b8-453d-b819-a96d4710270a admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:52.567823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a4541-07b8-453d-b819-a96d4710270a admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:52.572572 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bccf3-1456-464a-831e-85b14eda32ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:52.573429 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bccf3-1456-464a-831e-85b14eda32ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:52.573709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bccf3-1456-464a-831e-85b14eda32ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:52.573984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bccf3-1456-464a-831e-85b14eda32ef admin admin] PATH_INFO: `/v3/projects/3444fc5e89a24b7c9ec0e18369085501/users/0d48a4385c524710b422f853f03d14db/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:52.588394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bccf3-1456-464a-831e-85b14eda32ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3444fc5e89a24b7c9ec0e18369085501, user_id=0d48a4385c524710b422f853f03d14db, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:52.590961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bccf3-1456-464a-831e-85b14eda32ef admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:52.603906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1102/2178] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:52 2022] PUT /identity/v3/projects/3444fc5e89a24b7c9ec0e18369085501/users/0d48a4385c524710b422f853f03d14db/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:52.609105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70c0a7-e7bf-45c9-a6eb-6972bca2082a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:52.609272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70c0a7-e7bf-45c9-a6eb-6972bca2082a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:52.609554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70c0a7-e7bf-45c9-a6eb-6972bca2082a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:52.628489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8e70c0a7-e7bf-45c9-a6eb-6972bca2082a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:52.629688 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8e70c0a7-e7bf-45c9-a6eb-6972bca2082a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:52.690410 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1077/2179] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:52.697024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bccf3-1456-464a-831e-85b14eda32ef admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:52.698718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-778bccf3-1456-464a-831e-85b14eda32ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:52.752653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bccf3-1456-464a-831e-85b14eda32ef admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:52.756519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a6893-8859-4a6c-ae08-1fd361128d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:52.757141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a6893-8859-4a6c-ae08-1fd361128d75 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:52.757418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a6893-8859-4a6c-ae08-1fd361128d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:52.757690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a6893-8859-4a6c-ae08-1fd361128d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:52.766987 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a6893-8859-4a6c-ae08-1fd361128d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:52.768466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a6893-8859-4a6c-ae08-1fd361128d75 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:52.777678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1103/2180] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:12:57.448451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df713c-e311-424e-a5d3-92121624961c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:57.448977 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df713c-e311-424e-a5d3-92121624961c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:57.449070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df713c-e311-424e-a5d3-92121624961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:57.477557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f7df713c-e311-424e-a5d3-92121624961c None None] MFA Rules not processed for user `0d48a4385c524710b422f853f03d14db`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:12:57.478776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f7df713c-e311-424e-a5d3-92121624961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:12:57.555677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1078/2181] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:12:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:12:57.557815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a6893-8859-4a6c-ae08-1fd361128d75 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:57.567545 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a6893-8859-4a6c-ae08-1fd361128d75 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:57.573055 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89166b81-5738-4d48-9a75-14b91c605fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:57.573634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89166b81-5738-4d48-9a75-14b91c605fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:57.573957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89166b81-5738-4d48-9a75-14b91c605fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:57.574204 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89166b81-5738-4d48-9a75-14b91c605fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:57.574991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89166b81-5738-4d48-9a75-14b91c605fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:57.576921 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89166b81-5738-4d48-9a75-14b91c605fb7 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:57.609418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1104/2182] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:12:57 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:57.613580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df713c-e311-424e-a5d3-92121624961c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:57.624328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df713c-e311-424e-a5d3-92121624961c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:57.680821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31255f0c-7405-4b14-8a47-d1480886852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:57.681492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31255f0c-7405-4b14-8a47-d1480886852a admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:57.681773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31255f0c-7405-4b14-8a47-d1480886852a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:57.682044 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31255f0c-7405-4b14-8a47-d1480886852a admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:57.682996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31255f0c-7405-4b14-8a47-d1480886852a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:57.684946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31255f0c-7405-4b14-8a47-d1480886852a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:57.709168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1079/2183] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:12:57 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:12:57.710443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89166b81-5738-4d48-9a75-14b91c605fb7 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:57.721877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89166b81-5738-4d48-9a75-14b91c605fb7 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:57.726976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd489f-8fcf-4427-9349-8e2bdc78094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:57.727655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd489f-8fcf-4427-9349-8e2bdc78094a admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:57.727942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd489f-8fcf-4427-9349-8e2bdc78094a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:57.728323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd489f-8fcf-4427-9349-8e2bdc78094a admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:57.729087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd489f-8fcf-4427-9349-8e2bdc78094a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:57.730956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd489f-8fcf-4427-9349-8e2bdc78094a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:57.742018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1105/2184] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:57.746267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31255f0c-7405-4b14-8a47-d1480886852a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:57.757546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31255f0c-7405-4b14-8a47-d1480886852a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:57.762387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86a8f7-6011-4c08-af75-9c06fa74afe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:57.763253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86a8f7-6011-4c08-af75-9c06fa74afe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:57.763530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86a8f7-6011-4c08-af75-9c06fa74afe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:57.763800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86a8f7-6011-4c08-af75-9c06fa74afe9 admin admin] PATH_INFO: `/v3/projects/d7a19b2a1ef24312ac5a2c74173ce3d0/users/0c7a3a55f5404ad6ba0fd0a8cba88f37/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:57.778669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86a8f7-6011-4c08-af75-9c06fa74afe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a19b2a1ef24312ac5a2c74173ce3d0, user_id=0c7a3a55f5404ad6ba0fd0a8cba88f37, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:57.781937 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86a8f7-6011-4c08-af75-9c06fa74afe9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:57.797793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1080/2185] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:57 2022] PUT /identity/v3/projects/d7a19b2a1ef24312ac5a2c74173ce3d0/users/0c7a3a55f5404ad6ba0fd0a8cba88f37/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:12:57.801627 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd489f-8fcf-4427-9349-8e2bdc78094a admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:57.811432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd489f-8fcf-4427-9349-8e2bdc78094a admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:57.864519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faeb9e0-5a38-4ad2-8f9a-a44a71572718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:57.865098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faeb9e0-5a38-4ad2-8f9a-a44a71572718 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:57.865375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faeb9e0-5a38-4ad2-8f9a-a44a71572718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:57.865645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faeb9e0-5a38-4ad2-8f9a-a44a71572718 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:57.866466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faeb9e0-5a38-4ad2-8f9a-a44a71572718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:57.868035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faeb9e0-5a38-4ad2-8f9a-a44a71572718 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:57.877388 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1106/2186] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:12:57.881657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86a8f7-6011-4c08-af75-9c06fa74afe9 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:12:57.892201 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86a8f7-6011-4c08-af75-9c06fa74afe9 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:12:57.896744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236706bb-7353-4c98-a4cb-647ebbca30f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:12:57.897601 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236706bb-7353-4c98-a4cb-647ebbca30f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:12:57.897879 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236706bb-7353-4c98-a4cb-647ebbca30f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:12:57.898147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236706bb-7353-4c98-a4cb-647ebbca30f3 admin admin] PATH_INFO: `/v3/projects/d7a19b2a1ef24312ac5a2c74173ce3d0/users/0c7a3a55f5404ad6ba0fd0a8cba88f37/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:12:57.900077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236706bb-7353-4c98-a4cb-647ebbca30f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a19b2a1ef24312ac5a2c74173ce3d0, user_id=0c7a3a55f5404ad6ba0fd0a8cba88f37, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:12:57.902792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236706bb-7353-4c98-a4cb-647ebbca30f3 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:12:57.914169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1081/2187] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:12:57 2022] PUT /identity/v3/projects/d7a19b2a1ef24312ac5a2c74173ce3d0/users/0c7a3a55f5404ad6ba0fd0a8cba88f37/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:13:03.960124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa68d2-3420-4181-b088-6b4e27ef93b7 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:03.960988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa68d2-3420-4181-b088-6b4e27ef93b7 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:03.961587 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa68d2-3420-4181-b088-6b4e27ef93b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:03.999488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e7fa68d2-3420-4181-b088-6b4e27ef93b7 None None] MFA Rules not processed for user `0c7a3a55f5404ad6ba0fd0a8cba88f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:04.000749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e7fa68d2-3420-4181-b088-6b4e27ef93b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:04.087841 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1107/2188] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:04.099728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236706bb-7353-4c98-a4cb-647ebbca30f3 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:04.101788 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-236706bb-7353-4c98-a4cb-647ebbca30f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:04.179555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236706bb-7353-4c98-a4cb-647ebbca30f3 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:04.185457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0df0b1-5691-4000-8282-d27787261926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:04.186591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0df0b1-5691-4000-8282-d27787261926 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:04.186875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0df0b1-5691-4000-8282-d27787261926 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:04.187148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0df0b1-5691-4000-8282-d27787261926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:04.252239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0df0b1-5691-4000-8282-d27787261926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:04.253831 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0df0b1-5691-4000-8282-d27787261926 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:04.262523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1082/2189] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:13:05.473729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38d96f-cf42-466d-87e1-c611102676ce None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:05.474237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38d96f-cf42-466d-87e1-c611102676ce None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:05.474765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38d96f-cf42-466d-87e1-c611102676ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:05.496230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-5a38d96f-cf42-466d-87e1-c611102676ce None None] MFA Rules not processed for user `0d48a4385c524710b422f853f03d14db`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:05.497925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5a38d96f-cf42-466d-87e1-c611102676ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:05.506846 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1108/2190] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:06.261279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0df0b1-5691-4000-8282-d27787261926 service nova] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:06.263235 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ee0df0b1-5691-4000-8282-d27787261926 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:06.385028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0df0b1-5691-4000-8282-d27787261926 service nova] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:06.395848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:06.396823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:06.397202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:06.397357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] PATH_INFO: `/v3/users/a1427d17655f4ddc9f4c646c4023e5c8` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:06.401921 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1427d17655f4ddc9f4c646c4023e5c8)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:06.404624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:06.530767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1427d17655f4ddc9f4c646c4023e5c8'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:06.543923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1427d17655f4ddc9f4c646c4023e5c8'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:06.554833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1427d17655f4ddc9f4c646c4023e5c8'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:06.561058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1427d17655f4ddc9f4c646c4023e5c8'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:06.564512 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1427d17655f4ddc9f4c646c4023e5c8'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:06.605951 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1083/2191] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:13:06 2022] DELETE /identity/v3/users/a1427d17655f4ddc9f4c646c4023e5c8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:06.610779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950d972-bf2e-420b-8d1b-c3ed30f1b220 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:06.611900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950d972-bf2e-420b-8d1b-c3ed30f1b220 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:06.612264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950d972-bf2e-420b-8d1b-c3ed30f1b220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:06.636907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-9950d972-bf2e-420b-8d1b-c3ed30f1b220 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:06.636907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9950d972-bf2e-420b-8d1b-c3ed30f1b220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:06.709312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1109/2192] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:06.723478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:06.724952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:06.810236 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ca211-9ed1-4d6b-ac95-b74989185d66 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:06.817148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b798a1-1093-4cb3-9642-b841755b7a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:06.818204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b798a1-1093-4cb3-9642-b841755b7a00 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:06.818677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b798a1-1093-4cb3-9642-b841755b7a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:06.819138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b798a1-1093-4cb3-9642-b841755b7a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:06.838670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b798a1-1093-4cb3-9642-b841755b7a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:06.850571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b798a1-1093-4cb3-9642-b841755b7a00 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:06.875719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1084/2193] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:13:07.114566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950d972-bf2e-420b-8d1b-c3ed30f1b220 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:07.116015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9950d972-bf2e-420b-8d1b-c3ed30f1b220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:07.138015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950d972-bf2e-420b-8d1b-c3ed30f1b220 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:07.146517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:07.148242 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:07.148757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:07.149987 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] PATH_INFO: `/v3/users/2f63e415fcce47658cb7f85ac6d4a468` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:07.153345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f63e415fcce47658cb7f85ac6d4a468)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:07.155570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:07.237489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f63e415fcce47658cb7f85ac6d4a468'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:07.254099 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f63e415fcce47658cb7f85ac6d4a468'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:07.254951 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f63e415fcce47658cb7f85ac6d4a468'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:07.255798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f63e415fcce47658cb7f85ac6d4a468'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:07.270211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f63e415fcce47658cb7f85ac6d4a468'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:07.296974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1110/2194] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:13:07 2022] DELETE /identity/v3/users/2f63e415fcce47658cb7f85ac6d4a468 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:07.299184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5285b5-a87e-4e3c-b8dc-323702b588ce None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:07.300029 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5285b5-a87e-4e3c-b8dc-323702b588ce None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:07.300548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5285b5-a87e-4e3c-b8dc-323702b588ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:07.319648 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8c5285b5-a87e-4e3c-b8dc-323702b588ce None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:07.322009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8c5285b5-a87e-4e3c-b8dc-323702b588ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:07.396575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1085/2195] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:07.415511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:07.417289 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:07.524921 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5285b5-a87e-4e3c-b8dc-323702b588ce None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:07.526540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8c5285b5-a87e-4e3c-b8dc-323702b588ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:07.543711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5285b5-a87e-4e3c-b8dc-323702b588ce None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:07.546055 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6fa2f-ea65-4260-937e-d9b339cebd6b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:07.551133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:07.552389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:07.552851 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:07.553276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] PATH_INFO: `/v3/projects/de174033bed947858b59493c17bfca22` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:07.556787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de174033bed947858b59493c17bfca22)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:07.557931 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20daed-0cb6-4361-a3d2-616e87221c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:07.558694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20daed-0cb6-4361-a3d2-616e87221c3d service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:07.560008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20daed-0cb6-4361-a3d2-616e87221c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:07.560316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20daed-0cb6-4361-a3d2-616e87221c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:07.562814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:07.581700 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20daed-0cb6-4361-a3d2-616e87221c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:07.585642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20daed-0cb6-4361-a3d2-616e87221c3d service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:07.624302 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1111/2196] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:13:07.660327 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de174033bed947858b59493c17bfca22', 'request_id': 'req-1d812095-72a0-4069-b37e-2687b881f037'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:07.667219 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de174033bed947858b59493c17bfca22', 'request_id': 'req-1d812095-72a0-4069-b37e-2687b881f037'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:07.678733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de174033bed947858b59493c17bfca22', 'request_id': 'req-1d812095-72a0-4069-b37e-2687b881f037'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:07.707074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] The token cache is being invalidate because project de174033bed947858b59493c17bfca22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:13:07.709302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:07.710102 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:07.711754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1086/2197] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:13:07 2022] DELETE /identity/v3/projects/de174033bed947858b59493c17bfca22 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:07.956397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20daed-0cb6-4361-a3d2-616e87221c3d service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:07.958076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4c20daed-0cb6-4361-a3d2-616e87221c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:07.981984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20daed-0cb6-4361-a3d2-616e87221c3d service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:08.137066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:08.137957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:08.138236 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:08.138568 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] PATH_INFO: `/v3/users/638e8e052fda4abe989c714c28564c5b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:08.141214 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=638e8e052fda4abe989c714c28564c5b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:08.143391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:08.210604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:08.212358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:08.229035 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d812095-72a0-4069-b37e-2687b881f037 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:08.238169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638e8e052fda4abe989c714c28564c5b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.242037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:08.245363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:08.246630 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:08.249227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] PATH_INFO: `/v3/projects/d9792bfbaec74b52be6c8bab7a1eb536` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:08.251268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9792bfbaec74b52be6c8bab7a1eb536)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:08.253233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:08.257404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638e8e052fda4abe989c714c28564c5b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.258337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638e8e052fda4abe989c714c28564c5b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.259332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638e8e052fda4abe989c714c28564c5b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.277248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638e8e052fda4abe989c714c28564c5b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.300849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1112/2198] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:13:07 2022] DELETE /identity/v3/users/638e8e052fda4abe989c714c28564c5b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:08.321643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9792bfbaec74b52be6c8bab7a1eb536', 'request_id': 'req-818db895-21f8-4f69-a696-bc5006ec8902'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.329562 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9792bfbaec74b52be6c8bab7a1eb536', 'request_id': 'req-818db895-21f8-4f69-a696-bc5006ec8902'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.341064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9792bfbaec74b52be6c8bab7a1eb536', 'request_id': 'req-818db895-21f8-4f69-a696-bc5006ec8902'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.356135 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] The token cache is being invalidate because project d9792bfbaec74b52be6c8bab7a1eb536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:13:08.356420 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.357091 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.359623 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1087/2199] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:13:08 2022] DELETE /identity/v3/projects/d9792bfbaec74b52be6c8bab7a1eb536 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:08.363294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:08.364940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:08.473093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fab8a-aef1-4831-93dd-bdbaca9e7774 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:08.479660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bd775-7def-4b70-a373-cfd644f46615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:08.481006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd775-7def-4b70-a373-cfd644f46615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:08.481507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd775-7def-4b70-a373-cfd644f46615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:08.481989 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd775-7def-4b70-a373-cfd644f46615 admin admin] PATH_INFO: `/v3/users/b1df8f11fb674313ab7f27cc50444180` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:08.484253 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bd775-7def-4b70-a373-cfd644f46615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1df8f11fb674313ab7f27cc50444180)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:08.486554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bd775-7def-4b70-a373-cfd644f46615 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:08.584663 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-793bd775-7def-4b70-a373-cfd644f46615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1df8f11fb674313ab7f27cc50444180'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.598853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-793bd775-7def-4b70-a373-cfd644f46615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1df8f11fb674313ab7f27cc50444180'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.600263 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-793bd775-7def-4b70-a373-cfd644f46615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1df8f11fb674313ab7f27cc50444180'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.600942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-793bd775-7def-4b70-a373-cfd644f46615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1df8f11fb674313ab7f27cc50444180'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.616862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-793bd775-7def-4b70-a373-cfd644f46615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1df8f11fb674313ab7f27cc50444180'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.625902 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:08.628072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:08.639393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1113/2200] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:13:08 2022] DELETE /identity/v3/users/b1df8f11fb674313ab7f27cc50444180 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:08.789890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818db895-21f8-4f69-a696-bc5006ec8902 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:08.854266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a63145-bd0b-447d-a1b9-f77bda83a5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:08.855148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a63145-bd0b-447d-a1b9-f77bda83a5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:08.855432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a63145-bd0b-447d-a1b9-f77bda83a5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:08.855706 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a63145-bd0b-447d-a1b9-f77bda83a5f8 admin admin] PATH_INFO: `/v3/projects/db9273e9f75e4918b29f8d1e4dc4d1c3` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:08.856987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a63145-bd0b-447d-a1b9-f77bda83a5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9273e9f75e4918b29f8d1e4dc4d1c3)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:08.859488 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a63145-bd0b-447d-a1b9-f77bda83a5f8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:08.908031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-42a63145-bd0b-447d-a1b9-f77bda83a5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9273e9f75e4918b29f8d1e4dc4d1c3', 'request_id': 'req-42a63145-bd0b-447d-a1b9-f77bda83a5f8'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.915079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-42a63145-bd0b-447d-a1b9-f77bda83a5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9273e9f75e4918b29f8d1e4dc4d1c3', 'request_id': 'req-42a63145-bd0b-447d-a1b9-f77bda83a5f8'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.922544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-42a63145-bd0b-447d-a1b9-f77bda83a5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9273e9f75e4918b29f8d1e4dc4d1c3', 'request_id': 'req-42a63145-bd0b-447d-a1b9-f77bda83a5f8'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.935229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-42a63145-bd0b-447d-a1b9-f77bda83a5f8 admin admin] The token cache is being invalidate because project db9273e9f75e4918b29f8d1e4dc4d1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:13:08.935754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-42a63145-bd0b-447d-a1b9-f77bda83a5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.936575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-42a63145-bd0b-447d-a1b9-f77bda83a5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:08.938431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1088/2201] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:13:08 2022] DELETE /identity/v3/projects/db9273e9f75e4918b29f8d1e4dc4d1c3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:08.943541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8951f-59bd-4f5c-b12a-cf78d6c10c2e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:08.944420 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8951f-59bd-4f5c-b12a-cf78d6c10c2e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:08.944759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8951f-59bd-4f5c-b12a-cf78d6c10c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:08.963675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-c6a8951f-59bd-4f5c-b12a-cf78d6c10c2e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:08.965051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c6a8951f-59bd-4f5c-b12a-cf78d6c10c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:09.042552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1114/2202] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:09.043545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c07f02-c9dd-43d6-8478-5bbae2adb616 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.043829 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c07f02-c9dd-43d6-8478-5bbae2adb616 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.044121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c07f02-c9dd-43d6-8478-5bbae2adb616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.079282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8951f-59bd-4f5c-b12a-cf78d6c10c2e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.079417 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-00c07f02-c9dd-43d6-8478-5bbae2adb616 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:09.080670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-00c07f02-c9dd-43d6-8478-5bbae2adb616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:09.080916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c6a8951f-59bd-4f5c-b12a-cf78d6c10c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:09.095706 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1089/2203] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:13:09.096943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c07f02-c9dd-43d6-8478-5bbae2adb616 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.100199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8951f-59bd-4f5c-b12a-cf78d6c10c2e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.105504 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944f41e-d725-4971-ad51-030ae721b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.106411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944f41e-d725-4971-ad51-030ae721b1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.106692 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944f41e-d725-4971-ad51-030ae721b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.106959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944f41e-d725-4971-ad51-030ae721b1f3 admin admin] PATH_INFO: `/v3/projects/6f39b40165e74c61a6fcc539f26136f5` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.108475 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944f41e-d725-4971-ad51-030ae721b1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f39b40165e74c61a6fcc539f26136f5)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.110526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944f41e-d725-4971-ad51-030ae721b1f3 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.127368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c07f02-c9dd-43d6-8478-5bbae2adb616 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.141792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee4705-873b-4fa8-b0c8-075f5cd850f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.142478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee4705-873b-4fa8-b0c8-075f5cd850f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.142761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee4705-873b-4fa8-b0c8-075f5cd850f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.143034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee4705-873b-4fa8-b0c8-075f5cd850f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.143928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee4705-873b-4fa8-b0c8-075f5cd850f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:13:09.144280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee4705-873b-4fa8-b0c8-075f5cd850f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.146845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee4705-873b-4fa8-b0c8-075f5cd850f0 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.163827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1090/2204] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:13:09.168312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee4705-873b-4fa8-b0c8-075f5cd850f0 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.180379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6944f41e-d725-4971-ad51-030ae721b1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f39b40165e74c61a6fcc539f26136f5', 'request_id': 'req-6944f41e-d725-4971-ad51-030ae721b1f3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:09.186330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee4705-873b-4fa8-b0c8-075f5cd850f0 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.189498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6944f41e-d725-4971-ad51-030ae721b1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f39b40165e74c61a6fcc539f26136f5', 'request_id': 'req-6944f41e-d725-4971-ad51-030ae721b1f3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:09.195957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6944f41e-d725-4971-ad51-030ae721b1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f39b40165e74c61a6fcc539f26136f5', 'request_id': 'req-6944f41e-d725-4971-ad51-030ae721b1f3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:09.225271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6944f41e-d725-4971-ad51-030ae721b1f3 admin admin] The token cache is being invalidate because project 6f39b40165e74c61a6fcc539f26136f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:13:09.226021 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6944f41e-d725-4971-ad51-030ae721b1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:09.227690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6944f41e-d725-4971-ad51-030ae721b1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:09.230015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1115/2205] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:13:09 2022] DELETE /identity/v3/projects/6f39b40165e74c61a6fcc539f26136f5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:09.237026 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a372fb2-32a6-47ad-b352-a4f9da498049 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.237317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a372fb2-32a6-47ad-b352-a4f9da498049 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.237601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a372fb2-32a6-47ad-b352-a4f9da498049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.267902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-0a372fb2-32a6-47ad-b352-a4f9da498049 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:09.268130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f9473-f3c8-4364-8e48-c63dc89a0c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.269483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f9473-f3c8-4364-8e48-c63dc89a0c8e admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.269604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0a372fb2-32a6-47ad-b352-a4f9da498049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:09.269768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f9473-f3c8-4364-8e48-c63dc89a0c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.270059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f9473-f3c8-4364-8e48-c63dc89a0c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.270727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f9473-f3c8-4364-8e48-c63dc89a0c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.272786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f9473-f3c8-4364-8e48-c63dc89a0c8e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.286808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1116/2206] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:13:09.289017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737a8c7-fb71-43e6-b8a9-b58bcda8a7ed None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.289422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737a8c7-fb71-43e6-b8a9-b58bcda8a7ed None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.289820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737a8c7-fb71-43e6-b8a9-b58bcda8a7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.316915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f737a8c7-fb71-43e6-b8a9-b58bcda8a7ed None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:09.318517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f737a8c7-fb71-43e6-b8a9-b58bcda8a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:09.327526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1117/2207] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:13:09.331138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1091/2208] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:13:09 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:13:09.331919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f9473-f3c8-4364-8e48-c63dc89a0c8e admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.332892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737a8c7-fb71-43e6-b8a9-b58bcda8a7ed None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.334270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f737a8c7-fb71-43e6-b8a9-b58bcda8a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:09.348218 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737a8c7-fb71-43e6-b8a9-b58bcda8a7ed None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.424426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f9473-f3c8-4364-8e48-c63dc89a0c8e admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.429968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac0aa1-2e04-4458-8eaa-e89c144d1fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.430684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac0aa1-2e04-4458-8eaa-e89c144d1fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.430966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac0aa1-2e04-4458-8eaa-e89c144d1fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.431374 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac0aa1-2e04-4458-8eaa-e89c144d1fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.432405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac0aa1-2e04-4458-8eaa-e89c144d1fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:13:09.432716 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac0aa1-2e04-4458-8eaa-e89c144d1fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.434359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac0aa1-2e04-4458-8eaa-e89c144d1fc0 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.438617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aba295-8f24-47e6-92b1-3e4fe708703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.439940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aba295-8f24-47e6-92b1-3e4fe708703a admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.440296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aba295-8f24-47e6-92b1-3e4fe708703a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.440575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aba295-8f24-47e6-92b1-3e4fe708703a admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.441268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aba295-8f24-47e6-92b1-3e4fe708703a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.443234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aba295-8f24-47e6-92b1-3e4fe708703a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.447653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1092/2209] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:13:09.452256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac0aa1-2e04-4458-8eaa-e89c144d1fc0 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.462478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac0aa1-2e04-4458-8eaa-e89c144d1fc0 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.471578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727752d2-1a26-439e-8293-3d1bd3abf44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.471809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1118/2210] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:13:09 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:09.471938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727752d2-1a26-439e-8293-3d1bd3abf44a admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.471938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727752d2-1a26-439e-8293-3d1bd3abf44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.471938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727752d2-1a26-439e-8293-3d1bd3abf44a admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.471938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727752d2-1a26-439e-8293-3d1bd3abf44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.474543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727752d2-1a26-439e-8293-3d1bd3abf44a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.477080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aba295-8f24-47e6-92b1-3e4fe708703a admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.489961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aba295-8f24-47e6-92b1-3e4fe708703a admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.494979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aa44c-4a39-480a-91c3-aed9679c8358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.495714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aa44c-4a39-480a-91c3-aed9679c8358 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.496646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aa44c-4a39-480a-91c3-aed9679c8358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.496936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aa44c-4a39-480a-91c3-aed9679c8358 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.497667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aa44c-4a39-480a-91c3-aed9679c8358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.500137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aa44c-4a39-480a-91c3-aed9679c8358 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.508671 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1093/2211] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:13:09 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:13:09.509700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727752d2-1a26-439e-8293-3d1bd3abf44a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.517496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1119/2212] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:09.518494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aa44c-4a39-480a-91c3-aed9679c8358 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.529776 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aa44c-4a39-480a-91c3-aed9679c8358 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.609959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0a764-05a7-40b3-982f-2f670ed4ebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.610743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0a764-05a7-40b3-982f-2f670ed4ebea admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.611098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0a764-05a7-40b3-982f-2f670ed4ebea admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.611441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0a764-05a7-40b3-982f-2f670ed4ebea admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.612285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0a764-05a7-40b3-982f-2f670ed4ebea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.614007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0a764-05a7-40b3-982f-2f670ed4ebea admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.623414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727752d2-1a26-439e-8293-3d1bd3abf44a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.628810 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1120/2213] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:13:09.629052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1b0e2-e250-4af1-899b-152cd42e3905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.629864 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1b0e2-e250-4af1-899b-152cd42e3905 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.630153 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1b0e2-e250-4af1-899b-152cd42e3905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.630546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1b0e2-e250-4af1-899b-152cd42e3905 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.631259 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1b0e2-e250-4af1-899b-152cd42e3905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.632735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0a764-05a7-40b3-982f-2f670ed4ebea admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.633806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1b0e2-e250-4af1-899b-152cd42e3905 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.652428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0a764-05a7-40b3-982f-2f670ed4ebea admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.658751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece01248-98b3-4534-904f-29c0b2ebb031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.660195 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece01248-98b3-4534-904f-29c0b2ebb031 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.660982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece01248-98b3-4534-904f-29c0b2ebb031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.661408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece01248-98b3-4534-904f-29c0b2ebb031 admin admin] PATH_INFO: `/v3/projects/2755b44a34e84685a5731e4759104b44/users/6a5286f324eb41a4a994ad4a120b713e/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.665371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1094/2214] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:13:09 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:13:09.671074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1b0e2-e250-4af1-899b-152cd42e3905 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.686997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1b0e2-e250-4af1-899b-152cd42e3905 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.694265 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283ba43-7df5-4cc8-86f3-c105e6055f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.695846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283ba43-7df5-4cc8-86f3-c105e6055f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.696445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283ba43-7df5-4cc8-86f3-c105e6055f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.696899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283ba43-7df5-4cc8-86f3-c105e6055f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.697982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283ba43-7df5-4cc8-86f3-c105e6055f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.699927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece01248-98b3-4534-904f-29c0b2ebb031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2755b44a34e84685a5731e4759104b44, user_id=6a5286f324eb41a4a994ad4a120b713e, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.700520 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283ba43-7df5-4cc8-86f3-c105e6055f1f admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.702853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece01248-98b3-4534-904f-29c0b2ebb031 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.712699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1095/2215] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:09.713773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283ba43-7df5-4cc8-86f3-c105e6055f1f admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.715516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e283ba43-7df5-4cc8-86f3-c105e6055f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:09.725409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1121/2216] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:09 2022] PUT /identity/v3/projects/2755b44a34e84685a5731e4759104b44/users/6a5286f324eb41a4a994ad4a120b713e/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:09.729243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283ba43-7df5-4cc8-86f3-c105e6055f1f admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.736901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece01248-98b3-4534-904f-29c0b2ebb031 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.797736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.798981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.799451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.799906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] PATH_INFO: `/v3/users/d6d467fd6576432d857b20b4ee042644` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.801234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d467fd6576432d857b20b4ee042644)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.803172 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.817356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece01248-98b3-4534-904f-29c0b2ebb031 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.822644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98769d6-b1b2-43c5-893d-36f8d2f43c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.823305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98769d6-b1b2-43c5-893d-36f8d2f43c38 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.823582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98769d6-b1b2-43c5-893d-36f8d2f43c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.823892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98769d6-b1b2-43c5-893d-36f8d2f43c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.824655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98769d6-b1b2-43c5-893d-36f8d2f43c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.827532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98769d6-b1b2-43c5-893d-36f8d2f43c38 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.840814 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1122/2217] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:09.842360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23263a5-97ba-4a26-ad43-db3039b8b341 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.842697 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23263a5-97ba-4a26-ad43-db3039b8b341 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.842979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23263a5-97ba-4a26-ad43-db3039b8b341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.861934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d467fd6576432d857b20b4ee042644'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:09.871035 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d467fd6576432d857b20b4ee042644'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:09.872401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b23263a5-97ba-4a26-ad43-db3039b8b341 None None] MFA Rules not processed for user `6a5286f324eb41a4a994ad4a120b713e`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:09.874653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b23263a5-97ba-4a26-ad43-db3039b8b341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:09.880220 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d467fd6576432d857b20b4ee042644'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:09.880789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d467fd6576432d857b20b4ee042644'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:09.881460 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d467fd6576432d857b20b4ee042644'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:09.902407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1096/2218] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:13:09 2022] DELETE /identity/v3/users/d6d467fd6576432d857b20b4ee042644 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:09.903233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.904736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:09.957822 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1123/2219] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:09.962348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23263a5-97ba-4a26-ad43-db3039b8b341 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:09.963805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b23263a5-97ba-4a26-ad43-db3039b8b341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:09.970922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e113a-e32c-4ddc-9043-513eed3a3962 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.975729 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295c987-f922-4164-abe0-7fc94439abf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.976668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295c987-f922-4164-abe0-7fc94439abf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.976949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295c987-f922-4164-abe0-7fc94439abf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.977222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295c987-f922-4164-abe0-7fc94439abf1 admin admin] PATH_INFO: `/v3/projects/2f6545bd643143889dd68e5122cd3d9b/users/2bb85f22141a4764bed71ff1d8f3a2a1/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.977727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23263a5-97ba-4a26-ad43-db3039b8b341 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:09.983685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef7571-0a15-4758-925f-d8f04b8481b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:09.984396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef7571-0a15-4758-925f-d8f04b8481b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:09.984683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef7571-0a15-4758-925f-d8f04b8481b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:09.984962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef7571-0a15-4758-925f-d8f04b8481b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:09.985653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef7571-0a15-4758-925f-d8f04b8481b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.987581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef7571-0a15-4758-925f-d8f04b8481b9 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:09.995642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295c987-f922-4164-abe0-7fc94439abf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6545bd643143889dd68e5122cd3d9b, user_id=2bb85f22141a4764bed71ff1d8f3a2a1, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:09.998964 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295c987-f922-4164-abe0-7fc94439abf1 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.023248 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1097/2220] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:09 2022] PUT /identity/v3/projects/2f6545bd643143889dd68e5122cd3d9b/users/2bb85f22141a4764bed71ff1d8f3a2a1/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:10.023422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1124/2221] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:13:09 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:10.023507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295c987-f922-4164-abe0-7fc94439abf1 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.025353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada84b4-62f6-4417-b450-1580b0406302 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.025470 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada84b4-62f6-4417-b450-1580b0406302 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.025722 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada84b4-62f6-4417-b450-1580b0406302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.054226 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-7ada84b4-62f6-4417-b450-1580b0406302 None None] MFA Rules not processed for user `2bb85f22141a4764bed71ff1d8f3a2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:10.056070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-7ada84b4-62f6-4417-b450-1580b0406302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.088907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295c987-f922-4164-abe0-7fc94439abf1 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.151165 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1125/2222] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:10.151996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada84b4-62f6-4417-b450-1580b0406302 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.153302 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-7ada84b4-62f6-4417-b450-1580b0406302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.158331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0c7eb-6c76-4714-a862-9877e73ef5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.159100 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0c7eb-6c76-4714-a862-9877e73ef5fc admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.159446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0c7eb-6c76-4714-a862-9877e73ef5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.159792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0c7eb-6c76-4714-a862-9877e73ef5fc admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.160606 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0c7eb-6c76-4714-a862-9877e73ef5fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.162598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0c7eb-6c76-4714-a862-9877e73ef5fc admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.168798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada84b4-62f6-4417-b450-1580b0406302 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.174283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.175172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.175461 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.175753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] PATH_INFO: `/v3/projects/e736efbeaf5f4280880925ad0a747fe7` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.177054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e736efbeaf5f4280880925ad0a747fe7)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.178936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.183766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1098/2223] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:13:10 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:13:10.184407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0c7eb-6c76-4714-a862-9877e73ef5fc admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.193927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0c7eb-6c76-4714-a862-9877e73ef5fc admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.199009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4a9ce-d267-4819-bff8-29854ae27f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.199647 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4a9ce-d267-4819-bff8-29854ae27f65 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.199927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4a9ce-d267-4819-bff8-29854ae27f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.200234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4a9ce-d267-4819-bff8-29854ae27f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.200934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4a9ce-d267-4819-bff8-29854ae27f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.203105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4a9ce-d267-4819-bff8-29854ae27f65 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.234440 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1099/2224] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:13:10 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:10.234440 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4a9ce-d267-4819-bff8-29854ae27f65 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.245173 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e736efbeaf5f4280880925ad0a747fe7', 'request_id': 'req-7310c691-53a7-41ed-8a88-1916dc946ab8'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.253503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e736efbeaf5f4280880925ad0a747fe7', 'request_id': 'req-7310c691-53a7-41ed-8a88-1916dc946ab8'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.258948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e736efbeaf5f4280880925ad0a747fe7', 'request_id': 'req-7310c691-53a7-41ed-8a88-1916dc946ab8'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.269563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] The token cache is being invalidate because project e736efbeaf5f4280880925ad0a747fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:13:10.269871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.270510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.272060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1126/2225] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:13:10 2022] DELETE /identity/v3/projects/e736efbeaf5f4280880925ad0a747fe7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:10.272882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.274144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.292747 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4a9ce-d267-4819-bff8-29854ae27f65 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.298289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e237e-82cc-4394-8be6-e5718c2e56c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.298948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e237e-82cc-4394-8be6-e5718c2e56c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.299230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e237e-82cc-4394-8be6-e5718c2e56c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.299506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e237e-82cc-4394-8be6-e5718c2e56c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.300258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e237e-82cc-4394-8be6-e5718c2e56c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.301858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e237e-82cc-4394-8be6-e5718c2e56c9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.311968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1100/2226] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:10.312800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e237e-82cc-4394-8be6-e5718c2e56c9 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.314424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5f6e237e-82cc-4394-8be6-e5718c2e56c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.326627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e237e-82cc-4394-8be6-e5718c2e56c9 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.331201 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.332031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.332340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.332617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] PATH_INFO: `/v3/users/ebd87bbc7f66489b9713292f20f091e0` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.333868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd87bbc7f66489b9713292f20f091e0)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.335679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.335985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c691-53a7-41ed-8a88-1916dc946ab8 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.342310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312e403-11ec-46d7-841a-054f411183e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.342973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312e403-11ec-46d7-841a-054f411183e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.343251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312e403-11ec-46d7-841a-054f411183e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.343522 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312e403-11ec-46d7-841a-054f411183e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.344231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312e403-11ec-46d7-841a-054f411183e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.346127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312e403-11ec-46d7-841a-054f411183e4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.367511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1127/2227] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:13:10 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:10.368563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312e403-11ec-46d7-841a-054f411183e4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.370321 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0312e403-11ec-46d7-841a-054f411183e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.381702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312e403-11ec-46d7-841a-054f411183e4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.382405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd87bbc7f66489b9713292f20f091e0'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.387102 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fb817-865c-4b5c-8168-24dd6ab36c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.387971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fb817-865c-4b5c-8168-24dd6ab36c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.388342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fb817-865c-4b5c-8168-24dd6ab36c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.388811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fb817-865c-4b5c-8168-24dd6ab36c4f admin admin] PATH_INFO: `/v3/projects/03f46dbd2efd4e408d0cb9ccd21430c3/users/3f64b3fee9874c37b1aa33b317cab22d/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.391335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd87bbc7f66489b9713292f20f091e0'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.398827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd87bbc7f66489b9713292f20f091e0'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.399495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd87bbc7f66489b9713292f20f091e0'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.400140 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd87bbc7f66489b9713292f20f091e0'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.405596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fb817-865c-4b5c-8168-24dd6ab36c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f46dbd2efd4e408d0cb9ccd21430c3, user_id=3f64b3fee9874c37b1aa33b317cab22d, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.408013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fb817-865c-4b5c-8168-24dd6ab36c4f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.417290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1101/2228] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:13:10 2022] DELETE /identity/v3/users/ebd87bbc7f66489b9713292f20f091e0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:10.418452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.419730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.422153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1128/2229] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:10 2022] PUT /identity/v3/projects/03f46dbd2efd4e408d0cb9ccd21430c3/users/3f64b3fee9874c37b1aa33b317cab22d/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:10.425668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fb817-865c-4b5c-8168-24dd6ab36c4f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.427407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b15fb817-865c-4b5c-8168-24dd6ab36c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.496908 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaae5f-dd71-4b7e-898f-2366cadbbf5c admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.501975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5132863-16da-437f-9470-83651ccb3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.502635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5132863-16da-437f-9470-83651ccb3fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.502915 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5132863-16da-437f-9470-83651ccb3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.503187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5132863-16da-437f-9470-83651ccb3fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.503920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5132863-16da-437f-9470-83651ccb3fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.505558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5132863-16da-437f-9470-83651ccb3fa7 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.505906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fb817-865c-4b5c-8168-24dd6ab36c4f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.511232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295bfab-cc10-4dc0-9b09-9ef4aafa0703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.512005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295bfab-cc10-4dc0-9b09-9ef4aafa0703 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.512412 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295bfab-cc10-4dc0-9b09-9ef4aafa0703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.512884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295bfab-cc10-4dc0-9b09-9ef4aafa0703 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.514015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295bfab-cc10-4dc0-9b09-9ef4aafa0703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.515595 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295bfab-cc10-4dc0-9b09-9ef4aafa0703 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.519655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1102/2230] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:10.523813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5132863-16da-437f-9470-83651ccb3fa7 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.526455 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1129/2231] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:13:10.531235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295bfab-cc10-4dc0-9b09-9ef4aafa0703 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.535106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5132863-16da-437f-9470-83651ccb3fa7 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.539802 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fbe5c-a69a-44d6-957c-6f141e466888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.540712 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fbe5c-a69a-44d6-957c-6f141e466888 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.540841 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295bfab-cc10-4dc0-9b09-9ef4aafa0703 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.541009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fbe5c-a69a-44d6-957c-6f141e466888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.541256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fbe5c-a69a-44d6-957c-6f141e466888 admin admin] PATH_INFO: `/v3/projects/7458adaedc01454090a4b922578551ec/users/3784c66163f6441a8f33ae72155648dd/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.546493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4554e9-18dd-4d6d-bdf6-e318cf7223c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.547424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4554e9-18dd-4d6d-bdf6-e318cf7223c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.547709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4554e9-18dd-4d6d-bdf6-e318cf7223c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.547983 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4554e9-18dd-4d6d-bdf6-e318cf7223c6 admin admin] PATH_INFO: `/v3/projects/03f46dbd2efd4e408d0cb9ccd21430c3/users/3f64b3fee9874c37b1aa33b317cab22d/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.550077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4554e9-18dd-4d6d-bdf6-e318cf7223c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f46dbd2efd4e408d0cb9ccd21430c3, user_id=3f64b3fee9874c37b1aa33b317cab22d, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.552722 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4554e9-18dd-4d6d-bdf6-e318cf7223c6 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.555597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fbe5c-a69a-44d6-957c-6f141e466888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7458adaedc01454090a4b922578551ec, user_id=3784c66163f6441a8f33ae72155648dd, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.558500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fbe5c-a69a-44d6-957c-6f141e466888 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.563599 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1130/2232] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:10 2022] PUT /identity/v3/projects/03f46dbd2efd4e408d0cb9ccd21430c3/users/3f64b3fee9874c37b1aa33b317cab22d/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:13:10.571673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1103/2233] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:10 2022] PUT /identity/v3/projects/7458adaedc01454090a4b922578551ec/users/3784c66163f6441a8f33ae72155648dd/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:10.574226 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04b1ec-97dd-415b-bead-24058396a4fd None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.574687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04b1ec-97dd-415b-bead-24058396a4fd None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.575028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04b1ec-97dd-415b-bead-24058396a4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.575262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fbe5c-a69a-44d6-957c-6f141e466888 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.607545 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-fa04b1ec-97dd-415b-bead-24058396a4fd None None] MFA Rules not processed for user `3f64b3fee9874c37b1aa33b317cab22d`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:10.609341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-fa04b1ec-97dd-415b-bead-24058396a4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.650808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fbe5c-a69a-44d6-957c-6f141e466888 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.656358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d227204-6ec5-47a2-941a-fe2719a2d64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.657024 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d227204-6ec5-47a2-941a-fe2719a2d64f admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.657305 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d227204-6ec5-47a2-941a-fe2719a2d64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.657579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d227204-6ec5-47a2-941a-fe2719a2d64f admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.658355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d227204-6ec5-47a2-941a-fe2719a2d64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.659941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d227204-6ec5-47a2-941a-fe2719a2d64f admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.672962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1104/2234] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:10.672962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d227204-6ec5-47a2-941a-fe2719a2d64f admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.672962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3d227204-6ec5-47a2-941a-fe2719a2d64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.681096 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1131/2235] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:10.682543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04b1ec-97dd-415b-bead-24058396a4fd None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.684873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d227204-6ec5-47a2-941a-fe2719a2d64f admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.690608 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0c8a8-10c1-42b7-824c-cb13798e405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.691467 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0c8a8-10c1-42b7-824c-cb13798e405f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.691749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0c8a8-10c1-42b7-824c-cb13798e405f admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.692026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0c8a8-10c1-42b7-824c-cb13798e405f admin admin] PATH_INFO: `/v3/projects/e20e02f3a459467da24a0669e0b609aa` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.692988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04b1ec-97dd-415b-bead-24058396a4fd None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.693317 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0c8a8-10c1-42b7-824c-cb13798e405f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20e02f3a459467da24a0669e0b609aa)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.695217 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0c8a8-10c1-42b7-824c-cb13798e405f admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.697531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9eac20-eb89-4b30-aa24-d224f6025689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.698395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9eac20-eb89-4b30-aa24-d224f6025689 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.698674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9eac20-eb89-4b30-aa24-d224f6025689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.698944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9eac20-eb89-4b30-aa24-d224f6025689 admin admin] PATH_INFO: `/v3/projects/7458adaedc01454090a4b922578551ec/users/3784c66163f6441a8f33ae72155648dd/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.701504 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9eac20-eb89-4b30-aa24-d224f6025689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7458adaedc01454090a4b922578551ec, user_id=3784c66163f6441a8f33ae72155648dd, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.704120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9eac20-eb89-4b30-aa24-d224f6025689 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.714562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1132/2236] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:10 2022] PUT /identity/v3/projects/7458adaedc01454090a4b922578551ec/users/3784c66163f6441a8f33ae72155648dd/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:10.715353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9eac20-eb89-4b30-aa24-d224f6025689 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.725304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5a9eac20-eb89-4b30-aa24-d224f6025689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.741990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-95c0c8a8-10c1-42b7-824c-cb13798e405f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20e02f3a459467da24a0669e0b609aa', 'request_id': 'req-95c0c8a8-10c1-42b7-824c-cb13798e405f'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.747105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-95c0c8a8-10c1-42b7-824c-cb13798e405f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20e02f3a459467da24a0669e0b609aa', 'request_id': 'req-95c0c8a8-10c1-42b7-824c-cb13798e405f'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.754552 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-95c0c8a8-10c1-42b7-824c-cb13798e405f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20e02f3a459467da24a0669e0b609aa', 'request_id': 'req-95c0c8a8-10c1-42b7-824c-cb13798e405f'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.766657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-95c0c8a8-10c1-42b7-824c-cb13798e405f admin admin] The token cache is being invalidate because project e20e02f3a459467da24a0669e0b609aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:13:10.766939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-95c0c8a8-10c1-42b7-824c-cb13798e405f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.767632 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-95c0c8a8-10c1-42b7-824c-cb13798e405f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:10.773516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1105/2237] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:13:10 2022] DELETE /identity/v3/projects/e20e02f3a459467da24a0669e0b609aa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:10.773516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173d1b2-492b-42be-bb43-df9fa833fbc6 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.773516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173d1b2-492b-42be-bb43-df9fa833fbc6 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.773516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173d1b2-492b-42be-bb43-df9fa833fbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.783695 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9eac20-eb89-4b30-aa24-d224f6025689 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.799258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-6173d1b2-492b-42be-bb43-df9fa833fbc6 None None] MFA Rules not processed for user `3784c66163f6441a8f33ae72155648dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:10.801824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6173d1b2-492b-42be-bb43-df9fa833fbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.836546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6f6d8-3bad-428a-94f1-c80f78308511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.837180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6f6d8-3bad-428a-94f1-c80f78308511 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.837457 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6f6d8-3bad-428a-94f1-c80f78308511 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.837727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6f6d8-3bad-428a-94f1-c80f78308511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.839550 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-aac6f6d8-3bad-428a-94f1-c80f78308511 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.878290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1106/2238] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:10.879592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed887-b739-436d-859a-7358e3fe0520 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.879874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed887-b739-436d-859a-7358e3fe0520 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.880181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed887-b739-436d-859a-7358e3fe0520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.898055 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-82bed887-b739-436d-859a-7358e3fe0520 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:10.899248 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-82bed887-b739-436d-859a-7358e3fe0520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.900256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6f6d8-3bad-428a-94f1-c80f78308511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.901667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6f6d8-3bad-428a-94f1-c80f78308511 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.910734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1133/2239] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:13:10.911580 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6f6d8-3bad-428a-94f1-c80f78308511 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:10.913155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-aac6f6d8-3bad-428a-94f1-c80f78308511 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:10.928620 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6f6d8-3bad-428a-94f1-c80f78308511 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:10.934252 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf0a59-c32d-4eef-a588-ddc47a258ea3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:10.934983 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0a59-c32d-4eef-a588-ddc47a258ea3 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.935793 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0a59-c32d-4eef-a588-ddc47a258ea3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.936077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0a59-c32d-4eef-a588-ddc47a258ea3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.946215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf0a59-c32d-4eef-a588-ddc47a258ea3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:10.947604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf0a59-c32d-4eef-a588-ddc47a258ea3 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:10.958363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1134/2240] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:13:10.963381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1107/2241] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:10.972161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4241d-3f49-42c4-9b0a-c89a4e74cb2d None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:10.972449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4241d-3f49-42c4-9b0a-c89a4e74cb2d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:10.972726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4241d-3f49-42c4-9b0a-c89a4e74cb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:10.992247 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e0c4241d-3f49-42c4-9b0a-c89a4e74cb2d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:10.993353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e0c4241d-3f49-42c4-9b0a-c89a4e74cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:11.002369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1135/2242] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:11.008368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bed887-b739-436d-859a-7358e3fe0520 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:11.024783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bed887-b739-436d-859a-7358e3fe0520 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:11.030478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2d676-c879-427b-b509-fad9400e122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:11.031138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2d676-c879-427b-b509-fad9400e122c admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:11.031495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2d676-c879-427b-b509-fad9400e122c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:11.033310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2d676-c879-427b-b509-fad9400e122c admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:11.034491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2d676-c879-427b-b509-fad9400e122c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:13:11.042436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2d676-c879-427b-b509-fad9400e122c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:11.044387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2d676-c879-427b-b509-fad9400e122c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:11.064629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1108/2243] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:13:11.069938 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4241d-3f49-42c4-9b0a-c89a4e74cb2d None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:11.080211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4241d-3f49-42c4-9b0a-c89a4e74cb2d None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:11.091055 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb4cf5-ba66-485a-a6db-f212f7ae1b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:11.092399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb4cf5-ba66-485a-a6db-f212f7ae1b2a admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:11.092786 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb4cf5-ba66-485a-a6db-f212f7ae1b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:11.093063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb4cf5-ba66-485a-a6db-f212f7ae1b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:11.093878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb4cf5-ba66-485a-a6db-f212f7ae1b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:11.099950 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb4cf5-ba66-485a-a6db-f212f7ae1b2a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:11.141042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1136/2244] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:13:11 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:11.157019 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2d676-c879-427b-b509-fad9400e122c admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:11.167692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2d676-c879-427b-b509-fad9400e122c admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:11.238013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfd5f1-5ecd-4769-a8db-09fab60fc327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:11.238679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd5f1-5ecd-4769-a8db-09fab60fc327 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:11.238958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd5f1-5ecd-4769-a8db-09fab60fc327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:11.239229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd5f1-5ecd-4769-a8db-09fab60fc327 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:11.241084 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfd5f1-5ecd-4769-a8db-09fab60fc327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:11.242986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfd5f1-5ecd-4769-a8db-09fab60fc327 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:11.275059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1109/2245] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:13:11 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:11.287147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb4cf5-ba66-485a-a6db-f212f7ae1b2a admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:11.299370 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb4cf5-ba66-485a-a6db-f212f7ae1b2a admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:11.308194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff55d42-7e5e-42de-9b8b-e4743e080356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:11.308970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff55d42-7e5e-42de-9b8b-e4743e080356 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:11.309299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff55d42-7e5e-42de-9b8b-e4743e080356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:11.309626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff55d42-7e5e-42de-9b8b-e4743e080356 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:11.310921 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff55d42-7e5e-42de-9b8b-e4743e080356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:11.314551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff55d42-7e5e-42de-9b8b-e4743e080356 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:11.324220 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1137/2246] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:11.328104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfd5f1-5ecd-4769-a8db-09fab60fc327 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:11.339057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfd5f1-5ecd-4769-a8db-09fab60fc327 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:11.345824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7700ea-9fc2-4f56-a7fd-10c368310b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:11.346572 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7700ea-9fc2-4f56-a7fd-10c368310b56 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:11.346888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7700ea-9fc2-4f56-a7fd-10c368310b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:11.347164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7700ea-9fc2-4f56-a7fd-10c368310b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:11.348044 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7700ea-9fc2-4f56-a7fd-10c368310b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:11.349931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7700ea-9fc2-4f56-a7fd-10c368310b56 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:11.364786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1110/2247] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:11.365609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff55d42-7e5e-42de-9b8b-e4743e080356 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:11.378028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff55d42-7e5e-42de-9b8b-e4743e080356 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:11.383851 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55660786-4d81-43f6-ad86-641d079599d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:11.384769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55660786-4d81-43f6-ad86-641d079599d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:11.385045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55660786-4d81-43f6-ad86-641d079599d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:11.385316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55660786-4d81-43f6-ad86-641d079599d8 admin admin] PATH_INFO: `/v3/projects/54a6c7a983724c98a52bfb901940fe45/users/da82ca5a4e5c4b4c94ff084ba5a457de/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:11.402733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55660786-4d81-43f6-ad86-641d079599d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a6c7a983724c98a52bfb901940fe45, user_id=da82ca5a4e5c4b4c94ff084ba5a457de, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:11.405501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55660786-4d81-43f6-ad86-641d079599d8 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:11.419257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1138/2248] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:11 2022] PUT /identity/v3/projects/54a6c7a983724c98a52bfb901940fe45/users/da82ca5a4e5c4b4c94ff084ba5a457de/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:11.430090 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df61280-74c5-47e8-a49e-02c7d45968df None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:11.430374 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df61280-74c5-47e8-a49e-02c7d45968df None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:11.430647 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df61280-74c5-47e8-a49e-02c7d45968df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:11.460736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5df61280-74c5-47e8-a49e-02c7d45968df None None] MFA Rules not processed for user `da82ca5a4e5c4b4c94ff084ba5a457de`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:11.461944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5df61280-74c5-47e8-a49e-02c7d45968df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:11.470971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55660786-4d81-43f6-ad86-641d079599d8 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:11.472759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-55660786-4d81-43f6-ad86-641d079599d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:11.538433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55660786-4d81-43f6-ad86-641d079599d8 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:11.543182 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa3490-8ea7-462e-9515-952f71461b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:11.544049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3490-8ea7-462e-9515-952f71461b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:11.544363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3490-8ea7-462e-9515-952f71461b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:11.544683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3490-8ea7-462e-9515-952f71461b00 admin admin] PATH_INFO: `/v3/users/2bb85f22141a4764bed71ff1d8f3a2a1` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:11.546396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa3490-8ea7-462e-9515-952f71461b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb85f22141a4764bed71ff1d8f3a2a1)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:11.547618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1111/2249] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:11.551300 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa3490-8ea7-462e-9515-952f71461b00 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:11.559874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df61280-74c5-47e8-a49e-02c7d45968df None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:11.561294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5df61280-74c5-47e8-a49e-02c7d45968df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:11.594885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-91aa3490-8ea7-462e-9515-952f71461b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb85f22141a4764bed71ff1d8f3a2a1'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:11.601424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-91aa3490-8ea7-462e-9515-952f71461b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb85f22141a4764bed71ff1d8f3a2a1'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:11.602103 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-91aa3490-8ea7-462e-9515-952f71461b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb85f22141a4764bed71ff1d8f3a2a1'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:11.602715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-91aa3490-8ea7-462e-9515-952f71461b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb85f22141a4764bed71ff1d8f3a2a1'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:11.614613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-91aa3490-8ea7-462e-9515-952f71461b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb85f22141a4764bed71ff1d8f3a2a1'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:11.619444 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df61280-74c5-47e8-a49e-02c7d45968df None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:11.623471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79b47f-b0a3-44ae-974f-5b9c19eccfb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1848679bce324613b4a92de808165ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:11.624262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79b47f-b0a3-44ae-974f-5b9c19eccfb8 service glance] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:11.624544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79b47f-b0a3-44ae-974f-5b9c19eccfb8 service glance] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:11.624816 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79b47f-b0a3-44ae-974f-5b9c19eccfb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:11.626625 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6f79b47f-b0a3-44ae-974f-5b9c19eccfb8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:11.627452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1139/2250] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:13:11 2022] DELETE /identity/v3/users/2bb85f22141a4764bed71ff1d8f3a2a1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:13:11.631514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fd279-a9bd-4741-9a36-7465f280f2b2 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:11.631900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fd279-a9bd-4741-9a36-7465f280f2b2 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:11.632240 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fd279-a9bd-4741-9a36-7465f280f2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:11.637660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79b47f-b0a3-44ae-974f-5b9c19eccfb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:11.639219 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79b47f-b0a3-44ae-974f-5b9c19eccfb8 service glance] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:11.648202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1112/2251] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:13:11.649720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-193fd279-a9bd-4741-9a36-7465f280f2b2 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:11.650903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-193fd279-a9bd-4741-9a36-7465f280f2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:11.713769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1140/2252] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:13:11.724157 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79b47f-b0a3-44ae-974f-5b9c19eccfb8 service glance] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:11.725630 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6f79b47f-b0a3-44ae-974f-5b9c19eccfb8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:11.789041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79b47f-b0a3-44ae-974f-5b9c19eccfb8 service glance] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:11.837106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d529a7e-c7e4-48c5-a188-4ce1205610fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:11.837764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d529a7e-c7e4-48c5-a188-4ce1205610fb service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:11.838039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d529a7e-c7e4-48c5-a188-4ce1205610fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:11.838307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d529a7e-c7e4-48c5-a188-4ce1205610fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:11.848335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d529a7e-c7e4-48c5-a188-4ce1205610fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:11.849749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d529a7e-c7e4-48c5-a188-4ce1205610fb service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:11.859851 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1113/2253] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:13:12.127330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fd279-a9bd-4741-9a36-7465f280f2b2 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:12.128796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-193fd279-a9bd-4741-9a36-7465f280f2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:12.142917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fd279-a9bd-4741-9a36-7465f280f2b2 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:12.147491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:12.149401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:12.149724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:12.150011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] PATH_INFO: `/v3/projects/2f6545bd643143889dd68e5122cd3d9b` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:12.151245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6545bd643143889dd68e5122cd3d9b)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:12.153156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:12.215295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6545bd643143889dd68e5122cd3d9b', 'request_id': 'req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.227809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6545bd643143889dd68e5122cd3d9b', 'request_id': 'req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.233950 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6545bd643143889dd68e5122cd3d9b', 'request_id': 'req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.245759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] The token cache is being invalidate because project 2f6545bd643143889dd68e5122cd3d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:13:12.246016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.246694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.248314 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1141/2254] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:13:12 2022] DELETE /identity/v3/projects/2f6545bd643143889dd68e5122cd3d9b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:12.252338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d529a7e-c7e4-48c5-a188-4ce1205610fb service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:12.268537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d529a7e-c7e4-48c5-a188-4ce1205610fb service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:12.328230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f986f-c8b8-4c40-804f-dcfacd2ab02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:12.329100 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f986f-c8b8-4c40-804f-dcfacd2ab02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:12.329368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f986f-c8b8-4c40-804f-dcfacd2ab02c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:12.329633 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f986f-c8b8-4c40-804f-dcfacd2ab02c admin admin] PATH_INFO: `/v3/users/3784c66163f6441a8f33ae72155648dd` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:12.330805 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f986f-c8b8-4c40-804f-dcfacd2ab02c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3784c66163f6441a8f33ae72155648dd)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:12.332748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f986f-c8b8-4c40-804f-dcfacd2ab02c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:12.376337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ef0f986f-c8b8-4c40-804f-dcfacd2ab02c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3784c66163f6441a8f33ae72155648dd'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.384985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ef0f986f-c8b8-4c40-804f-dcfacd2ab02c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3784c66163f6441a8f33ae72155648dd'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.392376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ef0f986f-c8b8-4c40-804f-dcfacd2ab02c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3784c66163f6441a8f33ae72155648dd'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.393030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ef0f986f-c8b8-4c40-804f-dcfacd2ab02c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3784c66163f6441a8f33ae72155648dd'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.393618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ef0f986f-c8b8-4c40-804f-dcfacd2ab02c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3784c66163f6441a8f33ae72155648dd'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.410174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1114/2255] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:13:12 2022] DELETE /identity/v3/users/3784c66163f6441a8f33ae72155648dd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:13:12.670816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:12.672344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:12.688546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6acaa-d18a-4a8f-9a34-692f1e9c143e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:12.744211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b637d20-7740-4bac-9147-ba30df6c06ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:12.745066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b637d20-7740-4bac-9147-ba30df6c06ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:12.745340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b637d20-7740-4bac-9147-ba30df6c06ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:12.745607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b637d20-7740-4bac-9147-ba30df6c06ac admin admin] PATH_INFO: `/v3/projects/7458adaedc01454090a4b922578551ec` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:12.746821 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b637d20-7740-4bac-9147-ba30df6c06ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7458adaedc01454090a4b922578551ec)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:12.749384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b637d20-7740-4bac-9147-ba30df6c06ac admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:12.792065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-4b637d20-7740-4bac-9147-ba30df6c06ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7458adaedc01454090a4b922578551ec', 'request_id': 'req-4b637d20-7740-4bac-9147-ba30df6c06ac'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.800001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-4b637d20-7740-4bac-9147-ba30df6c06ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7458adaedc01454090a4b922578551ec', 'request_id': 'req-4b637d20-7740-4bac-9147-ba30df6c06ac'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.805702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-4b637d20-7740-4bac-9147-ba30df6c06ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7458adaedc01454090a4b922578551ec', 'request_id': 'req-4b637d20-7740-4bac-9147-ba30df6c06ac'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.816978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-4b637d20-7740-4bac-9147-ba30df6c06ac admin admin] The token cache is being invalidate because project 7458adaedc01454090a4b922578551ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:13:12.817265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-4b637d20-7740-4bac-9147-ba30df6c06ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.817888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-4b637d20-7740-4bac-9147-ba30df6c06ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:12.819384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1142/2256] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:13:12 2022] DELETE /identity/v3/projects/7458adaedc01454090a4b922578551ec => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:12.824388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03640c-9dcb-4eba-b404-e46271d0683e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:12.824717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03640c-9dcb-4eba-b404-e46271d0683e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:12.825023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03640c-9dcb-4eba-b404-e46271d0683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:12.842887 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8c03640c-9dcb-4eba-b404-e46271d0683e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:12.844079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8c03640c-9dcb-4eba-b404-e46271d0683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:12.899527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1115/2257] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:12.908368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277644c6-369e-4829-97c5-20550d8c408c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:12.908659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277644c6-369e-4829-97c5-20550d8c408c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:12.908936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277644c6-369e-4829-97c5-20550d8c408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:12.927678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-277644c6-369e-4829-97c5-20550d8c408c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:12.928896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-277644c6-369e-4829-97c5-20550d8c408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:12.937709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1143/2258] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:12.941903 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03640c-9dcb-4eba-b404-e46271d0683e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:12.951478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03640c-9dcb-4eba-b404-e46271d0683e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:12.955984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387767e-10e6-4281-9443-bd85cbfae8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:12.956666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387767e-10e6-4281-9443-bd85cbfae8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:12.956942 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387767e-10e6-4281-9443-bd85cbfae8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:12.957212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387767e-10e6-4281-9443-bd85cbfae8f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:12.957923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387767e-10e6-4281-9443-bd85cbfae8f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:13:12.958223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387767e-10e6-4281-9443-bd85cbfae8f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:12.959793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387767e-10e6-4281-9443-bd85cbfae8f5 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:12.970828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1116/2259] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:13:12.974955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277644c6-369e-4829-97c5-20550d8c408c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:12.984336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277644c6-369e-4829-97c5-20550d8c408c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:12.988927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6d602-91ae-45df-a7f2-c53a805145c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:12.989552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6d602-91ae-45df-a7f2-c53a805145c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:12.989835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6d602-91ae-45df-a7f2-c53a805145c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:12.990131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6d602-91ae-45df-a7f2-c53a805145c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:12.990802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6d602-91ae-45df-a7f2-c53a805145c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:12.992696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6d602-91ae-45df-a7f2-c53a805145c9 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:13.017239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1144/2260] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:13:12 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:13:13.021137 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387767e-10e6-4281-9443-bd85cbfae8f5 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:13.031285 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387767e-10e6-4281-9443-bd85cbfae8f5 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:13.086352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2430f3-fc69-4b69-a589-d9989afa306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:13.086984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2430f3-fc69-4b69-a589-d9989afa306f admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.087266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2430f3-fc69-4b69-a589-d9989afa306f admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.087538 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2430f3-fc69-4b69-a589-d9989afa306f admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.088264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2430f3-fc69-4b69-a589-d9989afa306f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:13.090165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2430f3-fc69-4b69-a589-d9989afa306f admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:13.110689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1117/2261] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:13:13 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:13:13.114840 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6d602-91ae-45df-a7f2-c53a805145c9 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:13.125618 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6d602-91ae-45df-a7f2-c53a805145c9 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:13.130516 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b2a04-d791-441b-9ea2-7cb7ae2f4304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:13.131178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b2a04-d791-441b-9ea2-7cb7ae2f4304 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.131476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b2a04-d791-441b-9ea2-7cb7ae2f4304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.131754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b2a04-d791-441b-9ea2-7cb7ae2f4304 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.132652 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b2a04-d791-441b-9ea2-7cb7ae2f4304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:13.134245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b2a04-d791-441b-9ea2-7cb7ae2f4304 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:13.145181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1145/2262] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:13.149238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2430f3-fc69-4b69-a589-d9989afa306f admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:13.159793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2430f3-fc69-4b69-a589-d9989afa306f admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:13.164471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d9cba-290a-4010-b32d-4c6d06eed14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:13.165128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9cba-290a-4010-b32d-4c6d06eed14c admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.165409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9cba-290a-4010-b32d-4c6d06eed14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.165682 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9cba-290a-4010-b32d-4c6d06eed14c admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.166401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d9cba-290a-4010-b32d-4c6d06eed14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:13.167985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d9cba-290a-4010-b32d-4c6d06eed14c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:13.178710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1118/2263] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:13.183057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b2a04-d791-441b-9ea2-7cb7ae2f4304 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:13.192905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b2a04-d791-441b-9ea2-7cb7ae2f4304 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:13.198025 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57f913-a0f7-40f4-9672-202cb7c5bba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:13.198891 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f913-a0f7-40f4-9672-202cb7c5bba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.199168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f913-a0f7-40f4-9672-202cb7c5bba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.199439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f913-a0f7-40f4-9672-202cb7c5bba4 admin admin] PATH_INFO: `/v3/projects/5478806db9b0478eb39ca47ed7cc6da4/users/c84da8065e18493cb4ca962b0665b73e/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.215291 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57f913-a0f7-40f4-9672-202cb7c5bba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5478806db9b0478eb39ca47ed7cc6da4, user_id=c84da8065e18493cb4ca962b0665b73e, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:13.218734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57f913-a0f7-40f4-9672-202cb7c5bba4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:13.238179 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1146/2264] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:13 2022] PUT /identity/v3/projects/5478806db9b0478eb39ca47ed7cc6da4/users/c84da8065e18493cb4ca962b0665b73e/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:13.248528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b639617-7011-481f-b5d0-a6618207a4d9 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.248932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b639617-7011-481f-b5d0-a6618207a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.249218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b639617-7011-481f-b5d0-a6618207a4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.278623 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-2b639617-7011-481f-b5d0-a6618207a4d9 None None] MFA Rules not processed for user `c84da8065e18493cb4ca962b0665b73e`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:13.280581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2b639617-7011-481f-b5d0-a6618207a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:13.347129 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1119/2265] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:13.351541 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57f913-a0f7-40f4-9672-202cb7c5bba4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:13.419035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57f913-a0f7-40f4-9672-202cb7c5bba4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:13.424535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644b672-27a4-4e0f-ad73-c5ce34795962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:13.425194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b672-27a4-4e0f-ad73-c5ce34795962 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.425583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b672-27a4-4e0f-ad73-c5ce34795962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.425878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b672-27a4-4e0f-ad73-c5ce34795962 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.426428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644b672-27a4-4e0f-ad73-c5ce34795962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:13.428937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644b672-27a4-4e0f-ad73-c5ce34795962 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:13.457403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1147/2266] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:13:13 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:13.461099 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b639617-7011-481f-b5d0-a6618207a4d9 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:13.476804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b639617-7011-481f-b5d0-a6618207a4d9 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:13.534234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589a580-1bf5-40c1-9d19-08c89cfa8b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:13.534904 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589a580-1bf5-40c1-9d19-08c89cfa8b23 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.535181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589a580-1bf5-40c1-9d19-08c89cfa8b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.535499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589a580-1bf5-40c1-9d19-08c89cfa8b23 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.536234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589a580-1bf5-40c1-9d19-08c89cfa8b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:13.538231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589a580-1bf5-40c1-9d19-08c89cfa8b23 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:13.559590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1120/2267] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:13:13 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:13.563788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644b672-27a4-4e0f-ad73-c5ce34795962 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:13.574816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644b672-27a4-4e0f-ad73-c5ce34795962 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:13.581371 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70dab2-b6c4-4f89-99b2-e72836b22f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:13.582193 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dab2-b6c4-4f89-99b2-e72836b22f70 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.582443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dab2-b6c4-4f89-99b2-e72836b22f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.582747 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dab2-b6c4-4f89-99b2-e72836b22f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.583542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70dab2-b6c4-4f89-99b2-e72836b22f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:13.585286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70dab2-b6c4-4f89-99b2-e72836b22f70 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:13.597356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1148/2268] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:13.601490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589a580-1bf5-40c1-9d19-08c89cfa8b23 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:13.612399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589a580-1bf5-40c1-9d19-08c89cfa8b23 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:13.617026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cd224-783f-476f-96ff-e9bad18f4143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:13.617922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cd224-783f-476f-96ff-e9bad18f4143 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.618199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cd224-783f-476f-96ff-e9bad18f4143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.618468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cd224-783f-476f-96ff-e9bad18f4143 admin admin] PATH_INFO: `/v3/projects/b725f6d7c2984b37892cf0529e69ddea/users/eb2109ba72b84b7ba6732fcf344c3405/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.633336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cd224-783f-476f-96ff-e9bad18f4143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b725f6d7c2984b37892cf0529e69ddea, user_id=eb2109ba72b84b7ba6732fcf344c3405, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:13.636496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cd224-783f-476f-96ff-e9bad18f4143 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:13.655282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1121/2269] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:13 2022] PUT /identity/v3/projects/b725f6d7c2984b37892cf0529e69ddea/users/eb2109ba72b84b7ba6732fcf344c3405/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:13.659243 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70dab2-b6c4-4f89-99b2-e72836b22f70 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:13.669097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70dab2-b6c4-4f89-99b2-e72836b22f70 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:13.725121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c4744-64a6-4bb7-92ec-93654e62b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:13.725786 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c4744-64a6-4bb7-92ec-93654e62b410 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.726072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c4744-64a6-4bb7-92ec-93654e62b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.726350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c4744-64a6-4bb7-92ec-93654e62b410 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.727075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c4744-64a6-4bb7-92ec-93654e62b410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:13.728728 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c4744-64a6-4bb7-92ec-93654e62b410 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:13.738417 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1149/2270] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:13.742472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cd224-783f-476f-96ff-e9bad18f4143 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:13.756564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cd224-783f-476f-96ff-e9bad18f4143 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:13.761387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba026a1e-b670-4683-98c7-407493811cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:13.762262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba026a1e-b670-4683-98c7-407493811cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.762545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba026a1e-b670-4683-98c7-407493811cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.762817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba026a1e-b670-4683-98c7-407493811cb2 admin admin] PATH_INFO: `/v3/projects/b725f6d7c2984b37892cf0529e69ddea/users/eb2109ba72b84b7ba6732fcf344c3405/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.766396 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba026a1e-b670-4683-98c7-407493811cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b725f6d7c2984b37892cf0529e69ddea, user_id=eb2109ba72b84b7ba6732fcf344c3405, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:13.771337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba026a1e-b670-4683-98c7-407493811cb2 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:13.782142 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1122/2271] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:13 2022] PUT /identity/v3/projects/b725f6d7c2984b37892cf0529e69ddea/users/eb2109ba72b84b7ba6732fcf344c3405/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:13.792249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aa5af-d9ed-43f1-bd9e-4760ad6fb030 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.792720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aa5af-d9ed-43f1-bd9e-4760ad6fb030 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.792813 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aa5af-d9ed-43f1-bd9e-4760ad6fb030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.820640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-c09aa5af-d9ed-43f1-bd9e-4760ad6fb030 None None] MFA Rules not processed for user `eb2109ba72b84b7ba6732fcf344c3405`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:13.821973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c09aa5af-d9ed-43f1-bd9e-4760ad6fb030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:13.887522 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1150/2272] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:13.899135 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba026a1e-b670-4683-98c7-407493811cb2 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:13.900974 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ba026a1e-b670-4683-98c7-407493811cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:13.957485 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba026a1e-b670-4683-98c7-407493811cb2 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:13.961117 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93043e59-a9a3-4f3a-bdf0-3b28e333be77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:13.961739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93043e59-a9a3-4f3a-bdf0-3b28e333be77 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:13.962017 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93043e59-a9a3-4f3a-bdf0-3b28e333be77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:13.962290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93043e59-a9a3-4f3a-bdf0-3b28e333be77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:13.971027 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93043e59-a9a3-4f3a-bdf0-3b28e333be77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:13.972504 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93043e59-a9a3-4f3a-bdf0-3b28e333be77 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:13.982384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1123/2273] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:13:14.010004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09aa5af-d9ed-43f1-bd9e-4760ad6fb030 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:14.073419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09aa5af-d9ed-43f1-bd9e-4760ad6fb030 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:14.078694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:14.079568 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:14.079849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:14.080155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] PATH_INFO: `/v3/users/c84da8065e18493cb4ca962b0665b73e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:14.081747 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84da8065e18493cb4ca962b0665b73e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:14.083729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:14.128245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84da8065e18493cb4ca962b0665b73e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.135534 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84da8065e18493cb4ca962b0665b73e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.136303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84da8065e18493cb4ca962b0665b73e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.136924 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84da8065e18493cb4ca962b0665b73e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.148946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84da8065e18493cb4ca962b0665b73e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.161874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1151/2274] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:13:14 2022] DELETE /identity/v3/users/c84da8065e18493cb4ca962b0665b73e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:14.169284 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55eb5-1087-42cb-b1cb-dac1d2df4a12 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:14.170933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55eb5-1087-42cb-b1cb-dac1d2df4a12 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:14.171564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55eb5-1087-42cb-b1cb-dac1d2df4a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:14.190582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-9bf55eb5-1087-42cb-b1cb-dac1d2df4a12 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:14.192310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9bf55eb5-1087-42cb-b1cb-dac1d2df4a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:14.255774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1124/2275] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:14.267374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:14.268788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:14.334086 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf00dda-6911-41cf-beb4-67d5b91cf343 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:14.338934 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54166dd-e8aa-41f3-8c1a-c14c431fce54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:14.339590 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54166dd-e8aa-41f3-8c1a-c14c431fce54 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:14.339865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54166dd-e8aa-41f3-8c1a-c14c431fce54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:14.340151 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54166dd-e8aa-41f3-8c1a-c14c431fce54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:14.355616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54166dd-e8aa-41f3-8c1a-c14c431fce54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:14.357678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54166dd-e8aa-41f3-8c1a-c14c431fce54 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:14.367111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1152/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:13:14.665488 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf55eb5-1087-42cb-b1cb-dac1d2df4a12 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:14.666963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9bf55eb5-1087-42cb-b1cb-dac1d2df4a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:14.681318 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf55eb5-1087-42cb-b1cb-dac1d2df4a12 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:14.705319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:14.706345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:14.706553 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:14.706826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] PATH_INFO: `/v3/projects/5478806db9b0478eb39ca47ed7cc6da4` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:14.708232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5478806db9b0478eb39ca47ed7cc6da4)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:14.710132 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:14.766324 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5478806db9b0478eb39ca47ed7cc6da4', 'request_id': 'req-c8f1475a-ad33-41e2-876c-815c643a07e1'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.771581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5478806db9b0478eb39ca47ed7cc6da4', 'request_id': 'req-c8f1475a-ad33-41e2-876c-815c643a07e1'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.778784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5478806db9b0478eb39ca47ed7cc6da4', 'request_id': 'req-c8f1475a-ad33-41e2-876c-815c643a07e1'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.790120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] The token cache is being invalidate because project 5478806db9b0478eb39ca47ed7cc6da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:13:14.790407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.791052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.792596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1125/2277] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:13:14 2022] DELETE /identity/v3/projects/5478806db9b0478eb39ca47ed7cc6da4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:14.797130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54166dd-e8aa-41f3-8c1a-c14c431fce54 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:14.806983 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54166dd-e8aa-41f3-8c1a-c14c431fce54 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:14.866270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3673dc-e026-4e17-bc10-7f38c274db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:14.867168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3673dc-e026-4e17-bc10-7f38c274db51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:14.867443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3673dc-e026-4e17-bc10-7f38c274db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:14.867713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3673dc-e026-4e17-bc10-7f38c274db51 admin admin] PATH_INFO: `/v3/users/eb2109ba72b84b7ba6732fcf344c3405` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:14.868927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3673dc-e026-4e17-bc10-7f38c274db51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb2109ba72b84b7ba6732fcf344c3405)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:14.870831 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3673dc-e026-4e17-bc10-7f38c274db51 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:14.916299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7d3673dc-e026-4e17-bc10-7f38c274db51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb2109ba72b84b7ba6732fcf344c3405'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.923662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7d3673dc-e026-4e17-bc10-7f38c274db51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb2109ba72b84b7ba6732fcf344c3405'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.924359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7d3673dc-e026-4e17-bc10-7f38c274db51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb2109ba72b84b7ba6732fcf344c3405'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.924947 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7d3673dc-e026-4e17-bc10-7f38c274db51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb2109ba72b84b7ba6732fcf344c3405'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.936263 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7d3673dc-e026-4e17-bc10-7f38c274db51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb2109ba72b84b7ba6732fcf344c3405'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:14.949039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1153/2278] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:13:14 2022] DELETE /identity/v3/users/eb2109ba72b84b7ba6732fcf344c3405 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:15.210139 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:15.211615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:15.233817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1475a-ad33-41e2-876c-815c643a07e1 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:15.289690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd9ea4-34fb-4d63-b966-d1a883001c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:15.290567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd9ea4-34fb-4d63-b966-d1a883001c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:15.290847 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd9ea4-34fb-4d63-b966-d1a883001c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:15.291122 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd9ea4-34fb-4d63-b966-d1a883001c6d admin admin] PATH_INFO: `/v3/projects/b725f6d7c2984b37892cf0529e69ddea` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:15.292419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd9ea4-34fb-4d63-b966-d1a883001c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b725f6d7c2984b37892cf0529e69ddea)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:15.294333 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd9ea4-34fb-4d63-b966-d1a883001c6d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:15.341400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-46cd9ea4-34fb-4d63-b966-d1a883001c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b725f6d7c2984b37892cf0529e69ddea', 'request_id': 'req-46cd9ea4-34fb-4d63-b966-d1a883001c6d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:15.346509 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-46cd9ea4-34fb-4d63-b966-d1a883001c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b725f6d7c2984b37892cf0529e69ddea', 'request_id': 'req-46cd9ea4-34fb-4d63-b966-d1a883001c6d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:15.353176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-46cd9ea4-34fb-4d63-b966-d1a883001c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b725f6d7c2984b37892cf0529e69ddea', 'request_id': 'req-46cd9ea4-34fb-4d63-b966-d1a883001c6d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:15.364025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-46cd9ea4-34fb-4d63-b966-d1a883001c6d admin admin] The token cache is being invalidate because project b725f6d7c2984b37892cf0529e69ddea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:13:15.364274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-46cd9ea4-34fb-4d63-b966-d1a883001c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:15.364914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-46cd9ea4-34fb-4d63-b966-d1a883001c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:15.366438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1126/2279] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:13:15 2022] DELETE /identity/v3/projects/b725f6d7c2984b37892cf0529e69ddea => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:15.371256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f043cae-1dc7-49a9-871b-83de13941f46 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:15.371547 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f043cae-1dc7-49a9-871b-83de13941f46 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:15.371823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f043cae-1dc7-49a9-871b-83de13941f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:15.391754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-9f043cae-1dc7-49a9-871b-83de13941f46 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:15.392983 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9f043cae-1dc7-49a9-871b-83de13941f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:15.473615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1154/2280] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:13:15.482619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4ec6-007f-42c9-b60a-d1793f02ec41 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:15.482925 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4ec6-007f-42c9-b60a-d1793f02ec41 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:15.483178 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4ec6-007f-42c9-b60a-d1793f02ec41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:15.507538 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-8bee4ec6-007f-42c9-b60a-d1793f02ec41 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:15.508813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-8bee4ec6-007f-42c9-b60a-d1793f02ec41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:15.518743 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1127/2281] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:15.523214 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f043cae-1dc7-49a9-871b-83de13941f46 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:15.532886 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f043cae-1dc7-49a9-871b-83de13941f46 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:15.538092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c5e9d-a5a7-43f9-a438-bbe5c6a6d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:15.538963 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c5e9d-a5a7-43f9-a438-bbe5c6a6d1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:15.539316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c5e9d-a5a7-43f9-a438-bbe5c6a6d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:15.539653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c5e9d-a5a7-43f9-a438-bbe5c6a6d1f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:15.540492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c5e9d-a5a7-43f9-a438-bbe5c6a6d1f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:13:15.541005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c5e9d-a5a7-43f9-a438-bbe5c6a6d1f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:15.543379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c5e9d-a5a7-43f9-a438-bbe5c6a6d1f3 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:15.558639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1155/2282] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:13:15.563003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4ec6-007f-42c9-b60a-d1793f02ec41 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:15.572494 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4ec6-007f-42c9-b60a-d1793f02ec41 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:15.578042 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b97450-b93c-4407-8c67-16a44c70ed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:15.578716 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b97450-b93c-4407-8c67-16a44c70ed53 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:15.579049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b97450-b93c-4407-8c67-16a44c70ed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:15.579243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b97450-b93c-4407-8c67-16a44c70ed53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:15.579952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b97450-b93c-4407-8c67-16a44c70ed53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:15.582354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b97450-b93c-4407-8c67-16a44c70ed53 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:15.614280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1128/2283] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:13:15 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:15.615753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c5e9d-a5a7-43f9-a438-bbe5c6a6d1f3 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:15.632926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c5e9d-a5a7-43f9-a438-bbe5c6a6d1f3 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:15.704185 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea3d27-9abb-4442-a945-a7dc89bf28be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:15.706903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea3d27-9abb-4442-a945-a7dc89bf28be admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:15.707127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea3d27-9abb-4442-a945-a7dc89bf28be admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:15.707424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea3d27-9abb-4442-a945-a7dc89bf28be admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:15.708215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea3d27-9abb-4442-a945-a7dc89bf28be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:15.710293 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea3d27-9abb-4442-a945-a7dc89bf28be admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:15.744228 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1156/2284] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:13:15 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:15.748903 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b97450-b93c-4407-8c67-16a44c70ed53 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:15.760907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b97450-b93c-4407-8c67-16a44c70ed53 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:15.766684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5382d44-f6cf-4ca7-9023-8f4358b258ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:15.767357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5382d44-f6cf-4ca7-9023-8f4358b258ec admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:15.767636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5382d44-f6cf-4ca7-9023-8f4358b258ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:15.767909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5382d44-f6cf-4ca7-9023-8f4358b258ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:15.768674 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5382d44-f6cf-4ca7-9023-8f4358b258ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:15.771151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5382d44-f6cf-4ca7-9023-8f4358b258ec admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:15.784123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1129/2285] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:15.788906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea3d27-9abb-4442-a945-a7dc89bf28be admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:15.800373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea3d27-9abb-4442-a945-a7dc89bf28be admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:15.807161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f8924-051b-4498-86d4-9170ce6dd291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:15.808318 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f8924-051b-4498-86d4-9170ce6dd291 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:15.808686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f8924-051b-4498-86d4-9170ce6dd291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:15.808965 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f8924-051b-4498-86d4-9170ce6dd291 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:15.811735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f8924-051b-4498-86d4-9170ce6dd291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:15.813435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f8924-051b-4498-86d4-9170ce6dd291 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:15.831215 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1157/2286] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:15.832705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5382d44-f6cf-4ca7-9023-8f4358b258ec admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:15.843210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5382d44-f6cf-4ca7-9023-8f4358b258ec admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:15.848876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a07f18-c34f-4ca9-addf-173bbece50d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:15.852128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07f18-c34f-4ca9-addf-173bbece50d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:15.852128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07f18-c34f-4ca9-addf-173bbece50d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:15.852128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07f18-c34f-4ca9-addf-173bbece50d4 admin admin] PATH_INFO: `/v3/projects/918fb79e77b44000a3bca1c68d45c1d1/users/99c73e9cee2f40589a8d9dc3807b48b7/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:15.867163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a07f18-c34f-4ca9-addf-173bbece50d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918fb79e77b44000a3bca1c68d45c1d1, user_id=99c73e9cee2f40589a8d9dc3807b48b7, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:15.870164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a07f18-c34f-4ca9-addf-173bbece50d4 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:15.900570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1130/2287] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:15 2022] PUT /identity/v3/projects/918fb79e77b44000a3bca1c68d45c1d1/users/99c73e9cee2f40589a8d9dc3807b48b7/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:15.912394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5407e02-f015-428f-829e-4fb342878fbe None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:15.913124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5407e02-f015-428f-829e-4fb342878fbe None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:15.913987 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5407e02-f015-428f-829e-4fb342878fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:15.949235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-a5407e02-f015-428f-829e-4fb342878fbe None None] MFA Rules not processed for user `99c73e9cee2f40589a8d9dc3807b48b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:15.950588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a5407e02-f015-428f-829e-4fb342878fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:16.039274 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1158/2288] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:16.043399 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a07f18-c34f-4ca9-addf-173bbece50d4 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:16.104545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a07f18-c34f-4ca9-addf-173bbece50d4 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:16.110360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20f866-7635-4506-b5c5-13d082bf69e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:16.111008 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20f866-7635-4506-b5c5-13d082bf69e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:16.111284 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20f866-7635-4506-b5c5-13d082bf69e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:16.111579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20f866-7635-4506-b5c5-13d082bf69e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:16.112301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20f866-7635-4506-b5c5-13d082bf69e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:16.114254 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20f866-7635-4506-b5c5-13d082bf69e9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:16.149930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1131/2289] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:13:16 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:16.153364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5407e02-f015-428f-829e-4fb342878fbe None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:16.166400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5407e02-f015-428f-829e-4fb342878fbe None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:16.224645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b54d42-4fbe-4757-b0e0-d9d24eaecdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:16.225311 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b54d42-4fbe-4757-b0e0-d9d24eaecdce admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:16.225590 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b54d42-4fbe-4757-b0e0-d9d24eaecdce admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:16.225887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b54d42-4fbe-4757-b0e0-d9d24eaecdce admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:16.226573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b54d42-4fbe-4757-b0e0-d9d24eaecdce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:16.228538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b54d42-4fbe-4757-b0e0-d9d24eaecdce admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:16.249699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1159/2290] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:13:16 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:16.253773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20f866-7635-4506-b5c5-13d082bf69e9 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:16.263676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20f866-7635-4506-b5c5-13d082bf69e9 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:16.268657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7daf3-8901-4e12-8bbe-7fd5570af29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:16.269313 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7daf3-8901-4e12-8bbe-7fd5570af29a admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:16.269626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7daf3-8901-4e12-8bbe-7fd5570af29a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:16.269904 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7daf3-8901-4e12-8bbe-7fd5570af29a admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:16.270631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7daf3-8901-4e12-8bbe-7fd5570af29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:16.272246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7daf3-8901-4e12-8bbe-7fd5570af29a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:16.283472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1132/2291] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:16.287345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b54d42-4fbe-4757-b0e0-d9d24eaecdce admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:16.297631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b54d42-4fbe-4757-b0e0-d9d24eaecdce admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:16.302217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4899ef4-47cd-4d60-8bd5-9f46ff9a5314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:16.303078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4899ef4-47cd-4d60-8bd5-9f46ff9a5314 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:16.303353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4899ef4-47cd-4d60-8bd5-9f46ff9a5314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:16.303621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4899ef4-47cd-4d60-8bd5-9f46ff9a5314 admin admin] PATH_INFO: `/v3/projects/24018ce168c64974bf8d81b0872ed975/users/faf7a4632f7a499c96b53dc9f8439876/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:16.318151 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4899ef4-47cd-4d60-8bd5-9f46ff9a5314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24018ce168c64974bf8d81b0872ed975, user_id=faf7a4632f7a499c96b53dc9f8439876, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:16.320833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4899ef4-47cd-4d60-8bd5-9f46ff9a5314 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:16.333622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1160/2292] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:16 2022] PUT /identity/v3/projects/24018ce168c64974bf8d81b0872ed975/users/faf7a4632f7a499c96b53dc9f8439876/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:16.337508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7daf3-8901-4e12-8bbe-7fd5570af29a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:16.347698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7daf3-8901-4e12-8bbe-7fd5570af29a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:16.399860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3816cfd-eb4f-4dbe-8638-99329b89e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:16.400526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3816cfd-eb4f-4dbe-8638-99329b89e5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:16.400804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3816cfd-eb4f-4dbe-8638-99329b89e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:16.401074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3816cfd-eb4f-4dbe-8638-99329b89e5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:16.401787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3816cfd-eb4f-4dbe-8638-99329b89e5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:16.403348 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3816cfd-eb4f-4dbe-8638-99329b89e5f8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:16.413116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1133/2293] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:16.417286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4899ef4-47cd-4d60-8bd5-9f46ff9a5314 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:16.428496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4899ef4-47cd-4d60-8bd5-9f46ff9a5314 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:16.433344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ed7ac-8e55-42ab-abdc-9d3f0bb59d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:16.434214 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ed7ac-8e55-42ab-abdc-9d3f0bb59d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:16.434492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ed7ac-8e55-42ab-abdc-9d3f0bb59d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:16.434760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ed7ac-8e55-42ab-abdc-9d3f0bb59d4c admin admin] PATH_INFO: `/v3/projects/24018ce168c64974bf8d81b0872ed975/users/faf7a4632f7a499c96b53dc9f8439876/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:16.437221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ed7ac-8e55-42ab-abdc-9d3f0bb59d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=24018ce168c64974bf8d81b0872ed975, user_id=faf7a4632f7a499c96b53dc9f8439876, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:16.439815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ed7ac-8e55-42ab-abdc-9d3f0bb59d4c admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:16.451610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1161/2294] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:16 2022] PUT /identity/v3/projects/24018ce168c64974bf8d81b0872ed975/users/faf7a4632f7a499c96b53dc9f8439876/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:16.462758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba846c19-c7a2-4469-b033-f80ae51a8eac None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:16.463052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba846c19-c7a2-4469-b033-f80ae51a8eac None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:16.463349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba846c19-c7a2-4469-b033-f80ae51a8eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:16.491169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-ba846c19-c7a2-4469-b033-f80ae51a8eac None None] MFA Rules not processed for user `faf7a4632f7a499c96b53dc9f8439876`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:16.492532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ba846c19-c7a2-4469-b033-f80ae51a8eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:16.560181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1134/2295] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:16.570718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ed7ac-8e55-42ab-abdc-9d3f0bb59d4c admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:16.572707 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-7c5ed7ac-8e55-42ab-abdc-9d3f0bb59d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:16.628597 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ed7ac-8e55-42ab-abdc-9d3f0bb59d4c admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:16.632262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca49eb-5934-4992-8269-d21dc6dd61f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:16.632906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca49eb-5934-4992-8269-d21dc6dd61f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:16.633180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca49eb-5934-4992-8269-d21dc6dd61f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:16.633450 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca49eb-5934-4992-8269-d21dc6dd61f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:16.688663 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca49eb-5934-4992-8269-d21dc6dd61f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:16.690100 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca49eb-5934-4992-8269-d21dc6dd61f7 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:16.698779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1162/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:13:21.883526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba846c19-c7a2-4469-b033-f80ae51a8eac None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:21.884964 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ba846c19-c7a2-4469-b033-f80ae51a8eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:21.896905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba846c19-c7a2-4469-b033-f80ae51a8eac None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:21.900460 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059dfa0-ac3d-47dd-883a-1bac2f5fe0fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:21.901082 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059dfa0-ac3d-47dd-883a-1bac2f5fe0fc service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:21.901363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059dfa0-ac3d-47dd-883a-1bac2f5fe0fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:21.901634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059dfa0-ac3d-47dd-883a-1bac2f5fe0fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:21.903307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d059dfa0-ac3d-47dd-883a-1bac2f5fe0fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:21.964856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059dfa0-ac3d-47dd-883a-1bac2f5fe0fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:21.966912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059dfa0-ac3d-47dd-883a-1bac2f5fe0fc service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:21.976330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1135/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:13:32.420019 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca49eb-5934-4992-8269-d21dc6dd61f7 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:32.429501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca49eb-5934-4992-8269-d21dc6dd61f7 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:32.433878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1181e1-a49a-4c5f-a35f-7356ad3606bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:32.434592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1181e1-a49a-4c5f-a35f-7356ad3606bc service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:32.434879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1181e1-a49a-4c5f-a35f-7356ad3606bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:32.435153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1181e1-a49a-4c5f-a35f-7356ad3606bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:32.445020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1181e1-a49a-4c5f-a35f-7356ad3606bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:32.446428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1181e1-a49a-4c5f-a35f-7356ad3606bc service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:32.467904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1163/2298] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:13:52.017937 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059dfa0-ac3d-47dd-883a-1bac2f5fe0fc service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:52.132899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059dfa0-ac3d-47dd-883a-1bac2f5fe0fc service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:52.137817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:52.138677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:52.138952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:52.139219 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] PATH_INFO: `/v3/users/99c73e9cee2f40589a8d9dc3807b48b7` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:52.140461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c73e9cee2f40589a8d9dc3807b48b7)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:52.142355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:52.205088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c73e9cee2f40589a8d9dc3807b48b7'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.216006 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c73e9cee2f40589a8d9dc3807b48b7'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.223732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c73e9cee2f40589a8d9dc3807b48b7'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.224455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c73e9cee2f40589a8d9dc3807b48b7'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.225114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c73e9cee2f40589a8d9dc3807b48b7'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.243257 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1136/2299] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:13:52 2022] DELETE /identity/v3/users/99c73e9cee2f40589a8d9dc3807b48b7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:52.247722 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fca1d3-80db-4d59-a008-4b7807888b34 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:52.248194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fca1d3-80db-4d59-a008-4b7807888b34 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:52.248306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fca1d3-80db-4d59-a008-4b7807888b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:52.293184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-72fca1d3-80db-4d59-a008-4b7807888b34 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:52.294364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-72fca1d3-80db-4d59-a008-4b7807888b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:52.351104 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1164/2300] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:52.360694 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:52.362066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:52.455915 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8925b9-bb12-4cbb-ace9-7e1e6d437d69 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:52.459639 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c6c5e-2f59-4c1d-aca3-ad046f55cd3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:52.460306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c6c5e-2f59-4c1d-aca3-ad046f55cd3e service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:52.460584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c6c5e-2f59-4c1d-aca3-ad046f55cd3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:52.460851 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c6c5e-2f59-4c1d-aca3-ad046f55cd3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:52.470018 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c6c5e-2f59-4c1d-aca3-ad046f55cd3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:52.471447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c6c5e-2f59-4c1d-aca3-ad046f55cd3e service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:52.480490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1137/2301] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:13:52.750163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fca1d3-80db-4d59-a008-4b7807888b34 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:52.752252 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-72fca1d3-80db-4d59-a008-4b7807888b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:52.764136 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fca1d3-80db-4d59-a008-4b7807888b34 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:52.769415 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:52.770290 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:52.770598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:52.770875 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] PATH_INFO: `/v3/projects/918fb79e77b44000a3bca1c68d45c1d1` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:52.772138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=918fb79e77b44000a3bca1c68d45c1d1)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:52.773987 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:52.818994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918fb79e77b44000a3bca1c68d45c1d1', 'request_id': 'req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.825984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918fb79e77b44000a3bca1c68d45c1d1', 'request_id': 'req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.832064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918fb79e77b44000a3bca1c68d45c1d1', 'request_id': 'req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.844379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] The token cache is being invalidate because project 918fb79e77b44000a3bca1c68d45c1d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:13:52.844709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.845411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.847137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1165/2302] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:13:52 2022] DELETE /identity/v3/projects/918fb79e77b44000a3bca1c68d45c1d1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:52.851161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c6c5e-2f59-4c1d-aca3-ad046f55cd3e service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:52.860736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c6c5e-2f59-4c1d-aca3-ad046f55cd3e service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:52.916928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9e582-466a-4594-a24c-159706ca9881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:52.917786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e582-466a-4594-a24c-159706ca9881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:52.918064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e582-466a-4594-a24c-159706ca9881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:52.918330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e582-466a-4594-a24c-159706ca9881 admin admin] PATH_INFO: `/v3/users/faf7a4632f7a499c96b53dc9f8439876` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:52.919504 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9e582-466a-4594-a24c-159706ca9881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf7a4632f7a499c96b53dc9f8439876)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:52.921432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9e582-466a-4594-a24c-159706ca9881 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:52.967852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3aa9e582-466a-4594-a24c-159706ca9881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf7a4632f7a499c96b53dc9f8439876'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.974465 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3aa9e582-466a-4594-a24c-159706ca9881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf7a4632f7a499c96b53dc9f8439876'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.981555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3aa9e582-466a-4594-a24c-159706ca9881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf7a4632f7a499c96b53dc9f8439876'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.982250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3aa9e582-466a-4594-a24c-159706ca9881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf7a4632f7a499c96b53dc9f8439876'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:52.982892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3aa9e582-466a-4594-a24c-159706ca9881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf7a4632f7a499c96b53dc9f8439876'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:53.000641 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1138/2303] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:13:52 2022] DELETE /identity/v3/users/faf7a4632f7a499c96b53dc9f8439876 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:53.300006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:53.301496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:53.315751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9237bb4-a6cc-45e2-be79-a6eacd3f7d80 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:53.370889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142cc89-316a-4c9c-bdc6-d62d48cdce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:53.371760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142cc89-316a-4c9c-bdc6-d62d48cdce50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:53.372035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142cc89-316a-4c9c-bdc6-d62d48cdce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:53.372337 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142cc89-316a-4c9c-bdc6-d62d48cdce50 admin admin] PATH_INFO: `/v3/projects/24018ce168c64974bf8d81b0872ed975` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:53.373542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142cc89-316a-4c9c-bdc6-d62d48cdce50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24018ce168c64974bf8d81b0872ed975)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:53.376072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142cc89-316a-4c9c-bdc6-d62d48cdce50 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:53.419451 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7142cc89-316a-4c9c-bdc6-d62d48cdce50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24018ce168c64974bf8d81b0872ed975', 'request_id': 'req-7142cc89-316a-4c9c-bdc6-d62d48cdce50'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:53.429832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7142cc89-316a-4c9c-bdc6-d62d48cdce50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24018ce168c64974bf8d81b0872ed975', 'request_id': 'req-7142cc89-316a-4c9c-bdc6-d62d48cdce50'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:53.436028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7142cc89-316a-4c9c-bdc6-d62d48cdce50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24018ce168c64974bf8d81b0872ed975', 'request_id': 'req-7142cc89-316a-4c9c-bdc6-d62d48cdce50'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:53.447457 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7142cc89-316a-4c9c-bdc6-d62d48cdce50 admin admin] The token cache is being invalidate because project 24018ce168c64974bf8d81b0872ed975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:13:53.447788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7142cc89-316a-4c9c-bdc6-d62d48cdce50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:53.448446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7142cc89-316a-4c9c-bdc6-d62d48cdce50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:13:53.450031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1166/2304] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:13:53 2022] DELETE /identity/v3/projects/24018ce168c64974bf8d81b0872ed975 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:53.455955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cb5f6-8799-4bc5-9a99-dc6362b7f568 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:53.456432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cb5f6-8799-4bc5-9a99-dc6362b7f568 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:53.456600 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cb5f6-8799-4bc5-9a99-dc6362b7f568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:53.505211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-858cb5f6-8799-4bc5-9a99-dc6362b7f568 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:53.506577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-858cb5f6-8799-4bc5-9a99-dc6362b7f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:53.562820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1139/2305] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:13:53.571393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6205e08-b588-4f9d-a704-205866f6944c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:53.571684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6205e08-b588-4f9d-a704-205866f6944c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:53.571951 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6205e08-b588-4f9d-a704-205866f6944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:53.591000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e6205e08-b588-4f9d-a704-205866f6944c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:53.592244 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e6205e08-b588-4f9d-a704-205866f6944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:53.600851 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1167/2306] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:53.605261 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cb5f6-8799-4bc5-9a99-dc6362b7f568 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:53.615749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cb5f6-8799-4bc5-9a99-dc6362b7f568 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:53.620448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5231f78-e776-4332-aa0d-27f50e492058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:53.621096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5231f78-e776-4332-aa0d-27f50e492058 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:53.621409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5231f78-e776-4332-aa0d-27f50e492058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:53.621684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5231f78-e776-4332-aa0d-27f50e492058 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:53.622404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5231f78-e776-4332-aa0d-27f50e492058 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:13:53.622739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5231f78-e776-4332-aa0d-27f50e492058 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:53.624891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5231f78-e776-4332-aa0d-27f50e492058 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:53.635980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1140/2307] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:13:53.641010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6205e08-b588-4f9d-a704-205866f6944c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:53.650140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6205e08-b588-4f9d-a704-205866f6944c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:53.654735 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4b9fe-e460-4dc4-9ef2-958a2a7acec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:53.655369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4b9fe-e460-4dc4-9ef2-958a2a7acec8 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:53.655654 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4b9fe-e460-4dc4-9ef2-958a2a7acec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:53.655926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4b9fe-e460-4dc4-9ef2-958a2a7acec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:53.656635 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4b9fe-e460-4dc4-9ef2-958a2a7acec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:53.658506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4b9fe-e460-4dc4-9ef2-958a2a7acec8 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:53.682666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1168/2308] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:13:53 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:53.687239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5231f78-e776-4332-aa0d-27f50e492058 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:53.697956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5231f78-e776-4332-aa0d-27f50e492058 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:53.755656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d5e5-3226-48e0-8cc0-fed9e55f3201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:53.756342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d5e5-3226-48e0-8cc0-fed9e55f3201 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:53.756622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d5e5-3226-48e0-8cc0-fed9e55f3201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:53.756892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d5e5-3226-48e0-8cc0-fed9e55f3201 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:53.757568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76d5e5-3226-48e0-8cc0-fed9e55f3201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:53.759517 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76d5e5-3226-48e0-8cc0-fed9e55f3201 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:53.778675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1141/2309] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:13:53 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:13:53.783140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4b9fe-e460-4dc4-9ef2-958a2a7acec8 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:53.793616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4b9fe-e460-4dc4-9ef2-958a2a7acec8 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:53.798321 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362daa34-cc85-422b-b4b1-2aa8023f7232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:53.798978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362daa34-cc85-422b-b4b1-2aa8023f7232 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:53.799260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362daa34-cc85-422b-b4b1-2aa8023f7232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:53.799535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362daa34-cc85-422b-b4b1-2aa8023f7232 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:53.800330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362daa34-cc85-422b-b4b1-2aa8023f7232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:53.801907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362daa34-cc85-422b-b4b1-2aa8023f7232 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:53.814036 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1169/2310] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:53.817989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d5e5-3226-48e0-8cc0-fed9e55f3201 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:53.828543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d5e5-3226-48e0-8cc0-fed9e55f3201 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:53.833107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a16850-06ea-4ac6-aa6d-ae6b42531d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:53.833745 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a16850-06ea-4ac6-aa6d-ae6b42531d14 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:53.834022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a16850-06ea-4ac6-aa6d-ae6b42531d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:53.834296 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a16850-06ea-4ac6-aa6d-ae6b42531d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:53.835005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a16850-06ea-4ac6-aa6d-ae6b42531d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:53.836861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a16850-06ea-4ac6-aa6d-ae6b42531d14 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:53.847575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1142/2311] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:13:53.851706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362daa34-cc85-422b-b4b1-2aa8023f7232 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:53.862760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362daa34-cc85-422b-b4b1-2aa8023f7232 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:53.867431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c0468-7753-4acc-8908-ec934f7deca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:53.868342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c0468-7753-4acc-8908-ec934f7deca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:53.868627 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c0468-7753-4acc-8908-ec934f7deca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:53.868901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c0468-7753-4acc-8908-ec934f7deca3 admin admin] PATH_INFO: `/v3/projects/3c438898ecc344d0be2da18a183ea2c9/users/325a911940cd42cd878dbd849b7d8dab/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:53.883785 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c0468-7753-4acc-8908-ec934f7deca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c438898ecc344d0be2da18a183ea2c9, user_id=325a911940cd42cd878dbd849b7d8dab, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:53.886443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c0468-7753-4acc-8908-ec934f7deca3 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:53.902812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1170/2312] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:13:53 2022] PUT /identity/v3/projects/3c438898ecc344d0be2da18a183ea2c9/users/325a911940cd42cd878dbd849b7d8dab/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:13:53.914051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b4cf9-0922-468f-a275-6377dab1a86c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:53.914340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b4cf9-0922-468f-a275-6377dab1a86c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:53.914619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b4cf9-0922-468f-a275-6377dab1a86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:53.943838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-703b4cf9-0922-468f-a275-6377dab1a86c None None] MFA Rules not processed for user `325a911940cd42cd878dbd849b7d8dab`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:13:53.945052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-703b4cf9-0922-468f-a275-6377dab1a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:54.010660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1143/2313] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:13:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:13:54.021422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c0468-7753-4acc-8908-ec934f7deca3 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:13:54.023058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-799c0468-7753-4acc-8908-ec934f7deca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:13:54.081645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c0468-7753-4acc-8908-ec934f7deca3 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:13:54.085302 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde10e0-b83b-44e2-bee3-b044f00a1ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:13:54.085937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde10e0-b83b-44e2-bee3-b044f00a1ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:13:54.086219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde10e0-b83b-44e2-bee3-b044f00a1ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:13:54.086490 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde10e0-b83b-44e2-bee3-b044f00a1ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:13:54.094857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde10e0-b83b-44e2-bee3-b044f00a1ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:13:54.096387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde10e0-b83b-44e2-bee3-b044f00a1ff7 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:13:54.105287 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1171/2314] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:13:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:13.459216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b4cf9-0922-468f-a275-6377dab1a86c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:13.460723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-703b4cf9-0922-468f-a275-6377dab1a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:13.530834 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b4cf9-0922-468f-a275-6377dab1a86c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:13.535820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:13.536718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:13.536997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:13.537275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] PATH_INFO: `/v3/users/6a5286f324eb41a4a994ad4a120b713e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:13.538451 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5286f324eb41a4a994ad4a120b713e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:13.540369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:13.592513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5286f324eb41a4a994ad4a120b713e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:13.600391 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5286f324eb41a4a994ad4a120b713e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:13.610355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5286f324eb41a4a994ad4a120b713e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:13.611149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5286f324eb41a4a994ad4a120b713e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:13.612012 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5286f324eb41a4a994ad4a120b713e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:13.631817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1144/2315] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:13 2022] DELETE /identity/v3/users/6a5286f324eb41a4a994ad4a120b713e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:13.636295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344b989-1fae-42fe-a520-482e576ec0c4 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:13.636810 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344b989-1fae-42fe-a520-482e576ec0c4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:13.636907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344b989-1fae-42fe-a520-482e576ec0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:13.654389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-a344b989-1fae-42fe-a520-482e576ec0c4 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:13.655589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a344b989-1fae-42fe-a520-482e576ec0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:13.717902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1172/2316] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:13.728009 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:13.729478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:13.786899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac55fb-8afe-478d-9f72-b230c0fda527 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:13.790518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2934271-5c76-48e3-bb64-9ef42a4438fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:13.791150 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2934271-5c76-48e3-bb64-9ef42a4438fa service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:13.791430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2934271-5c76-48e3-bb64-9ef42a4438fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:13.791702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2934271-5c76-48e3-bb64-9ef42a4438fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:13.801246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2934271-5c76-48e3-bb64-9ef42a4438fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:13.802816 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2934271-5c76-48e3-bb64-9ef42a4438fa service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:13.815161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1145/2317] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:14.084552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344b989-1fae-42fe-a520-482e576ec0c4 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:14.085935 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a344b989-1fae-42fe-a520-482e576ec0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:14.108661 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344b989-1fae-42fe-a520-482e576ec0c4 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:14.125269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:14.127705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:14.129374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:14.129885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] PATH_INFO: `/v3/projects/2755b44a34e84685a5731e4759104b44` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:14.131326 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2755b44a34e84685a5731e4759104b44)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:14.133282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:14.182896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2755b44a34e84685a5731e4759104b44', 'request_id': 'req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.190213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2755b44a34e84685a5731e4759104b44', 'request_id': 'req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.196287 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2755b44a34e84685a5731e4759104b44', 'request_id': 'req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.208300 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] The token cache is being invalidate because project 2755b44a34e84685a5731e4759104b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:14.208660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.209517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.211172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1173/2318] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:14 2022] DELETE /identity/v3/projects/2755b44a34e84685a5731e4759104b44 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:14.215322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2934271-5c76-48e3-bb64-9ef42a4438fa service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:14.226649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2934271-5c76-48e3-bb64-9ef42a4438fa service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:14.282856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e91a8-fa6e-45ff-9a4f-696ed0040c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:14.283883 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e91a8-fa6e-45ff-9a4f-696ed0040c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:14.284198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e91a8-fa6e-45ff-9a4f-696ed0040c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:14.284473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e91a8-fa6e-45ff-9a4f-696ed0040c67 admin admin] PATH_INFO: `/v3/users/3f64b3fee9874c37b1aa33b317cab22d` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:14.285666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e91a8-fa6e-45ff-9a4f-696ed0040c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f64b3fee9874c37b1aa33b317cab22d)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:14.287556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e91a8-fa6e-45ff-9a4f-696ed0040c67 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:14.332384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f04e91a8-fa6e-45ff-9a4f-696ed0040c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f64b3fee9874c37b1aa33b317cab22d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.340144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f04e91a8-fa6e-45ff-9a4f-696ed0040c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f64b3fee9874c37b1aa33b317cab22d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.347884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f04e91a8-fa6e-45ff-9a4f-696ed0040c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f64b3fee9874c37b1aa33b317cab22d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.348571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f04e91a8-fa6e-45ff-9a4f-696ed0040c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f64b3fee9874c37b1aa33b317cab22d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.349163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f04e91a8-fa6e-45ff-9a4f-696ed0040c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f64b3fee9874c37b1aa33b317cab22d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.365862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1146/2319] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:14 2022] DELETE /identity/v3/users/3f64b3fee9874c37b1aa33b317cab22d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:14.640762 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:14.642265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:14.657028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60b9e6-0c57-4bc1-bb9a-1ed705a5da0d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:14.714734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7f091-5489-4e0d-b827-0f749d3588ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:14.715589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7f091-5489-4e0d-b827-0f749d3588ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:14.715868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7f091-5489-4e0d-b827-0f749d3588ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:14.716168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7f091-5489-4e0d-b827-0f749d3588ec admin admin] PATH_INFO: `/v3/projects/03f46dbd2efd4e408d0cb9ccd21430c3` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:14.717344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7f091-5489-4e0d-b827-0f749d3588ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f46dbd2efd4e408d0cb9ccd21430c3)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:14.719249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7f091-5489-4e0d-b827-0f749d3588ec admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:14.764168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-93d7f091-5489-4e0d-b827-0f749d3588ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f46dbd2efd4e408d0cb9ccd21430c3', 'request_id': 'req-93d7f091-5489-4e0d-b827-0f749d3588ec'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.772576 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-93d7f091-5489-4e0d-b827-0f749d3588ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f46dbd2efd4e408d0cb9ccd21430c3', 'request_id': 'req-93d7f091-5489-4e0d-b827-0f749d3588ec'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.781855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-93d7f091-5489-4e0d-b827-0f749d3588ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f46dbd2efd4e408d0cb9ccd21430c3', 'request_id': 'req-93d7f091-5489-4e0d-b827-0f749d3588ec'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.792345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-93d7f091-5489-4e0d-b827-0f749d3588ec admin admin] The token cache is being invalidate because project 03f46dbd2efd4e408d0cb9ccd21430c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:14.792630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-93d7f091-5489-4e0d-b827-0f749d3588ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.793285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-93d7f091-5489-4e0d-b827-0f749d3588ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.794817 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1174/2320] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:14 2022] DELETE /identity/v3/projects/03f46dbd2efd4e408d0cb9ccd21430c3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:14.799852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d98b70-5ea7-4582-921d-408b10caa3be None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:14.800371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d98b70-5ea7-4582-921d-408b10caa3be None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:14.800485 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d98b70-5ea7-4582-921d-408b10caa3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:14.818346 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-56d98b70-5ea7-4582-921d-408b10caa3be None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:14.819534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-56d98b70-5ea7-4582-921d-408b10caa3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:14.880128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1147/2321] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:14.888818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0b09a-d62e-430f-8372-340679f72467 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:14.889160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0b09a-d62e-430f-8372-340679f72467 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:14.889441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0b09a-d62e-430f-8372-340679f72467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:14.901479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d98b70-5ea7-4582-921d-408b10caa3be None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:14.902904 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-56d98b70-5ea7-4582-921d-408b10caa3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:14.911212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-70e0b09a-d62e-430f-8372-340679f72467 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:14.912525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-70e0b09a-d62e-430f-8372-340679f72467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:14.916180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d98b70-5ea7-4582-921d-408b10caa3be None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:14.920575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1175/2322] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:14.921325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7962f0-935a-498f-bb89-1231f436825d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:14.922263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7962f0-935a-498f-bb89-1231f436825d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:14.922908 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7962f0-935a-498f-bb89-1231f436825d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:14.922908 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7962f0-935a-498f-bb89-1231f436825d admin admin] PATH_INFO: `/v3/users/325a911940cd42cd878dbd849b7d8dab` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:14.924331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7962f0-935a-498f-bb89-1231f436825d admin admin] RBAC: Authorizing `identity:delete_user(user_id=325a911940cd42cd878dbd849b7d8dab)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:14.924781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0b09a-d62e-430f-8372-340679f72467 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:14.926384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7962f0-935a-498f-bb89-1231f436825d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:14.933992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0b09a-d62e-430f-8372-340679f72467 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:14.938819 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613571cd-efed-47ae-ae28-9582cd4849de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:14.939464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613571cd-efed-47ae-ae28-9582cd4849de admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:14.939765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613571cd-efed-47ae-ae28-9582cd4849de admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:14.940018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613571cd-efed-47ae-ae28-9582cd4849de admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:14.940893 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613571cd-efed-47ae-ae28-9582cd4849de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:14:14.941203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613571cd-efed-47ae-ae28-9582cd4849de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:14.942782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613571cd-efed-47ae-ae28-9582cd4849de admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:14.956130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1176/2323] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:14:14.960568 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613571cd-efed-47ae-ae28-9582cd4849de admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:14.971768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613571cd-efed-47ae-ae28-9582cd4849de admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:14.976939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794d90c-4941-4572-a31c-a05289f497fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:14.977901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794d90c-4941-4572-a31c-a05289f497fa admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:14.978030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794d90c-4941-4572-a31c-a05289f497fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:14.978335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794d90c-4941-4572-a31c-a05289f497fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:14.979076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794d90c-4941-4572-a31c-a05289f497fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:14.979463 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fa7962f0-935a-498f-bb89-1231f436825d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325a911940cd42cd878dbd849b7d8dab'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.981054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794d90c-4941-4572-a31c-a05289f497fa admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:14.986940 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fa7962f0-935a-498f-bb89-1231f436825d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325a911940cd42cd878dbd849b7d8dab'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.993740 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fa7962f0-935a-498f-bb89-1231f436825d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325a911940cd42cd878dbd849b7d8dab'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.994380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fa7962f0-935a-498f-bb89-1231f436825d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325a911940cd42cd878dbd849b7d8dab'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:14.994999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fa7962f0-935a-498f-bb89-1231f436825d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325a911940cd42cd878dbd849b7d8dab'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:15.010281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1177/2324] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:14:14 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:14:15.011596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794d90c-4941-4572-a31c-a05289f497fa admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.011889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1148/2325] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:14 2022] DELETE /identity/v3/users/325a911940cd42cd878dbd849b7d8dab => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:14:15.013256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0794d90c-4941-4572-a31c-a05289f497fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:15.018057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522cae-65d2-4afb-bbfd-835da00ad447 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.018352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522cae-65d2-4afb-bbfd-835da00ad447 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.018899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522cae-65d2-4afb-bbfd-835da00ad447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.040109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-63522cae-65d2-4afb-bbfd-835da00ad447 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:15.040109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-63522cae-65d2-4afb-bbfd-835da00ad447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:15.084853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794d90c-4941-4572-a31c-a05289f497fa admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.101484 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1149/2326] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:15.111025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63522cae-65d2-4afb-bbfd-835da00ad447 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.113105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-63522cae-65d2-4afb-bbfd-835da00ad447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:15.142325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650c93b-09b2-4ed9-b7f9-1944f2cd2223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.143031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650c93b-09b2-4ed9-b7f9-1944f2cd2223 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.143383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650c93b-09b2-4ed9-b7f9-1944f2cd2223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.143664 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650c93b-09b2-4ed9-b7f9-1944f2cd2223 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.144380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650c93b-09b2-4ed9-b7f9-1944f2cd2223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.146291 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650c93b-09b2-4ed9-b7f9-1944f2cd2223 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.166632 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1178/2327] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:14:15 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:15.167948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63522cae-65d2-4afb-bbfd-835da00ad447 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.170785 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650c93b-09b2-4ed9-b7f9-1944f2cd2223 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.172006 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5bc6-5ecb-496a-9220-972a8bb9e846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.172672 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5bc6-5ecb-496a-9220-972a8bb9e846 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.172955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5bc6-5ecb-496a-9220-972a8bb9e846 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.173230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5bc6-5ecb-496a-9220-972a8bb9e846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.181376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650c93b-09b2-4ed9-b7f9-1944f2cd2223 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.183486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d5bc6-5ecb-496a-9220-972a8bb9e846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.185054 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d5bc6-5ecb-496a-9220-972a8bb9e846 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.190040 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e44f4a-11ce-439e-9e41-540a5479d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.190884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e44f4a-11ce-439e-9e41-540a5479d179 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.191485 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e44f4a-11ce-439e-9e41-540a5479d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.191973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e44f4a-11ce-439e-9e41-540a5479d179 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.193469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e44f4a-11ce-439e-9e41-540a5479d179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.195480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e44f4a-11ce-439e-9e41-540a5479d179 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.196115 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1150/2328] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:14:15.214057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1179/2329] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:14:15.215212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5bc6-5ecb-496a-9220-972a8bb9e846 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.226574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5bc6-5ecb-496a-9220-972a8bb9e846 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.237171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fa837-8426-461f-8ade-4783d02fea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.237925 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa837-8426-461f-8ade-4783d02fea51 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.238279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa837-8426-461f-8ade-4783d02fea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.238773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa837-8426-461f-8ade-4783d02fea51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.239567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fa837-8426-461f-8ade-4783d02fea51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.241339 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fa837-8426-461f-8ade-4783d02fea51 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.257890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1151/2330] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:14:15.258899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e44f4a-11ce-439e-9e41-540a5479d179 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.276734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e44f4a-11ce-439e-9e41-540a5479d179 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.282165 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc625cdd-77c2-4cbb-b9e3-75050c31d23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.283809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc625cdd-77c2-4cbb-b9e3-75050c31d23e admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.284244 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc625cdd-77c2-4cbb-b9e3-75050c31d23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.284547 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc625cdd-77c2-4cbb-b9e3-75050c31d23e admin admin] PATH_INFO: `/v3/projects/6212eedb93ad4dac9c425049d9bbb9fa/users/bcb4008188fe4d51b1fc907f2874e121/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.301556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc625cdd-77c2-4cbb-b9e3-75050c31d23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6212eedb93ad4dac9c425049d9bbb9fa, user_id=bcb4008188fe4d51b1fc907f2874e121, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.304306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc625cdd-77c2-4cbb-b9e3-75050c31d23e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.318128 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1180/2331] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:15 2022] PUT /identity/v3/projects/6212eedb93ad4dac9c425049d9bbb9fa/users/bcb4008188fe4d51b1fc907f2874e121/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:15.327888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f54f5-5eb6-4f14-881f-ae5280716f4a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.328203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f54f5-5eb6-4f14-881f-ae5280716f4a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.328547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f54f5-5eb6-4f14-881f-ae5280716f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.356680 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-487f54f5-5eb6-4f14-881f-ae5280716f4a None None] MFA Rules not processed for user `bcb4008188fe4d51b1fc907f2874e121`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:15.357874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-487f54f5-5eb6-4f14-881f-ae5280716f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:15.447794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1152/2332] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:15.452390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc625cdd-77c2-4cbb-b9e3-75050c31d23e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.519716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc625cdd-77c2-4cbb-b9e3-75050c31d23e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.524761 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec623b8b-b07c-4cc2-ac3a-aef60d5bd8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.525408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec623b8b-b07c-4cc2-ac3a-aef60d5bd8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.525685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec623b8b-b07c-4cc2-ac3a-aef60d5bd8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.525954 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec623b8b-b07c-4cc2-ac3a-aef60d5bd8f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.526643 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec623b8b-b07c-4cc2-ac3a-aef60d5bd8f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.528679 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec623b8b-b07c-4cc2-ac3a-aef60d5bd8f9 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.553506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f54f5-5eb6-4f14-881f-ae5280716f4a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.555219 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-487f54f5-5eb6-4f14-881f-ae5280716f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:15.558759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1181/2333] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:14:15 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:15.559589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec623b8b-b07c-4cc2-ac3a-aef60d5bd8f9 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.569820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f54f5-5eb6-4f14-881f-ae5280716f4a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.625183 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec623b8b-b07c-4cc2-ac3a-aef60d5bd8f9 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.630418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708c3a8-a4fd-48c8-bd19-d24457e299c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.631075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708c3a8-a4fd-48c8-bd19-d24457e299c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.631357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708c3a8-a4fd-48c8-bd19-d24457e299c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.631468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c6815-6b95-4259-afb4-d8918ec46193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.631633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708c3a8-a4fd-48c8-bd19-d24457e299c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.632359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708c3a8-a4fd-48c8-bd19-d24457e299c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.632487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c6815-6b95-4259-afb4-d8918ec46193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.632657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c6815-6b95-4259-afb4-d8918ec46193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.632927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c6815-6b95-4259-afb4-d8918ec46193 admin admin] PATH_INFO: `/v3/projects/3c438898ecc344d0be2da18a183ea2c9` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.634095 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c6815-6b95-4259-afb4-d8918ec46193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c438898ecc344d0be2da18a183ea2c9)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.634263 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708c3a8-a4fd-48c8-bd19-d24457e299c0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.635964 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c6815-6b95-4259-afb4-d8918ec46193 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.654555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1182/2334] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:14:15 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:14:15.658387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708c3a8-a4fd-48c8-bd19-d24457e299c0 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.668401 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708c3a8-a4fd-48c8-bd19-d24457e299c0 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.673063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84743c74-4169-43be-9d3b-f72dad728917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.674355 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84743c74-4169-43be-9d3b-f72dad728917 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.674635 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84743c74-4169-43be-9d3b-f72dad728917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.674902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84743c74-4169-43be-9d3b-f72dad728917 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.675613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84743c74-4169-43be-9d3b-f72dad728917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.677198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84743c74-4169-43be-9d3b-f72dad728917 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.682506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-9a3c6815-6b95-4259-afb4-d8918ec46193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c438898ecc344d0be2da18a183ea2c9', 'request_id': 'req-9a3c6815-6b95-4259-afb4-d8918ec46193'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:15.687563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1183/2335] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:14:15.691526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-9a3c6815-6b95-4259-afb4-d8918ec46193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c438898ecc344d0be2da18a183ea2c9', 'request_id': 'req-9a3c6815-6b95-4259-afb4-d8918ec46193'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:15.692465 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84743c74-4169-43be-9d3b-f72dad728917 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.695398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-9a3c6815-6b95-4259-afb4-d8918ec46193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c438898ecc344d0be2da18a183ea2c9', 'request_id': 'req-9a3c6815-6b95-4259-afb4-d8918ec46193'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:15.702567 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84743c74-4169-43be-9d3b-f72dad728917 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.706842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-9a3c6815-6b95-4259-afb4-d8918ec46193 admin admin] The token cache is being invalidate because project 3c438898ecc344d0be2da18a183ea2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:15.707193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-9a3c6815-6b95-4259-afb4-d8918ec46193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:15.707837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-9a3c6815-6b95-4259-afb4-d8918ec46193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:15.709394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1153/2336] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:15 2022] DELETE /identity/v3/projects/3c438898ecc344d0be2da18a183ea2c9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:14:15.714112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c78f6-3f9a-46b5-a4c9-ccaa2251c562 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.714466 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c78f6-3f9a-46b5-a4c9-ccaa2251c562 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.714864 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c78f6-3f9a-46b5-a4c9-ccaa2251c562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.732106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-aa3c78f6-3f9a-46b5-a4c9-ccaa2251c562 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:15.733385 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-aa3c78f6-3f9a-46b5-a4c9-ccaa2251c562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:15.757800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c4c94-d3f5-4f22-9e44-43b5834bcdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.758680 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c4c94-d3f5-4f22-9e44-43b5834bcdb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.758964 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c4c94-d3f5-4f22-9e44-43b5834bcdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.759242 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c4c94-d3f5-4f22-9e44-43b5834bcdb1 admin admin] PATH_INFO: `/v3/projects/e277afbc0b1540a197f47cc54515da48/users/93c8aff53c824f34848e60f2f593a320/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.772872 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c4c94-d3f5-4f22-9e44-43b5834bcdb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e277afbc0b1540a197f47cc54515da48, user_id=93c8aff53c824f34848e60f2f593a320, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.775546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c4c94-d3f5-4f22-9e44-43b5834bcdb1 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.787816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1184/2337] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:15 2022] PUT /identity/v3/projects/e277afbc0b1540a197f47cc54515da48/users/93c8aff53c824f34848e60f2f593a320/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:15.790148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1154/2338] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:14:15.791651 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c4c94-d3f5-4f22-9e44-43b5834bcdb1 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.793303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-598c4c94-d3f5-4f22-9e44-43b5834bcdb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:15.797472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43404d1e-8b22-434e-ad2e-74aff0effcd5 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.797764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43404d1e-8b22-434e-ad2e-74aff0effcd5 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.798063 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43404d1e-8b22-434e-ad2e-74aff0effcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.817123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-43404d1e-8b22-434e-ad2e-74aff0effcd5 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:15.818307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-43404d1e-8b22-434e-ad2e-74aff0effcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:15.859219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c4c94-d3f5-4f22-9e44-43b5834bcdb1 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.863908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0c6c8-77f8-4134-b2a0-230c47f10fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.864608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0c6c8-77f8-4134-b2a0-230c47f10fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.864892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0c6c8-77f8-4134-b2a0-230c47f10fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.865166 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0c6c8-77f8-4134-b2a0-230c47f10fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.865894 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0c6c8-77f8-4134-b2a0-230c47f10fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.867483 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0c6c8-77f8-4134-b2a0-230c47f10fcd admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.879890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1155/2339] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:15.880182 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1185/2340] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:14:15.881992 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43404d1e-8b22-434e-ad2e-74aff0effcd5 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.882613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0c6c8-77f8-4134-b2a0-230c47f10fcd admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.891086 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43404d1e-8b22-434e-ad2e-74aff0effcd5 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.892207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0c6c8-77f8-4134-b2a0-230c47f10fcd admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.896373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6de1-230d-4599-b504-9f1ca718d199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.897096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6de1-230d-4599-b504-9f1ca718d199 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.897307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a77479-3fde-447d-bb83-0ece75ec532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.897428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6de1-230d-4599-b504-9f1ca718d199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.897628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6de1-230d-4599-b504-9f1ca718d199 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.898279 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a77479-3fde-447d-bb83-0ece75ec532c admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.898387 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6de1-230d-4599-b504-9f1ca718d199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:14:15.898562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a77479-3fde-447d-bb83-0ece75ec532c admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.898665 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6de1-230d-4599-b504-9f1ca718d199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.898832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a77479-3fde-447d-bb83-0ece75ec532c admin admin] PATH_INFO: `/v3/projects/e277afbc0b1540a197f47cc54515da48/users/93c8aff53c824f34848e60f2f593a320/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.900218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6de1-230d-4599-b504-9f1ca718d199 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.900802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a77479-3fde-447d-bb83-0ece75ec532c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e277afbc0b1540a197f47cc54515da48, user_id=93c8aff53c824f34848e60f2f593a320, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.903386 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a77479-3fde-447d-bb83-0ece75ec532c admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:15.911603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1156/2341] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:14:15.913283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1186/2342] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:15 2022] PUT /identity/v3/projects/e277afbc0b1540a197f47cc54515da48/users/93c8aff53c824f34848e60f2f593a320/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:14:15.921885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6de1-230d-4599-b504-9f1ca718d199 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:15.923433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd70f2-3f38-4837-82db-dea7b8991765 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.923758 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd70f2-3f38-4837-82db-dea7b8991765 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.924042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd70f2-3f38-4837-82db-dea7b8991765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.925147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6de1-230d-4599-b504-9f1ca718d199 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:15.952031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-edbd70f2-3f38-4837-82db-dea7b8991765 None None] MFA Rules not processed for user `93c8aff53c824f34848e60f2f593a320`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:15.953485 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-edbd70f2-3f38-4837-82db-dea7b8991765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:15.985182 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fe802-9a32-43f8-9473-89c8a4bd254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:15.985845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fe802-9a32-43f8-9473-89c8a4bd254d admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:15.986375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fe802-9a32-43f8-9473-89c8a4bd254d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:15.986375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fe802-9a32-43f8-9473-89c8a4bd254d admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:15.987091 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fe802-9a32-43f8-9473-89c8a4bd254d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:15.989036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fe802-9a32-43f8-9473-89c8a4bd254d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:16.018939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1157/2343] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:14:15 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:16.023104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fe802-9a32-43f8-9473-89c8a4bd254d admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:16.040720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1187/2344] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:15 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:14:16.048201 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd70f2-3f38-4837-82db-dea7b8991765 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:16.049612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-edbd70f2-3f38-4837-82db-dea7b8991765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:16.102715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fe802-9a32-43f8-9473-89c8a4bd254d admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:16.107742 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56230b9f-a6af-43f9-ac05-aba9b13d7882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:16.108437 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56230b9f-a6af-43f9-ac05-aba9b13d7882 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:16.108713 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56230b9f-a6af-43f9-ac05-aba9b13d7882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:16.108987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56230b9f-a6af-43f9-ac05-aba9b13d7882 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:16.109755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56230b9f-a6af-43f9-ac05-aba9b13d7882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:16.112209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56230b9f-a6af-43f9-ac05-aba9b13d7882 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:16.136197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1158/2345] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:14:16 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:14:16.137503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56230b9f-a6af-43f9-ac05-aba9b13d7882 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:16.147220 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56230b9f-a6af-43f9-ac05-aba9b13d7882 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:16.148206 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd70f2-3f38-4837-82db-dea7b8991765 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:16.151821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7727a-5b1f-43cc-99f6-1aa62b03f2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:16.152492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7727a-5b1f-43cc-99f6-1aa62b03f2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:16.152772 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7727a-5b1f-43cc-99f6-1aa62b03f2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:16.153045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7727a-5b1f-43cc-99f6-1aa62b03f2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:16.153766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7727a-5b1f-43cc-99f6-1aa62b03f2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:16.155334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7727a-5b1f-43cc-99f6-1aa62b03f2e6 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:16.165640 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1159/2346] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:14:16.169338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7727a-5b1f-43cc-99f6-1aa62b03f2e6 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:16.179119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7727a-5b1f-43cc-99f6-1aa62b03f2e6 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:16.183976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84956f-6f92-46c6-addb-3bf290cae9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:16.184617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84956f-6f92-46c6-addb-3bf290cae9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:16.184894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84956f-6f92-46c6-addb-3bf290cae9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:16.185161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84956f-6f92-46c6-addb-3bf290cae9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:16.185853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84956f-6f92-46c6-addb-3bf290cae9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:16.187511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84956f-6f92-46c6-addb-3bf290cae9b6 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:16.195790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aff4ea-998a-43cb-b22a-010484c6e755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:16.196466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aff4ea-998a-43cb-b22a-010484c6e755 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:16.196748 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aff4ea-998a-43cb-b22a-010484c6e755 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:16.200256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1160/2347] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:14:16.200399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aff4ea-998a-43cb-b22a-010484c6e755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:16.201175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84956f-6f92-46c6-addb-3bf290cae9b6 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:16.214803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84956f-6f92-46c6-addb-3bf290cae9b6 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:16.219432 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477a563-602b-48ed-abd0-3fde92383c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:16.220966 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477a563-602b-48ed-abd0-3fde92383c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:16.221233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477a563-602b-48ed-abd0-3fde92383c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:16.221741 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477a563-602b-48ed-abd0-3fde92383c8e admin admin] PATH_INFO: `/v3/projects/8d76fe98c8fa41c0a11bceee702e156c/users/620d9d4b6c274621bd9f93c6a5423cb3/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:16.241288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477a563-602b-48ed-abd0-3fde92383c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d76fe98c8fa41c0a11bceee702e156c, user_id=620d9d4b6c274621bd9f93c6a5423cb3, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:16.244165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477a563-602b-48ed-abd0-3fde92383c8e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:16.259424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aff4ea-998a-43cb-b22a-010484c6e755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:16.260367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1161/2348] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:16 2022] PUT /identity/v3/projects/8d76fe98c8fa41c0a11bceee702e156c/users/620d9d4b6c274621bd9f93c6a5423cb3/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:16.260876 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aff4ea-998a-43cb-b22a-010484c6e755 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:16.270971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764820e-d148-4221-a5c4-43df6a9066f2 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:16.271124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1188/2349] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:16 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:14:16.271256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764820e-d148-4221-a5c4-43df6a9066f2 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:16.271523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764820e-d148-4221-a5c4-43df6a9066f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:16.298430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0764820e-d148-4221-a5c4-43df6a9066f2 None None] MFA Rules not processed for user `620d9d4b6c274621bd9f93c6a5423cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:16.299845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0764820e-d148-4221-a5c4-43df6a9066f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:16.313443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aff4ea-998a-43cb-b22a-010484c6e755 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:16.314873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-66aff4ea-998a-43cb-b22a-010484c6e755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:16.325556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aff4ea-998a-43cb-b22a-010484c6e755 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:16.363990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1162/2350] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:14:16.374899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764820e-d148-4221-a5c4-43df6a9066f2 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:16.377403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb98b2b-1753-455d-a83d-c25679a42a62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:16.378045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb98b2b-1753-455d-a83d-c25679a42a62 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:16.378323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb98b2b-1753-455d-a83d-c25679a42a62 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:16.378594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb98b2b-1753-455d-a83d-c25679a42a62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:16.380400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-fdb98b2b-1753-455d-a83d-c25679a42a62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:16.384424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764820e-d148-4221-a5c4-43df6a9066f2 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:16.388288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c107e-81d5-4b8b-a8f4-276c6fccd87c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:16.388904 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c107e-81d5-4b8b-a8f4-276c6fccd87c service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:16.389184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c107e-81d5-4b8b-a8f4-276c6fccd87c service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:16.389473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c107e-81d5-4b8b-a8f4-276c6fccd87c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:16.398230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c107e-81d5-4b8b-a8f4-276c6fccd87c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:16.399657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c107e-81d5-4b8b-a8f4-276c6fccd87c service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:16.408958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1163/2351] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:14:16.439259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb98b2b-1753-455d-a83d-c25679a42a62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:16.440758 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb98b2b-1753-455d-a83d-c25679a42a62 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:16.449540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1189/2352] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:14:19.736583 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c107e-81d5-4b8b-a8f4-276c6fccd87c service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:19.797200 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c107e-81d5-4b8b-a8f4-276c6fccd87c service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:19.802319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:19.803057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:19.803335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:19.803606 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] PATH_INFO: `/v3/users/bcb4008188fe4d51b1fc907f2874e121` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:19.805059 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb4008188fe4d51b1fc907f2874e121)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:19.806971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:19.856913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb4008188fe4d51b1fc907f2874e121'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:19.865635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb4008188fe4d51b1fc907f2874e121'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:19.872507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb4008188fe4d51b1fc907f2874e121'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:19.873145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb4008188fe4d51b1fc907f2874e121'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:19.873757 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb4008188fe4d51b1fc907f2874e121'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:19.891231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1164/2353] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:19 2022] DELETE /identity/v3/users/bcb4008188fe4d51b1fc907f2874e121 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:19.895907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e1191-bed9-4909-9e1d-22dbadbe8b23 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:19.896407 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e1191-bed9-4909-9e1d-22dbadbe8b23 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:19.896524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e1191-bed9-4909-9e1d-22dbadbe8b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:19.915285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-1e1e1191-bed9-4909-9e1d-22dbadbe8b23 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:19.916786 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-1e1e1191-bed9-4909-9e1d-22dbadbe8b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:19.978270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1190/2354] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:19.988409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:19.990090 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:20.049800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19065a7c-bb92-425c-89c6-d8bcaa086eac admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:20.054295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269fdeb-18c7-4ba0-9620-5fbd40b5327a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:20.055268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269fdeb-18c7-4ba0-9620-5fbd40b5327a service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:20.055551 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269fdeb-18c7-4ba0-9620-5fbd40b5327a service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:20.055818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269fdeb-18c7-4ba0-9620-5fbd40b5327a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:20.065782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269fdeb-18c7-4ba0-9620-5fbd40b5327a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:20.067260 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269fdeb-18c7-4ba0-9620-5fbd40b5327a service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:20.077274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1165/2355] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:20.481532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e1191-bed9-4909-9e1d-22dbadbe8b23 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:20.485178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-1e1e1191-bed9-4909-9e1d-22dbadbe8b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:20.486344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269fdeb-18c7-4ba0-9620-5fbd40b5327a service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:20.488922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f269fdeb-18c7-4ba0-9620-5fbd40b5327a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:20.497780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e1191-bed9-4909-9e1d-22dbadbe8b23 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:20.504014 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:20.505333 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:20.505871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:20.506249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] PATH_INFO: `/v3/projects/6212eedb93ad4dac9c425049d9bbb9fa` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:20.507530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6212eedb93ad4dac9c425049d9bbb9fa)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:20.510655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:20.532343 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269fdeb-18c7-4ba0-9620-5fbd40b5327a service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:20.537800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f976799-42ef-4b81-9552-c4e2a920644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:20.538769 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f976799-42ef-4b81-9552-c4e2a920644a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:20.539119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f976799-42ef-4b81-9552-c4e2a920644a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:20.539461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f976799-42ef-4b81-9552-c4e2a920644a admin admin] PATH_INFO: `/v3/users/620d9d4b6c274621bd9f93c6a5423cb3` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:20.540932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f976799-42ef-4b81-9552-c4e2a920644a admin admin] RBAC: Authorizing `identity:delete_user(user_id=620d9d4b6c274621bd9f93c6a5423cb3)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:20.543394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f976799-42ef-4b81-9552-c4e2a920644a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:20.575341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6212eedb93ad4dac9c425049d9bbb9fa', 'request_id': 'req-13827fb4-d46f-4415-8e6f-c5b26337dbab'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.584882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6212eedb93ad4dac9c425049d9bbb9fa', 'request_id': 'req-13827fb4-d46f-4415-8e6f-c5b26337dbab'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.591259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6212eedb93ad4dac9c425049d9bbb9fa', 'request_id': 'req-13827fb4-d46f-4415-8e6f-c5b26337dbab'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.596642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0f976799-42ef-4b81-9552-c4e2a920644a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620d9d4b6c274621bd9f93c6a5423cb3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.604256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] The token cache is being invalidate because project 6212eedb93ad4dac9c425049d9bbb9fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:20.604553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.605309 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.605541 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0f976799-42ef-4b81-9552-c4e2a920644a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620d9d4b6c274621bd9f93c6a5423cb3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.608049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1191/2356] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:20 2022] DELETE /identity/v3/projects/6212eedb93ad4dac9c425049d9bbb9fa => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:20.611599 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:20.612910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0f976799-42ef-4b81-9552-c4e2a920644a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620d9d4b6c274621bd9f93c6a5423cb3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.613053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:20.613667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0f976799-42ef-4b81-9552-c4e2a920644a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620d9d4b6c274621bd9f93c6a5423cb3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.614353 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0f976799-42ef-4b81-9552-c4e2a920644a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620d9d4b6c274621bd9f93c6a5423cb3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.632866 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1166/2357] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:20 2022] DELETE /identity/v3/users/620d9d4b6c274621bd9f93c6a5423cb3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:20.637481 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13fdaf-0d19-4322-91bb-85bdc48a2694 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:20.637884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13fdaf-0d19-4322-91bb-85bdc48a2694 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:20.638303 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13fdaf-0d19-4322-91bb-85bdc48a2694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:20.656784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-3a13fdaf-0d19-4322-91bb-85bdc48a2694 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:20.658765 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3a13fdaf-0d19-4322-91bb-85bdc48a2694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:20.685239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13827fb4-d46f-4415-8e6f-c5b26337dbab admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:20.724824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1167/2358] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:14:20.742988 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13fdaf-0d19-4322-91bb-85bdc48a2694 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:20.744533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3a13fdaf-0d19-4322-91bb-85bdc48a2694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:20.756990 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:20.758112 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:20.758557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:20.759235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] PATH_INFO: `/v3/users/93c8aff53c824f34848e60f2f593a320` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:20.760805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c8aff53c824f34848e60f2f593a320)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:20.762858 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:20.805105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13fdaf-0d19-4322-91bb-85bdc48a2694 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:20.809180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bbc86-3a1d-4b6f-9785-c1e7c43e0ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:20.809763 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bbc86-3a1d-4b6f-9785-c1e7c43e0ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:20.810110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bbc86-3a1d-4b6f-9785-c1e7c43e0ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:20.810289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bbc86-3a1d-4b6f-9785-c1e7c43e0ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:20.814590 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c8aff53c824f34848e60f2f593a320'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.821868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bbc86-3a1d-4b6f-9785-c1e7c43e0ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:20.822296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c8aff53c824f34848e60f2f593a320'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.823119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bbc86-3a1d-4b6f-9785-c1e7c43e0ea3 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:20.823657 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c8aff53c824f34848e60f2f593a320'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.824353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c8aff53c824f34848e60f2f593a320'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.837852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1168/2359] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:20.849165 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c8aff53c824f34848e60f2f593a320'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:20.864208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1192/2360] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:20 2022] DELETE /identity/v3/users/93c8aff53c824f34848e60f2f593a320 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:14:21.336759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bbc86-3a1d-4b6f-9785-c1e7c43e0ea3 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:21.338455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-686bbc86-3a1d-4b6f-9785-c1e7c43e0ea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:21.351539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:21.354449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:21.389783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bbc86-3a1d-4b6f-9785-c1e7c43e0ea3 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:21.474923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d182b-9c27-40f3-89b8-f7001a12eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:21.475739 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffafa5-619c-4d37-afd4-f1ee289ccc69 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:21.476152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d182b-9c27-40f3-89b8-f7001a12eb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:21.476509 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d182b-9c27-40f3-89b8-f7001a12eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:21.476848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d182b-9c27-40f3-89b8-f7001a12eb77 admin admin] PATH_INFO: `/v3/projects/8d76fe98c8fa41c0a11bceee702e156c` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:21.478116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d182b-9c27-40f3-89b8-f7001a12eb77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d76fe98c8fa41c0a11bceee702e156c)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:21.480080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d182b-9c27-40f3-89b8-f7001a12eb77 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:21.482694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd302b-041f-4c4d-ba89-1d1a7699b68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:21.483955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd302b-041f-4c4d-ba89-1d1a7699b68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:21.485093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd302b-041f-4c4d-ba89-1d1a7699b68d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:21.485665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd302b-041f-4c4d-ba89-1d1a7699b68d admin admin] PATH_INFO: `/v3/projects/e277afbc0b1540a197f47cc54515da48` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:21.488130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd302b-041f-4c4d-ba89-1d1a7699b68d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e277afbc0b1540a197f47cc54515da48)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:21.490802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd302b-041f-4c4d-ba89-1d1a7699b68d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:21.535748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7e0d182b-9c27-40f3-89b8-f7001a12eb77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d76fe98c8fa41c0a11bceee702e156c', 'request_id': 'req-7e0d182b-9c27-40f3-89b8-f7001a12eb77'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:21.541655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7e0d182b-9c27-40f3-89b8-f7001a12eb77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d76fe98c8fa41c0a11bceee702e156c', 'request_id': 'req-7e0d182b-9c27-40f3-89b8-f7001a12eb77'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:21.546939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-24cd302b-041f-4c4d-ba89-1d1a7699b68d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e277afbc0b1540a197f47cc54515da48', 'request_id': 'req-24cd302b-041f-4c4d-ba89-1d1a7699b68d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:21.550315 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7e0d182b-9c27-40f3-89b8-f7001a12eb77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d76fe98c8fa41c0a11bceee702e156c', 'request_id': 'req-7e0d182b-9c27-40f3-89b8-f7001a12eb77'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:21.556019 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-24cd302b-041f-4c4d-ba89-1d1a7699b68d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e277afbc0b1540a197f47cc54515da48', 'request_id': 'req-24cd302b-041f-4c4d-ba89-1d1a7699b68d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:21.562986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-24cd302b-041f-4c4d-ba89-1d1a7699b68d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e277afbc0b1540a197f47cc54515da48', 'request_id': 'req-24cd302b-041f-4c4d-ba89-1d1a7699b68d'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:21.565351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7e0d182b-9c27-40f3-89b8-f7001a12eb77 admin admin] The token cache is being invalidate because project 8d76fe98c8fa41c0a11bceee702e156c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:21.565795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7e0d182b-9c27-40f3-89b8-f7001a12eb77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:21.566636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7e0d182b-9c27-40f3-89b8-f7001a12eb77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:21.569308 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1169/2361] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:21 2022] DELETE /identity/v3/projects/8d76fe98c8fa41c0a11bceee702e156c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:21.576936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-24cd302b-041f-4c4d-ba89-1d1a7699b68d admin admin] The token cache is being invalidate because project e277afbc0b1540a197f47cc54515da48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:21.577235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-24cd302b-041f-4c4d-ba89-1d1a7699b68d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:21.578029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-24cd302b-041f-4c4d-ba89-1d1a7699b68d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:21.580321 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1193/2362] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:21 2022] DELETE /identity/v3/projects/e277afbc0b1540a197f47cc54515da48 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:21.592453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499b6cf-e12e-45fc-99a2-e09a10b50772 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:21.592984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499b6cf-e12e-45fc-99a2-e09a10b50772 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:21.593219 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499b6cf-e12e-45fc-99a2-e09a10b50772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:21.613933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-2499b6cf-e12e-45fc-99a2-e09a10b50772 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:21.615105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2499b6cf-e12e-45fc-99a2-e09a10b50772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:21.692449 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1170/2363] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:21.700322 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174385fd-c9ce-452f-9fee-2494cc91dbb7 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:21.700953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174385fd-c9ce-452f-9fee-2494cc91dbb7 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:21.701306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174385fd-c9ce-452f-9fee-2494cc91dbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:21.720869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-174385fd-c9ce-452f-9fee-2494cc91dbb7 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:21.722308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-174385fd-c9ce-452f-9fee-2494cc91dbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:21.733860 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1194/2364] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:21.735262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499b6cf-e12e-45fc-99a2-e09a10b50772 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:21.748354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499b6cf-e12e-45fc-99a2-e09a10b50772 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:21.765061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05070d-c8d9-4d62-88d1-04a5bb9a7085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:21.765939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05070d-c8d9-4d62-88d1-04a5bb9a7085 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:21.766506 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05070d-c8d9-4d62-88d1-04a5bb9a7085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:21.767843 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05070d-c8d9-4d62-88d1-04a5bb9a7085 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:21.769881 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05070d-c8d9-4d62-88d1-04a5bb9a7085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:14:21.770242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05070d-c8d9-4d62-88d1-04a5bb9a7085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:21.772002 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05070d-c8d9-4d62-88d1-04a5bb9a7085 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:21.785911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1171/2365] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:14:21.790944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174385fd-c9ce-452f-9fee-2494cc91dbb7 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:21.807126 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174385fd-c9ce-452f-9fee-2494cc91dbb7 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:21.814218 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2efbca-e3f7-4d6b-96a6-f22ef994e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:21.814881 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2efbca-e3f7-4d6b-96a6-f22ef994e5ed admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:21.815159 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2efbca-e3f7-4d6b-96a6-f22ef994e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:21.815428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2efbca-e3f7-4d6b-96a6-f22ef994e5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:21.816135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2efbca-e3f7-4d6b-96a6-f22ef994e5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:21.818202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2efbca-e3f7-4d6b-96a6-f22ef994e5ed admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:21.851467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1195/2366] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:14:21 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:21.855573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05070d-c8d9-4d62-88d1-04a5bb9a7085 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:21.866108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05070d-c8d9-4d62-88d1-04a5bb9a7085 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:21.925516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a71d8-c085-4ad1-9904-b6c94e06a914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:21.926776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a71d8-c085-4ad1-9904-b6c94e06a914 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:21.927066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a71d8-c085-4ad1-9904-b6c94e06a914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:21.927471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a71d8-c085-4ad1-9904-b6c94e06a914 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:21.928202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a71d8-c085-4ad1-9904-b6c94e06a914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:21.930401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a71d8-c085-4ad1-9904-b6c94e06a914 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:21.968793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1172/2367] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:14:21 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:21.973551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2efbca-e3f7-4d6b-96a6-f22ef994e5ed admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:21.984612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2efbca-e3f7-4d6b-96a6-f22ef994e5ed admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:21.990536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61d881-7004-44e8-9bea-52ca8fa5ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:21.991462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61d881-7004-44e8-9bea-52ca8fa5ccb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:21.991816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61d881-7004-44e8-9bea-52ca8fa5ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:21.992191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61d881-7004-44e8-9bea-52ca8fa5ccb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:21.992997 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61d881-7004-44e8-9bea-52ca8fa5ccb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:21.994754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61d881-7004-44e8-9bea-52ca8fa5ccb4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:22.011330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1196/2368] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:14:22.012749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a71d8-c085-4ad1-9904-b6c94e06a914 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:22.023677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a71d8-c085-4ad1-9904-b6c94e06a914 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:22.029996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18dcaf-7c9d-488b-b0fd-93b78483e4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:22.030174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18dcaf-7c9d-488b-b0fd-93b78483e4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:22.030437 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18dcaf-7c9d-488b-b0fd-93b78483e4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:22.030777 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18dcaf-7c9d-488b-b0fd-93b78483e4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:22.031578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18dcaf-7c9d-488b-b0fd-93b78483e4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:22.033459 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18dcaf-7c9d-488b-b0fd-93b78483e4d9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:22.047215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1173/2369] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:14:22.048753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61d881-7004-44e8-9bea-52ca8fa5ccb4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:22.059000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61d881-7004-44e8-9bea-52ca8fa5ccb4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:22.063831 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f4481-bd99-415a-bdca-068154e19bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:22.065309 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f4481-bd99-415a-bdca-068154e19bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:22.065939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f4481-bd99-415a-bdca-068154e19bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:22.065939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f4481-bd99-415a-bdca-068154e19bc2 admin admin] PATH_INFO: `/v3/projects/296ba866c3774453886337248635f52e/users/14c62eb6b8a9423ba983f59b9e623484/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:22.081168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f4481-bd99-415a-bdca-068154e19bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=296ba866c3774453886337248635f52e, user_id=14c62eb6b8a9423ba983f59b9e623484, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:22.083779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f4481-bd99-415a-bdca-068154e19bc2 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:22.097609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1197/2370] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:22 2022] PUT /identity/v3/projects/296ba866c3774453886337248635f52e/users/14c62eb6b8a9423ba983f59b9e623484/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:22.107643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aa278-761a-4579-b575-9160bd8a286e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:22.107931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aa278-761a-4579-b575-9160bd8a286e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:22.108363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aa278-761a-4579-b575-9160bd8a286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:22.137345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-548aa278-761a-4579-b575-9160bd8a286e None None] MFA Rules not processed for user `14c62eb6b8a9423ba983f59b9e623484`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:22.138784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-548aa278-761a-4579-b575-9160bd8a286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:22.211262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1174/2371] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:22.215879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f4481-bd99-415a-bdca-068154e19bc2 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:22.301394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f4481-bd99-415a-bdca-068154e19bc2 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:22.307852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34484e-bc70-47aa-a124-cc635e88230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:22.308601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34484e-bc70-47aa-a124-cc635e88230f admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:22.308943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34484e-bc70-47aa-a124-cc635e88230f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:22.309291 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34484e-bc70-47aa-a124-cc635e88230f admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:22.310055 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34484e-bc70-47aa-a124-cc635e88230f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:22.312583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34484e-bc70-47aa-a124-cc635e88230f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:22.360609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1198/2372] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:14:22 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:14:22.365293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aa278-761a-4579-b575-9160bd8a286e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:22.377291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aa278-761a-4579-b575-9160bd8a286e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:22.437023 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f26ab-2b55-4100-8757-70c932e697c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:22.437696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f26ab-2b55-4100-8757-70c932e697c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:22.437975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f26ab-2b55-4100-8757-70c932e697c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:22.438250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f26ab-2b55-4100-8757-70c932e697c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:22.438995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f26ab-2b55-4100-8757-70c932e697c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:22.441520 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f26ab-2b55-4100-8757-70c932e697c8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:22.471462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1175/2373] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:14:22 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:22.475520 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34484e-bc70-47aa-a124-cc635e88230f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:22.486636 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34484e-bc70-47aa-a124-cc635e88230f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:22.491768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da1781-840d-4e20-b7d1-2891e6d39744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:22.492487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da1781-840d-4e20-b7d1-2891e6d39744 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:22.492770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da1781-840d-4e20-b7d1-2891e6d39744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:22.493044 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da1781-840d-4e20-b7d1-2891e6d39744 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:22.493772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da1781-840d-4e20-b7d1-2891e6d39744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:22.495384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da1781-840d-4e20-b7d1-2891e6d39744 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:22.507866 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1199/2374] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:14:22.512333 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f26ab-2b55-4100-8757-70c932e697c8 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:22.524375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f26ab-2b55-4100-8757-70c932e697c8 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:22.529634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171d573-adfe-4367-83f0-9fa033ab729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:22.530295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171d573-adfe-4367-83f0-9fa033ab729b admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:22.530573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171d573-adfe-4367-83f0-9fa033ab729b admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:22.530844 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171d573-adfe-4367-83f0-9fa033ab729b admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:22.531566 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171d573-adfe-4367-83f0-9fa033ab729b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:22.533755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171d573-adfe-4367-83f0-9fa033ab729b admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:22.544579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1176/2375] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:14:22.548912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da1781-840d-4e20-b7d1-2891e6d39744 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:22.559143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da1781-840d-4e20-b7d1-2891e6d39744 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:22.563861 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6157f8-f03e-4984-b4a3-307beb971f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:22.564959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6157f8-f03e-4984-b4a3-307beb971f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:22.565238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6157f8-f03e-4984-b4a3-307beb971f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:22.565507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6157f8-f03e-4984-b4a3-307beb971f72 admin admin] PATH_INFO: `/v3/projects/4e125e824460435e9bb8657ed4f4f1db/users/53de6771912d40c7928a522306f4f1a4/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:22.582972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6157f8-f03e-4984-b4a3-307beb971f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e125e824460435e9bb8657ed4f4f1db, user_id=53de6771912d40c7928a522306f4f1a4, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:22.585854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6157f8-f03e-4984-b4a3-307beb971f72 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:22.601805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1200/2376] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:22 2022] PUT /identity/v3/projects/4e125e824460435e9bb8657ed4f4f1db/users/53de6771912d40c7928a522306f4f1a4/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:22.613160 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688ee73-0ea2-4e00-80df-b1f31468aa7e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:22.613365 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688ee73-0ea2-4e00-80df-b1f31468aa7e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:22.613667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688ee73-0ea2-4e00-80df-b1f31468aa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:22.640171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a688ee73-0ea2-4e00-80df-b1f31468aa7e None None] MFA Rules not processed for user `53de6771912d40c7928a522306f4f1a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:22.641395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a688ee73-0ea2-4e00-80df-b1f31468aa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:22.708229 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1177/2377] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:22.712201 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6157f8-f03e-4984-b4a3-307beb971f72 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:22.803133 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6157f8-f03e-4984-b4a3-307beb971f72 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:22.808310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79ac5e-9e79-4930-b2da-ec23ac9e9636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:22.809179 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79ac5e-9e79-4930-b2da-ec23ac9e9636 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:22.809443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79ac5e-9e79-4930-b2da-ec23ac9e9636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:22.809616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79ac5e-9e79-4930-b2da-ec23ac9e9636 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:22.811526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79ac5e-9e79-4930-b2da-ec23ac9e9636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:22.812631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79ac5e-9e79-4930-b2da-ec23ac9e9636 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:22.856168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1201/2378] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:14:22 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:14:22.857691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688ee73-0ea2-4e00-80df-b1f31468aa7e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:22.873220 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688ee73-0ea2-4e00-80df-b1f31468aa7e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:22.968596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc02216-0796-487e-859d-0ad93ba99772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:22.969724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc02216-0796-487e-859d-0ad93ba99772 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:22.974590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc02216-0796-487e-859d-0ad93ba99772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:22.974827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc02216-0796-487e-859d-0ad93ba99772 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:22.975551 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc02216-0796-487e-859d-0ad93ba99772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:22.977627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc02216-0796-487e-859d-0ad93ba99772 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:23.002015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1178/2379] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:14:22 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:23.005855 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79ac5e-9e79-4930-b2da-ec23ac9e9636 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:23.018256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79ac5e-9e79-4930-b2da-ec23ac9e9636 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:23.023614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1c5c9-bb42-4294-9404-ba0ad48a8940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:23.025158 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1c5c9-bb42-4294-9404-ba0ad48a8940 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:23.025537 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1c5c9-bb42-4294-9404-ba0ad48a8940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:23.025907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1c5c9-bb42-4294-9404-ba0ad48a8940 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:23.026793 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1c5c9-bb42-4294-9404-ba0ad48a8940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:23.029444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1c5c9-bb42-4294-9404-ba0ad48a8940 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:23.059223 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1202/2380] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:14:23.063365 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc02216-0796-487e-859d-0ad93ba99772 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:23.073364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc02216-0796-487e-859d-0ad93ba99772 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:23.078143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0f2c4-cfe7-4e36-a6f6-4d84193c6655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:23.079016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0f2c4-cfe7-4e36-a6f6-4d84193c6655 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:23.079293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0f2c4-cfe7-4e36-a6f6-4d84193c6655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:23.080156 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0f2c4-cfe7-4e36-a6f6-4d84193c6655 admin admin] PATH_INFO: `/v3/projects/30d9ce57966c4af2a6595a82c1b7fe1c/users/3723061dc6bd415da9e7456426f17e25/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:23.094681 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0f2c4-cfe7-4e36-a6f6-4d84193c6655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d9ce57966c4af2a6595a82c1b7fe1c, user_id=3723061dc6bd415da9e7456426f17e25, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:23.098102 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0f2c4-cfe7-4e36-a6f6-4d84193c6655 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:23.112328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1179/2381] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:23 2022] PUT /identity/v3/projects/30d9ce57966c4af2a6595a82c1b7fe1c/users/3723061dc6bd415da9e7456426f17e25/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:23.116270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1c5c9-bb42-4294-9404-ba0ad48a8940 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:23.126020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1c5c9-bb42-4294-9404-ba0ad48a8940 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:23.182687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f413b7-9d13-44fa-922f-581037051a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:23.183351 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f413b7-9d13-44fa-922f-581037051a99 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:23.183659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f413b7-9d13-44fa-922f-581037051a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:23.183933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f413b7-9d13-44fa-922f-581037051a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:23.184715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f413b7-9d13-44fa-922f-581037051a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:23.186336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f413b7-9d13-44fa-922f-581037051a99 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:23.196690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1203/2382] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:14:23.201129 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0f2c4-cfe7-4e36-a6f6-4d84193c6655 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:23.211245 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0f2c4-cfe7-4e36-a6f6-4d84193c6655 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:23.215816 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61873ec5-52d9-42ce-8df7-16ba1a407261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:23.216739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61873ec5-52d9-42ce-8df7-16ba1a407261 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:23.217026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61873ec5-52d9-42ce-8df7-16ba1a407261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:23.217300 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61873ec5-52d9-42ce-8df7-16ba1a407261 admin admin] PATH_INFO: `/v3/projects/30d9ce57966c4af2a6595a82c1b7fe1c/users/3723061dc6bd415da9e7456426f17e25/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:23.219296 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61873ec5-52d9-42ce-8df7-16ba1a407261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d9ce57966c4af2a6595a82c1b7fe1c, user_id=3723061dc6bd415da9e7456426f17e25, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:23.222428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61873ec5-52d9-42ce-8df7-16ba1a407261 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:23.233081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1180/2383] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:23 2022] PUT /identity/v3/projects/30d9ce57966c4af2a6595a82c1b7fe1c/users/3723061dc6bd415da9e7456426f17e25/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:23.243690 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299839c-d58c-4f85-a06b-9088f2964a8e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:23.243977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299839c-d58c-4f85-a06b-9088f2964a8e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:23.244303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299839c-d58c-4f85-a06b-9088f2964a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:23.273089 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-3299839c-d58c-4f85-a06b-9088f2964a8e None None] MFA Rules not processed for user `3723061dc6bd415da9e7456426f17e25`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:23.275373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3299839c-d58c-4f85-a06b-9088f2964a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:23.344917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1204/2384] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:23.358732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61873ec5-52d9-42ce-8df7-16ba1a407261 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:23.360416 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-61873ec5-52d9-42ce-8df7-16ba1a407261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:23.428704 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61873ec5-52d9-42ce-8df7-16ba1a407261 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:23.432863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f03fe-81c5-44bf-98c2-0809c42b8a55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:23.433416 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f03fe-81c5-44bf-98c2-0809c42b8a55 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:23.434342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f03fe-81c5-44bf-98c2-0809c42b8a55 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:23.434342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f03fe-81c5-44bf-98c2-0809c42b8a55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:23.445011 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f03fe-81c5-44bf-98c2-0809c42b8a55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:23.446505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f03fe-81c5-44bf-98c2-0809c42b8a55 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:23.460406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1181/2385] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:23.966268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299839c-d58c-4f85-a06b-9088f2964a8e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:23.976240 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299839c-d58c-4f85-a06b-9088f2964a8e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:23.979700 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34623907-3e21-45fd-8ea5-d899dfb736b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:23.980357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34623907-3e21-45fd-8ea5-d899dfb736b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:23.980639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34623907-3e21-45fd-8ea5-d899dfb736b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:23.980912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34623907-3e21-45fd-8ea5-d899dfb736b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:24.033834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34623907-3e21-45fd-8ea5-d899dfb736b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:24.035271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34623907-3e21-45fd-8ea5-d899dfb736b8 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:24.043750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1205/2386] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:30.280234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f03fe-81c5-44bf-98c2-0809c42b8a55 service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:30.288587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f03fe-81c5-44bf-98c2-0809c42b8a55 service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:30.292349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64a3b8-77fa-4140-b8aa-5e12aa5ab8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:30.292985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64a3b8-77fa-4140-b8aa-5e12aa5ab8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:30.293264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64a3b8-77fa-4140-b8aa-5e12aa5ab8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:30.293587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64a3b8-77fa-4140-b8aa-5e12aa5ab8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:30.353116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64a3b8-77fa-4140-b8aa-5e12aa5ab8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:30.354471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64a3b8-77fa-4140-b8aa-5e12aa5ab8f3 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:30.364539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1182/2387] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:32.398571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34623907-3e21-45fd-8ea5-d899dfb736b8 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:32.463509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34623907-3e21-45fd-8ea5-d899dfb736b8 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:32.468559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:32.469493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:32.469839 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:32.470176 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] PATH_INFO: `/v3/users/14c62eb6b8a9423ba983f59b9e623484` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:32.471415 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c62eb6b8a9423ba983f59b9e623484)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:32.474077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:32.531525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c62eb6b8a9423ba983f59b9e623484'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:32.539218 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c62eb6b8a9423ba983f59b9e623484'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:32.540157 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c62eb6b8a9423ba983f59b9e623484'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:32.540864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c62eb6b8a9423ba983f59b9e623484'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:32.554945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c62eb6b8a9423ba983f59b9e623484'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:32.575130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1206/2388] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:32 2022] DELETE /identity/v3/users/14c62eb6b8a9423ba983f59b9e623484 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:32.583131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabd862-1393-4442-b0f5-3989e0bba067 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:32.583131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabd862-1393-4442-b0f5-3989e0bba067 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:32.583131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabd862-1393-4442-b0f5-3989e0bba067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:32.617346 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5cabd862-1393-4442-b0f5-3989e0bba067 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:32.618726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5cabd862-1393-4442-b0f5-3989e0bba067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:32.706245 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1183/2389] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:32.725240 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:32.726061 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cf26a-6d5c-4a7e-bb4e-84e42f9ba54f None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:32.726351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cf26a-6d5c-4a7e-bb4e-84e42f9ba54f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:32.726629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cf26a-6d5c-4a7e-bb4e-84e42f9ba54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:32.727921 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:32.748232 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-cf9cf26a-6d5c-4a7e-bb4e-84e42f9ba54f None None] MFA Rules not processed for user `1e4b30ac01a84009b41f6c83de99cfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:32.749434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-cf9cf26a-6d5c-4a7e-bb4e-84e42f9ba54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:32.805303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e9453-3ef6-4d93-a141-59bc2858b552 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:32.809661 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6919500-4afa-4769-bc94-9f92486b5a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:32.810503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6919500-4afa-4769-bc94-9f92486b5a37 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:32.810939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6919500-4afa-4769-bc94-9f92486b5a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:32.811364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6919500-4afa-4769-bc94-9f92486b5a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:32.816583 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1184/2390] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:14:32.824066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6919500-4afa-4769-bc94-9f92486b5a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:32.825994 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6919500-4afa-4769-bc94-9f92486b5a37 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:32.836194 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1207/2391] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:33.228891 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cf26a-6d5c-4a7e-bb4e-84e42f9ba54f None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:33.230379 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-cf9cf26a-6d5c-4a7e-bb4e-84e42f9ba54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:33.245393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cf26a-6d5c-4a7e-bb4e-84e42f9ba54f None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:33.250172 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:33.251052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:33.251334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:33.251617 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] PATH_INFO: `/v3/projects/296ba866c3774453886337248635f52e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:33.252879 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=296ba866c3774453886337248635f52e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:33.255511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:33.317298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296ba866c3774453886337248635f52e', 'request_id': 'req-fd839ded-a914-4302-a104-90e97ef22549'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.322760 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296ba866c3774453886337248635f52e', 'request_id': 'req-fd839ded-a914-4302-a104-90e97ef22549'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.330968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296ba866c3774453886337248635f52e', 'request_id': 'req-fd839ded-a914-4302-a104-90e97ef22549'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.343980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] The token cache is being invalidate because project 296ba866c3774453886337248635f52e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:33.344296 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.344967 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.346520 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1185/2392] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:33 2022] DELETE /identity/v3/projects/296ba866c3774453886337248635f52e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:33.350723 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6919500-4afa-4769-bc94-9f92486b5a37 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:33.360332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6919500-4afa-4769-bc94-9f92486b5a37 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:33.415818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:33.416736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:33.417021 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:33.417299 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] PATH_INFO: `/v3/users/53de6771912d40c7928a522306f4f1a4` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:33.418486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53de6771912d40c7928a522306f4f1a4)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:33.420428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:33.466984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53de6771912d40c7928a522306f4f1a4'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.473457 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53de6771912d40c7928a522306f4f1a4'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.474168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53de6771912d40c7928a522306f4f1a4'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.474774 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53de6771912d40c7928a522306f4f1a4'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.486087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53de6771912d40c7928a522306f4f1a4'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.499574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1208/2393] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:33 2022] DELETE /identity/v3/users/53de6771912d40c7928a522306f4f1a4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:14:33.786590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:33.788623 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:33.803041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd839ded-a914-4302-a104-90e97ef22549 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:33.880856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:33.881876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:33.882226 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:33.882629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] PATH_INFO: `/v3/projects/4e125e824460435e9bb8657ed4f4f1db` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:33.883893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e125e824460435e9bb8657ed4f4f1db)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:33.885998 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:33.934935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e125e824460435e9bb8657ed4f4f1db', 'request_id': 'req-67e6cc5a-bbe1-40d3-995e-5323793a6486'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.940370 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e125e824460435e9bb8657ed4f4f1db', 'request_id': 'req-67e6cc5a-bbe1-40d3-995e-5323793a6486'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.949072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e125e824460435e9bb8657ed4f4f1db', 'request_id': 'req-67e6cc5a-bbe1-40d3-995e-5323793a6486'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.963564 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] The token cache is being invalidate because project 4e125e824460435e9bb8657ed4f4f1db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:33.963792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.964495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:33.966868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1186/2394] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:33 2022] DELETE /identity/v3/projects/4e125e824460435e9bb8657ed4f4f1db => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:33.970751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:33.972881 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:33.986381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c7fc-bbb2-4933-a099-b0f2bd42b8b2 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:34.059000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74b7c8-da1d-403d-be0e-e15e664a28c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:34.059936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74b7c8-da1d-403d-be0e-e15e664a28c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:34.060258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74b7c8-da1d-403d-be0e-e15e664a28c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:34.060510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74b7c8-da1d-403d-be0e-e15e664a28c5 admin admin] PATH_INFO: `/v3/users/3723061dc6bd415da9e7456426f17e25` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:34.062063 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74b7c8-da1d-403d-be0e-e15e664a28c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3723061dc6bd415da9e7456426f17e25)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:34.064174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74b7c8-da1d-403d-be0e-e15e664a28c5 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:34.110869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3e74b7c8-da1d-403d-be0e-e15e664a28c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3723061dc6bd415da9e7456426f17e25'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.118057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3e74b7c8-da1d-403d-be0e-e15e664a28c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3723061dc6bd415da9e7456426f17e25'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.118816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3e74b7c8-da1d-403d-be0e-e15e664a28c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3723061dc6bd415da9e7456426f17e25'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.119421 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3e74b7c8-da1d-403d-be0e-e15e664a28c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3723061dc6bd415da9e7456426f17e25'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.131265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-3e74b7c8-da1d-403d-be0e-e15e664a28c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3723061dc6bd415da9e7456426f17e25'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.144184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1209/2395] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:33 2022] DELETE /identity/v3/users/3723061dc6bd415da9e7456426f17e25 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:34.405050 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:34.406484 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:34.421403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6cc5a-bbe1-40d3-995e-5323793a6486 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:34.476785 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c473034-132e-4306-9e97-518040b0286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:34.477633 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473034-132e-4306-9e97-518040b0286e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:34.477934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473034-132e-4306-9e97-518040b0286e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:34.478191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473034-132e-4306-9e97-518040b0286e admin admin] PATH_INFO: `/v3/projects/30d9ce57966c4af2a6595a82c1b7fe1c` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:34.479351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c473034-132e-4306-9e97-518040b0286e admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d9ce57966c4af2a6595a82c1b7fe1c)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:34.481288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c473034-132e-4306-9e97-518040b0286e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:34.525375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7c473034-132e-4306-9e97-518040b0286e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d9ce57966c4af2a6595a82c1b7fe1c', 'request_id': 'req-7c473034-132e-4306-9e97-518040b0286e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.530597 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7c473034-132e-4306-9e97-518040b0286e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d9ce57966c4af2a6595a82c1b7fe1c', 'request_id': 'req-7c473034-132e-4306-9e97-518040b0286e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.538201 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7c473034-132e-4306-9e97-518040b0286e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d9ce57966c4af2a6595a82c1b7fe1c', 'request_id': 'req-7c473034-132e-4306-9e97-518040b0286e'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.548975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7c473034-132e-4306-9e97-518040b0286e admin admin] The token cache is being invalidate because project 30d9ce57966c4af2a6595a82c1b7fe1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:34.549258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7c473034-132e-4306-9e97-518040b0286e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.549900 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-7c473034-132e-4306-9e97-518040b0286e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:34.551452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1187/2396] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:34 2022] DELETE /identity/v3/projects/30d9ce57966c4af2a6595a82c1b7fe1c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:34.557568 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86f639-1cfa-4831-965c-906e0ff8c539 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:34.558158 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86f639-1cfa-4831-965c-906e0ff8c539 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:34.558158 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86f639-1cfa-4831-965c-906e0ff8c539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:34.576174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-8d86f639-1cfa-4831-965c-906e0ff8c539 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:34.577339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8d86f639-1cfa-4831-965c-906e0ff8c539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:34.634383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1210/2397] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:34.642701 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e74ca-c0d7-421d-9e3a-57361def38c9 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:34.642986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e74ca-c0d7-421d-9e3a-57361def38c9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:34.643259 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e74ca-c0d7-421d-9e3a-57361def38c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:34.661453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-102e74ca-c0d7-421d-9e3a-57361def38c9 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:34.662555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-102e74ca-c0d7-421d-9e3a-57361def38c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:34.670175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1188/2398] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:34.674208 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86f639-1cfa-4831-965c-906e0ff8c539 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:34.683869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86f639-1cfa-4831-965c-906e0ff8c539 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:34.688525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cda509-167c-4257-b2b5-0f42d5415bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:34.689163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cda509-167c-4257-b2b5-0f42d5415bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:34.689443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cda509-167c-4257-b2b5-0f42d5415bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:34.689713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cda509-167c-4257-b2b5-0f42d5415bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:34.690434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cda509-167c-4257-b2b5-0f42d5415bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:14:34.691264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cda509-167c-4257-b2b5-0f42d5415bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:34.692876 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cda509-167c-4257-b2b5-0f42d5415bf4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:34.703901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1211/2399] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:14:34.708619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e74ca-c0d7-421d-9e3a-57361def38c9 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:34.717579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e74ca-c0d7-421d-9e3a-57361def38c9 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:34.722214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e636b6-b0da-411c-965b-df0f418df635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:34.722865 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e636b6-b0da-411c-965b-df0f418df635 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:34.723168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e636b6-b0da-411c-965b-df0f418df635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:34.723489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e636b6-b0da-411c-965b-df0f418df635 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:34.724218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e636b6-b0da-411c-965b-df0f418df635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:34.726085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e636b6-b0da-411c-965b-df0f418df635 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:34.754171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1189/2400] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:14:34 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:14:34.755366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cda509-167c-4257-b2b5-0f42d5415bf4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:34.765383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cda509-167c-4257-b2b5-0f42d5415bf4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:34.821878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b311207-ac8a-45d1-b5a8-bb42eb5ba997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:34.822539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b311207-ac8a-45d1-b5a8-bb42eb5ba997 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:34.822828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b311207-ac8a-45d1-b5a8-bb42eb5ba997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:34.823101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b311207-ac8a-45d1-b5a8-bb42eb5ba997 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:34.823784 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b311207-ac8a-45d1-b5a8-bb42eb5ba997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:34.825722 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b311207-ac8a-45d1-b5a8-bb42eb5ba997 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:34.845137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1212/2401] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:14:34 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:34.854253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e636b6-b0da-411c-965b-df0f418df635 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:34.864416 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e636b6-b0da-411c-965b-df0f418df635 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:34.869200 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08066bc3-a0e9-4ddb-ad59-66d7eb23f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:34.869852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08066bc3-a0e9-4ddb-ad59-66d7eb23f76a admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:34.870132 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08066bc3-a0e9-4ddb-ad59-66d7eb23f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:34.870400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08066bc3-a0e9-4ddb-ad59-66d7eb23f76a admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:34.871117 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08066bc3-a0e9-4ddb-ad59-66d7eb23f76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:34.872723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08066bc3-a0e9-4ddb-ad59-66d7eb23f76a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:34.883469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1190/2402] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:14:34.887587 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b311207-ac8a-45d1-b5a8-bb42eb5ba997 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:34.898042 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b311207-ac8a-45d1-b5a8-bb42eb5ba997 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:34.902775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592f503-0c71-46a3-96d1-7a2e4be39ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:34.903431 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592f503-0c71-46a3-96d1-7a2e4be39ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:34.903854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592f503-0c71-46a3-96d1-7a2e4be39ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:34.904169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592f503-0c71-46a3-96d1-7a2e4be39ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:34.904904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592f503-0c71-46a3-96d1-7a2e4be39ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:34.906474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592f503-0c71-46a3-96d1-7a2e4be39ca1 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:34.917009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1213/2403] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:14:34.921224 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08066bc3-a0e9-4ddb-ad59-66d7eb23f76a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:34.932070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08066bc3-a0e9-4ddb-ad59-66d7eb23f76a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:34.936921 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfecde-1bf8-4b1e-8a1f-3290426647ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:34.937875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfecde-1bf8-4b1e-8a1f-3290426647ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:34.938218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfecde-1bf8-4b1e-8a1f-3290426647ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:34.938557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfecde-1bf8-4b1e-8a1f-3290426647ff admin admin] PATH_INFO: `/v3/projects/5520b085fed94897b94318d0ab18351a/users/fbb3338ab71449f2917b7e5e459d2ea8/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:34.955047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfecde-1bf8-4b1e-8a1f-3290426647ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5520b085fed94897b94318d0ab18351a, user_id=fbb3338ab71449f2917b7e5e459d2ea8, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:34.957899 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfecde-1bf8-4b1e-8a1f-3290426647ff admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:34.969914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1191/2404] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:34 2022] PUT /identity/v3/projects/5520b085fed94897b94318d0ab18351a/users/fbb3338ab71449f2917b7e5e459d2ea8/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:14:34.981612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713a8f4-fc6a-4e43-9e4a-2611924700e9 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:34.981904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713a8f4-fc6a-4e43-9e4a-2611924700e9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:34.982183 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713a8f4-fc6a-4e43-9e4a-2611924700e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:35.008920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b713a8f4-fc6a-4e43-9e4a-2611924700e9 None None] MFA Rules not processed for user `fbb3338ab71449f2917b7e5e459d2ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:35.010109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b713a8f4-fc6a-4e43-9e4a-2611924700e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:35.075852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1214/2405] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:35.080278 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfecde-1bf8-4b1e-8a1f-3290426647ff admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:35.139941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfecde-1bf8-4b1e-8a1f-3290426647ff admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:35.144644 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606929b3-e3ad-4596-806c-6553a95879fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:35.145297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606929b3-e3ad-4596-806c-6553a95879fb admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:35.145577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606929b3-e3ad-4596-806c-6553a95879fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:35.145851 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606929b3-e3ad-4596-806c-6553a95879fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:35.146534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606929b3-e3ad-4596-806c-6553a95879fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:35.148463 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606929b3-e3ad-4596-806c-6553a95879fb admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:35.173936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1192/2406] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:14:35 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:35.178619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713a8f4-fc6a-4e43-9e4a-2611924700e9 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:35.191487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713a8f4-fc6a-4e43-9e4a-2611924700e9 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:35.244742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ba1ca-af1d-4862-8d10-66bf0597e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:35.245400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ba1ca-af1d-4862-8d10-66bf0597e0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:35.245680 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ba1ca-af1d-4862-8d10-66bf0597e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:35.245955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ba1ca-af1d-4862-8d10-66bf0597e0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:35.246630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ba1ca-af1d-4862-8d10-66bf0597e0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:35.248563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ba1ca-af1d-4862-8d10-66bf0597e0e4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:35.267645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1215/2407] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:14:35 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:35.271633 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606929b3-e3ad-4596-806c-6553a95879fb admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:35.281557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606929b3-e3ad-4596-806c-6553a95879fb admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:35.286522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0b611-ba90-4f95-855b-62c3990b8f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:35.287159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0b611-ba90-4f95-855b-62c3990b8f81 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:35.287435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0b611-ba90-4f95-855b-62c3990b8f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:35.287702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0b611-ba90-4f95-855b-62c3990b8f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:35.288450 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0b611-ba90-4f95-855b-62c3990b8f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:35.290047 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0b611-ba90-4f95-855b-62c3990b8f81 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:35.300909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1193/2408] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:14:35.305097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ba1ca-af1d-4862-8d10-66bf0597e0e4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:35.314395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ba1ca-af1d-4862-8d10-66bf0597e0e4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:35.319076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa32cb-7a5d-47e8-8dda-d0e18112e344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:35.319934 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa32cb-7a5d-47e8-8dda-d0e18112e344 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:35.320250 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa32cb-7a5d-47e8-8dda-d0e18112e344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:35.320518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa32cb-7a5d-47e8-8dda-d0e18112e344 admin admin] PATH_INFO: `/v3/projects/8a5c63000589496082b88b911fd5b646/users/9d75f56134944f91900d180ac7cfd677/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:35.334343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa32cb-7a5d-47e8-8dda-d0e18112e344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5c63000589496082b88b911fd5b646, user_id=9d75f56134944f91900d180ac7cfd677, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:35.336995 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa32cb-7a5d-47e8-8dda-d0e18112e344 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:35.349126 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1216/2409] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:35 2022] PUT /identity/v3/projects/8a5c63000589496082b88b911fd5b646/users/9d75f56134944f91900d180ac7cfd677/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:14:35.353050 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0b611-ba90-4f95-855b-62c3990b8f81 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:35.363239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0b611-ba90-4f95-855b-62c3990b8f81 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:35.415676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee642e-8de7-413e-a23f-1eb251ea17e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:35.416349 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee642e-8de7-413e-a23f-1eb251ea17e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:35.416627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee642e-8de7-413e-a23f-1eb251ea17e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:35.416897 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee642e-8de7-413e-a23f-1eb251ea17e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:35.417603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee642e-8de7-413e-a23f-1eb251ea17e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:35.419307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee642e-8de7-413e-a23f-1eb251ea17e5 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:35.429249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1194/2410] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:14:35.433422 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa32cb-7a5d-47e8-8dda-d0e18112e344 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:35.443387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa32cb-7a5d-47e8-8dda-d0e18112e344 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:35.447926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7d8f5-1532-4b96-8fc1-1452c08ea745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:35.448820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7d8f5-1532-4b96-8fc1-1452c08ea745 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:35.449098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7d8f5-1532-4b96-8fc1-1452c08ea745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:35.449369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7d8f5-1532-4b96-8fc1-1452c08ea745 admin admin] PATH_INFO: `/v3/projects/8a5c63000589496082b88b911fd5b646/users/9d75f56134944f91900d180ac7cfd677/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:35.451325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7d8f5-1532-4b96-8fc1-1452c08ea745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5c63000589496082b88b911fd5b646, user_id=9d75f56134944f91900d180ac7cfd677, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:35.453944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7d8f5-1532-4b96-8fc1-1452c08ea745 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:35.463616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1217/2411] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:35 2022] PUT /identity/v3/projects/8a5c63000589496082b88b911fd5b646/users/9d75f56134944f91900d180ac7cfd677/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:35.473844 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec2bbf-52c4-440c-9a8e-de0651cd2a80 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:35.474131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec2bbf-52c4-440c-9a8e-de0651cd2a80 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:35.474411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec2bbf-52c4-440c-9a8e-de0651cd2a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:35.499928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a8ec2bbf-52c4-440c-9a8e-de0651cd2a80 None None] MFA Rules not processed for user `9d75f56134944f91900d180ac7cfd677`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:35.501148 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a8ec2bbf-52c4-440c-9a8e-de0651cd2a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:35.565231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1195/2412] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:35.576630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7d8f5-1532-4b96-8fc1-1452c08ea745 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:35.578372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-51d7d8f5-1532-4b96-8fc1-1452c08ea745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:35.636312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7d8f5-1532-4b96-8fc1-1452c08ea745 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:35.639871 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26740a2-8c05-4678-9703-22f87213db89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:35.640534 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26740a2-8c05-4678-9703-22f87213db89 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:35.640813 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26740a2-8c05-4678-9703-22f87213db89 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:35.641084 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26740a2-8c05-4678-9703-22f87213db89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:35.649710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26740a2-8c05-4678-9703-22f87213db89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:35.651104 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26740a2-8c05-4678-9703-22f87213db89 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:35.660970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1218/2413] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:35.727911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec2bbf-52c4-440c-9a8e-de0651cd2a80 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:35.737536 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec2bbf-52c4-440c-9a8e-de0651cd2a80 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:35.741217 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2adb0a-4182-4e64-b556-7af9c0985264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:35.741838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2adb0a-4182-4e64-b556-7af9c0985264 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:35.742115 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2adb0a-4182-4e64-b556-7af9c0985264 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:35.742386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2adb0a-4182-4e64-b556-7af9c0985264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:35.797981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2adb0a-4182-4e64-b556-7af9c0985264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:35.800725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2adb0a-4182-4e64-b556-7af9c0985264 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:35.812508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1196/2414] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:36.069087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26740a2-8c05-4678-9703-22f87213db89 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:36.130068 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26740a2-8c05-4678-9703-22f87213db89 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:36.134478 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:36.135330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:36.135609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:36.135882 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] PATH_INFO: `/v3/users/fbb3338ab71449f2917b7e5e459d2ea8` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:36.137081 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb3338ab71449f2917b7e5e459d2ea8)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:36.138964 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:36.182889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb3338ab71449f2917b7e5e459d2ea8'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.189459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb3338ab71449f2917b7e5e459d2ea8'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.190050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb3338ab71449f2917b7e5e459d2ea8'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.190672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb3338ab71449f2917b7e5e459d2ea8'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.201961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb3338ab71449f2917b7e5e459d2ea8'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.215503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1219/2415] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:36 2022] DELETE /identity/v3/users/fbb3338ab71449f2917b7e5e459d2ea8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:36.219938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c0da7-0f21-4341-b5f0-925518a7c712 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:36.220461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c0da7-0f21-4341-b5f0-925518a7c712 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:36.220547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c0da7-0f21-4341-b5f0-925518a7c712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:36.238400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-2d1c0da7-0f21-4341-b5f0-925518a7c712 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:36.239587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2d1c0da7-0f21-4341-b5f0-925518a7c712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:36.296291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1197/2416] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:36.306659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:36.308052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:36.371141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fbc2e-ce12-4872-8f29-d1e1c6eb7ee7 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:36.374746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f95d52-6864-4c83-91d6-c03865d5929e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:36.375382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f95d52-6864-4c83-91d6-c03865d5929e service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:36.375657 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f95d52-6864-4c83-91d6-c03865d5929e service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:36.375927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f95d52-6864-4c83-91d6-c03865d5929e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:36.384679 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f95d52-6864-4c83-91d6-c03865d5929e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:36.386075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f95d52-6864-4c83-91d6-c03865d5929e service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:36.395111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1220/2417] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:36.649445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c0da7-0f21-4341-b5f0-925518a7c712 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:36.650829 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2d1c0da7-0f21-4341-b5f0-925518a7c712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:36.663630 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c0da7-0f21-4341-b5f0-925518a7c712 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:36.668171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:36.669049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:36.669346 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:36.669615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] PATH_INFO: `/v3/projects/5520b085fed94897b94318d0ab18351a` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:36.670830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5520b085fed94897b94318d0ab18351a)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:36.672810 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:36.721286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5520b085fed94897b94318d0ab18351a', 'request_id': 'req-33e615f9-bf71-486a-9ad3-69ca57705440'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.729756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5520b085fed94897b94318d0ab18351a', 'request_id': 'req-33e615f9-bf71-486a-9ad3-69ca57705440'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.738219 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5520b085fed94897b94318d0ab18351a', 'request_id': 'req-33e615f9-bf71-486a-9ad3-69ca57705440'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.749299 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] The token cache is being invalidate because project 5520b085fed94897b94318d0ab18351a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:36.749584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.750254 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.751825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1198/2418] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:36 2022] DELETE /identity/v3/projects/5520b085fed94897b94318d0ab18351a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:36.755836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f95d52-6864-4c83-91d6-c03865d5929e service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:36.765066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f95d52-6864-4c83-91d6-c03865d5929e service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:36.820520 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96783f3f-67a9-44b5-a002-ea628eb4d9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:36.821383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96783f3f-67a9-44b5-a002-ea628eb4d9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:36.821660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96783f3f-67a9-44b5-a002-ea628eb4d9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:36.821928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96783f3f-67a9-44b5-a002-ea628eb4d9c3 admin admin] PATH_INFO: `/v3/users/9d75f56134944f91900d180ac7cfd677` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:36.823090 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96783f3f-67a9-44b5-a002-ea628eb4d9c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d75f56134944f91900d180ac7cfd677)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:36.825020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96783f3f-67a9-44b5-a002-ea628eb4d9c3 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:36.869913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-96783f3f-67a9-44b5-a002-ea628eb4d9c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d75f56134944f91900d180ac7cfd677'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.876494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-96783f3f-67a9-44b5-a002-ea628eb4d9c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d75f56134944f91900d180ac7cfd677'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.877156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-96783f3f-67a9-44b5-a002-ea628eb4d9c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d75f56134944f91900d180ac7cfd677'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.877753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-96783f3f-67a9-44b5-a002-ea628eb4d9c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d75f56134944f91900d180ac7cfd677'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.888756 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-96783f3f-67a9-44b5-a002-ea628eb4d9c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d75f56134944f91900d180ac7cfd677'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:36.900562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1221/2419] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:36 2022] DELETE /identity/v3/users/9d75f56134944f91900d180ac7cfd677 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:37.202923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:37.204368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:37.218578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e615f9-bf71-486a-9ad3-69ca57705440 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:37.274525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:37.275371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:37.275648 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:37.275922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] PATH_INFO: `/v3/projects/8a5c63000589496082b88b911fd5b646` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:37.277107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5c63000589496082b88b911fd5b646)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:37.278979 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:37.329247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5c63000589496082b88b911fd5b646', 'request_id': 'req-92bafffb-1952-4f01-8b78-7f2c04a2aa07'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:37.334935 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5c63000589496082b88b911fd5b646', 'request_id': 'req-92bafffb-1952-4f01-8b78-7f2c04a2aa07'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:37.341994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5c63000589496082b88b911fd5b646', 'request_id': 'req-92bafffb-1952-4f01-8b78-7f2c04a2aa07'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:37.353415 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] The token cache is being invalidate because project 8a5c63000589496082b88b911fd5b646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:37.353698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:37.354315 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:37.355842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1199/2420] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:37 2022] DELETE /identity/v3/projects/8a5c63000589496082b88b911fd5b646 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:37.360854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73551027-23f3-4095-8f32-b3d734474184 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:37.361139 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73551027-23f3-4095-8f32-b3d734474184 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:37.361404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73551027-23f3-4095-8f32-b3d734474184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:37.381344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-73551027-23f3-4095-8f32-b3d734474184 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:37.382614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-73551027-23f3-4095-8f32-b3d734474184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:37.382964 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:37.384433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:37.444549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1222/2421] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:37.454072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2140e1-8a40-4e36-bf78-8ca0bb9ed1c2 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:37.454263 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2140e1-8a40-4e36-bf78-8ca0bb9ed1c2 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:37.454573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2140e1-8a40-4e36-bf78-8ca0bb9ed1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:37.474203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-4c2140e1-8a40-4e36-bf78-8ca0bb9ed1c2 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:37.475681 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4c2140e1-8a40-4e36-bf78-8ca0bb9ed1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:37.485308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1223/2422] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:37.487233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bafffb-1952-4f01-8b78-7f2c04a2aa07 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:37.490189 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2140e1-8a40-4e36-bf78-8ca0bb9ed1c2 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:37.493298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adfa7d-2135-479d-946e-59ff7756b63e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7f2aea3e494546a04e20d8cedccc9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:37.493944 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adfa7d-2135-479d-946e-59ff7756b63e service placement] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:37.494218 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adfa7d-2135-479d-946e-59ff7756b63e service placement] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:37.494675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adfa7d-2135-479d-946e-59ff7756b63e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:37.496624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-22adfa7d-2135-479d-946e-59ff7756b63e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:37.501117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2140e1-8a40-4e36-bf78-8ca0bb9ed1c2 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:37.506361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6284b-63fa-464e-8005-4ba2a7e29587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:37.507007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6284b-63fa-464e-8005-4ba2a7e29587 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:37.507281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6284b-63fa-464e-8005-4ba2a7e29587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:37.507578 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6284b-63fa-464e-8005-4ba2a7e29587 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:37.508542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6284b-63fa-464e-8005-4ba2a7e29587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:14:37.508853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6284b-63fa-464e-8005-4ba2a7e29587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:37.509570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adfa7d-2135-479d-946e-59ff7756b63e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:37.510485 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6284b-63fa-464e-8005-4ba2a7e29587 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:37.511660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adfa7d-2135-479d-946e-59ff7756b63e service placement] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:37.522867 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1224/2423] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:14:37.523797 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1200/2424] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:14:37.529166 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6284b-63fa-464e-8005-4ba2a7e29587 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:37.539210 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6284b-63fa-464e-8005-4ba2a7e29587 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:37.543929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e9f10-daca-43e2-8269-23c15afebc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:37.544590 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e9f10-daca-43e2-8269-23c15afebc5d admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:37.544870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e9f10-daca-43e2-8269-23c15afebc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:37.545141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e9f10-daca-43e2-8269-23c15afebc5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:37.545812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e9f10-daca-43e2-8269-23c15afebc5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:37.547687 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e9f10-daca-43e2-8269-23c15afebc5d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:37.572594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1225/2425] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:14:37 2022] POST /identity/v3/projects => generated 359 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:37.576855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adfa7d-2135-479d-946e-59ff7756b63e service placement] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:37.587822 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adfa7d-2135-479d-946e-59ff7756b63e service placement] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:37.644792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4a9c1-ac31-477f-bc71-b7aebc510b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:37.645453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4a9c1-ac31-477f-bc71-b7aebc510b27 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:37.645729 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4a9c1-ac31-477f-bc71-b7aebc510b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:37.645996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4a9c1-ac31-477f-bc71-b7aebc510b27 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:37.646674 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4a9c1-ac31-477f-bc71-b7aebc510b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:37.648665 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4a9c1-ac31-477f-bc71-b7aebc510b27 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:37.668200 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1201/2426] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:14:37 2022] POST /identity/v3/users => generated 280 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:37.672618 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e9f10-daca-43e2-8269-23c15afebc5d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:37.685688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e9f10-daca-43e2-8269-23c15afebc5d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:37.690981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd73e0-1041-4fac-942a-b4094c9a4c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:37.691901 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd73e0-1041-4fac-942a-b4094c9a4c24 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:37.692209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd73e0-1041-4fac-942a-b4094c9a4c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:37.692500 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd73e0-1041-4fac-942a-b4094c9a4c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:37.693345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd73e0-1041-4fac-942a-b4094c9a4c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:37.695000 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd73e0-1041-4fac-942a-b4094c9a4c24 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:37.705978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1226/2427] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:14:37.711113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4a9c1-ac31-477f-bc71-b7aebc510b27 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:37.721573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4a9c1-ac31-477f-bc71-b7aebc510b27 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:37.726199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdb0be-f7f1-4cc8-b6eb-fbe990fe3d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:37.726840 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdb0be-f7f1-4cc8-b6eb-fbe990fe3d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:37.727115 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdb0be-f7f1-4cc8-b6eb-fbe990fe3d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:37.727384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdb0be-f7f1-4cc8-b6eb-fbe990fe3d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:37.728103 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdb0be-f7f1-4cc8-b6eb-fbe990fe3d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:37.729683 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdb0be-f7f1-4cc8-b6eb-fbe990fe3d97 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:37.739113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1202/2428] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:14:37.743452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd73e0-1041-4fac-942a-b4094c9a4c24 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:37.754001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd73e0-1041-4fac-942a-b4094c9a4c24 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:37.758563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375f5a4-95e3-46a0-a449-f24e82414aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:37.759426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375f5a4-95e3-46a0-a449-f24e82414aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:37.759703 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375f5a4-95e3-46a0-a449-f24e82414aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:37.759975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375f5a4-95e3-46a0-a449-f24e82414aa2 admin admin] PATH_INFO: `/v3/projects/b1ae3ff1cfad4cc79ff6f8ae5ce8ce56/users/d7395c32f02a4b6aa3b507cb96874371/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:37.774521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375f5a4-95e3-46a0-a449-f24e82414aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ae3ff1cfad4cc79ff6f8ae5ce8ce56, user_id=d7395c32f02a4b6aa3b507cb96874371, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:37.777195 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375f5a4-95e3-46a0-a449-f24e82414aa2 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:37.789952 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1227/2429] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:37 2022] PUT /identity/v3/projects/b1ae3ff1cfad4cc79ff6f8ae5ce8ce56/users/d7395c32f02a4b6aa3b507cb96874371/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:37.800805 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98154659-92d4-499d-8c1f-30a2c6c99ba1 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:37.801088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98154659-92d4-499d-8c1f-30a2c6c99ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:37.801362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98154659-92d4-499d-8c1f-30a2c6c99ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:37.827990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-98154659-92d4-499d-8c1f-30a2c6c99ba1 None None] MFA Rules not processed for user `d7395c32f02a4b6aa3b507cb96874371`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:37.829154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-98154659-92d4-499d-8c1f-30a2c6c99ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:37.892943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1203/2430] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:37 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:14:37.923741 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375f5a4-95e3-46a0-a449-f24e82414aa2 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:37.925965 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b375f5a4-95e3-46a0-a449-f24e82414aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:37.982015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375f5a4-95e3-46a0-a449-f24e82414aa2 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:37.985737 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fb6e7-b83b-478b-90ef-272bdb8891f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:37.986385 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fb6e7-b83b-478b-90ef-272bdb8891f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:37.986667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fb6e7-b83b-478b-90ef-272bdb8891f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:37.986967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fb6e7-b83b-478b-90ef-272bdb8891f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:38.005417 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fb6e7-b83b-478b-90ef-272bdb8891f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:38.006857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fb6e7-b83b-478b-90ef-272bdb8891f8 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:38.015784 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1228/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:37 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:38.030070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98154659-92d4-499d-8c1f-30a2c6c99ba1 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:38.090335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98154659-92d4-499d-8c1f-30a2c6c99ba1 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:38.094835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:38.095698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:38.096005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:38.096305 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] PATH_INFO: `/v3/users/d7395c32f02a4b6aa3b507cb96874371` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:38.098152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7395c32f02a4b6aa3b507cb96874371)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:38.100067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:38.142516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7395c32f02a4b6aa3b507cb96874371'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:38.149493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7395c32f02a4b6aa3b507cb96874371'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:38.156194 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7395c32f02a4b6aa3b507cb96874371'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:38.156824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7395c32f02a4b6aa3b507cb96874371'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:38.157652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7395c32f02a4b6aa3b507cb96874371'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:38.176000 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1204/2432] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:38 2022] DELETE /identity/v3/users/d7395c32f02a4b6aa3b507cb96874371 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:38.180904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13fa65-ef29-4eb0-b652-44ff44ae3846 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:38.181195 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13fa65-ef29-4eb0-b652-44ff44ae3846 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:38.181477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13fa65-ef29-4eb0-b652-44ff44ae3846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:38.198473 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-dd13fa65-ef29-4eb0-b652-44ff44ae3846 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:38.199673 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-dd13fa65-ef29-4eb0-b652-44ff44ae3846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:38.269073 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1229/2433] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:38.278855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:38.280329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:38.344344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c0517-bbfd-4a54-980a-5cfafe709087 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:38.348034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec023f1-9292-4146-86ce-2fa4004f7cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:38.348696 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec023f1-9292-4146-86ce-2fa4004f7cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:38.348972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec023f1-9292-4146-86ce-2fa4004f7cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:38.349244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec023f1-9292-4146-86ce-2fa4004f7cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:38.359044 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec023f1-9292-4146-86ce-2fa4004f7cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:38.360547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec023f1-9292-4146-86ce-2fa4004f7cf8 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:38.370184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1205/2434] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:38.739974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13fa65-ef29-4eb0-b652-44ff44ae3846 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:38.741543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-dd13fa65-ef29-4eb0-b652-44ff44ae3846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:38.753856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13fa65-ef29-4eb0-b652-44ff44ae3846 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:38.758466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f67206-1693-463d-b943-921ffe4acae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:38.759394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f67206-1693-463d-b943-921ffe4acae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:38.759973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f67206-1693-463d-b943-921ffe4acae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:38.759973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f67206-1693-463d-b943-921ffe4acae0 admin admin] PATH_INFO: `/v3/projects/b1ae3ff1cfad4cc79ff6f8ae5ce8ce56` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:38.761264 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f67206-1693-463d-b943-921ffe4acae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ae3ff1cfad4cc79ff6f8ae5ce8ce56)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:38.763233 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f67206-1693-463d-b943-921ffe4acae0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:38.809557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b3f67206-1693-463d-b943-921ffe4acae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ae3ff1cfad4cc79ff6f8ae5ce8ce56', 'request_id': 'req-b3f67206-1693-463d-b943-921ffe4acae0'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:38.816705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b3f67206-1693-463d-b943-921ffe4acae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ae3ff1cfad4cc79ff6f8ae5ce8ce56', 'request_id': 'req-b3f67206-1693-463d-b943-921ffe4acae0'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:38.822035 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b3f67206-1693-463d-b943-921ffe4acae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ae3ff1cfad4cc79ff6f8ae5ce8ce56', 'request_id': 'req-b3f67206-1693-463d-b943-921ffe4acae0'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:38.833107 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b3f67206-1693-463d-b943-921ffe4acae0 admin admin] The token cache is being invalidate because project b1ae3ff1cfad4cc79ff6f8ae5ce8ce56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:38.833389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b3f67206-1693-463d-b943-921ffe4acae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:38.834006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b3f67206-1693-463d-b943-921ffe4acae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:38.835526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1230/2435] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:38 2022] DELETE /identity/v3/projects/b1ae3ff1cfad4cc79ff6f8ae5ce8ce56 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:14:38.840444 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78599b7-c56f-43c0-a218-4053f3c4eb7a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:38.840725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78599b7-c56f-43c0-a218-4053f3c4eb7a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:38.840996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78599b7-c56f-43c0-a218-4053f3c4eb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:38.858455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-b78599b7-c56f-43c0-a218-4053f3c4eb7a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:38.859567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b78599b7-c56f-43c0-a218-4053f3c4eb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:38.915332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1206/2436] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:38.922995 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da900d-805d-4a36-9c3e-c13d91b800a3 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:38.923277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da900d-805d-4a36-9c3e-c13d91b800a3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:38.923550 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da900d-805d-4a36-9c3e-c13d91b800a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:38.941625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f6da900d-805d-4a36-9c3e-c13d91b800a3 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:38.942793 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f6da900d-805d-4a36-9c3e-c13d91b800a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:38.950468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1231/2437] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:38.954523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78599b7-c56f-43c0-a218-4053f3c4eb7a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:38.964326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78599b7-c56f-43c0-a218-4053f3c4eb7a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:38.968817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dabd70-88de-4e96-88fb-6242e2286d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:38.969476 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabd70-88de-4e96-88fb-6242e2286d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:38.969756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabd70-88de-4e96-88fb-6242e2286d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:38.970028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabd70-88de-4e96-88fb-6242e2286d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:38.970740 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dabd70-88de-4e96-88fb-6242e2286d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:14:38.971041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dabd70-88de-4e96-88fb-6242e2286d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:38.973246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dabd70-88de-4e96-88fb-6242e2286d3c admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:38.984250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1207/2438] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:14:38.988795 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da900d-805d-4a36-9c3e-c13d91b800a3 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:38.997526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da900d-805d-4a36-9c3e-c13d91b800a3 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:39.002024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a331f3-5e42-4b13-a4fb-6e286bfa8be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:39.002656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a331f3-5e42-4b13-a4fb-6e286bfa8be1 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:39.003527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a331f3-5e42-4b13-a4fb-6e286bfa8be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:39.003898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a331f3-5e42-4b13-a4fb-6e286bfa8be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:39.004611 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a331f3-5e42-4b13-a4fb-6e286bfa8be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:39.006538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a331f3-5e42-4b13-a4fb-6e286bfa8be1 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:39.032078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1232/2439] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:14:38 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:39.036717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dabd70-88de-4e96-88fb-6242e2286d3c admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:39.046281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dabd70-88de-4e96-88fb-6242e2286d3c admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:39.102388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63c2c0-9b17-4d39-806c-2c951492b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:39.103092 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63c2c0-9b17-4d39-806c-2c951492b673 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:39.103309 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63c2c0-9b17-4d39-806c-2c951492b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:39.103575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63c2c0-9b17-4d39-806c-2c951492b673 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:39.104357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63c2c0-9b17-4d39-806c-2c951492b673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:39.106253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63c2c0-9b17-4d39-806c-2c951492b673 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:39.130338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1208/2440] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:14:39 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:14:39.131550 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a331f3-5e42-4b13-a4fb-6e286bfa8be1 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:39.142237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a331f3-5e42-4b13-a4fb-6e286bfa8be1 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:39.150172 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0c1df-2c68-46bd-a5bf-8489f73ea96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:39.150843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0c1df-2c68-46bd-a5bf-8489f73ea96f admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:39.151153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0c1df-2c68-46bd-a5bf-8489f73ea96f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:39.151425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0c1df-2c68-46bd-a5bf-8489f73ea96f admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:39.152184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0c1df-2c68-46bd-a5bf-8489f73ea96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:39.153758 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0c1df-2c68-46bd-a5bf-8489f73ea96f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:39.164827 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1233/2441] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:14:39.169099 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63c2c0-9b17-4d39-806c-2c951492b673 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:39.179673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63c2c0-9b17-4d39-806c-2c951492b673 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:39.184313 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26b9f7-e20e-460c-9ba9-4299828df0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:39.184957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26b9f7-e20e-460c-9ba9-4299828df0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:39.185237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26b9f7-e20e-460c-9ba9-4299828df0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:39.185511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26b9f7-e20e-460c-9ba9-4299828df0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:39.186227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26b9f7-e20e-460c-9ba9-4299828df0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:39.187827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26b9f7-e20e-460c-9ba9-4299828df0e5 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:39.197379 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1209/2442] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:14:39.201581 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0c1df-2c68-46bd-a5bf-8489f73ea96f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:39.212339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0c1df-2c68-46bd-a5bf-8489f73ea96f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:39.219611 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5dcbfd-e4c2-4cb3-b1ef-7cafce6d1d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:39.220679 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5dcbfd-e4c2-4cb3-b1ef-7cafce6d1d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:39.221036 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5dcbfd-e4c2-4cb3-b1ef-7cafce6d1d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:39.221351 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5dcbfd-e4c2-4cb3-b1ef-7cafce6d1d98 admin admin] PATH_INFO: `/v3/projects/878f03511c5f4139834201c1a12018a0/users/9023ed3150df41ad90aca2928ab30351/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:39.238408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5dcbfd-e4c2-4cb3-b1ef-7cafce6d1d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=878f03511c5f4139834201c1a12018a0, user_id=9023ed3150df41ad90aca2928ab30351, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:39.241200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5dcbfd-e4c2-4cb3-b1ef-7cafce6d1d98 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:39.255837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1234/2443] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:39 2022] PUT /identity/v3/projects/878f03511c5f4139834201c1a12018a0/users/9023ed3150df41ad90aca2928ab30351/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:39.266274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbc8f3-6d91-4a68-9168-676c2345918c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:39.266561 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbc8f3-6d91-4a68-9168-676c2345918c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:39.266845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbc8f3-6d91-4a68-9168-676c2345918c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:39.294960 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-abfbc8f3-6d91-4a68-9168-676c2345918c None None] MFA Rules not processed for user `9023ed3150df41ad90aca2928ab30351`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:39.296922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-abfbc8f3-6d91-4a68-9168-676c2345918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:39.363176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1210/2444] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:39.375540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5dcbfd-e4c2-4cb3-b1ef-7cafce6d1d98 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:39.377251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9c5dcbfd-e4c2-4cb3-b1ef-7cafce6d1d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:39.453549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5dcbfd-e4c2-4cb3-b1ef-7cafce6d1d98 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:39.457728 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bc0fd-f69a-4660-9110-2bc49bc37aa3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1848679bce324613b4a92de808165ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:39.458368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bc0fd-f69a-4660-9110-2bc49bc37aa3 service glance] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:39.458652 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bc0fd-f69a-4660-9110-2bc49bc37aa3 service glance] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:39.458930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bc0fd-f69a-4660-9110-2bc49bc37aa3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:39.467138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bc0fd-f69a-4660-9110-2bc49bc37aa3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:39.468608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bc0fd-f69a-4660-9110-2bc49bc37aa3 service glance] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:39.477158 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1235/2445] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:43.275774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbc8f3-6d91-4a68-9168-676c2345918c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:43.277166 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-abfbc8f3-6d91-4a68-9168-676c2345918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:43.338154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbc8f3-6d91-4a68-9168-676c2345918c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:43.342456 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:43.343302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:43.343582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:43.343853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] PATH_INFO: `/v3/users/e44db0900b884ce9b0ba14ebead7d43b` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:43.345038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44db0900b884ce9b0ba14ebead7d43b)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:43.346955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:43.392214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44db0900b884ce9b0ba14ebead7d43b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:43.403298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44db0900b884ce9b0ba14ebead7d43b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:43.412684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44db0900b884ce9b0ba14ebead7d43b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:43.413658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44db0900b884ce9b0ba14ebead7d43b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:43.414347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44db0900b884ce9b0ba14ebead7d43b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:43.434297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1211/2446] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:43 2022] DELETE /identity/v3/users/e44db0900b884ce9b0ba14ebead7d43b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:43.438771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79694d10-0708-4e8c-abb2-fcbe122fe2da None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:43.439232 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79694d10-0708-4e8c-abb2-fcbe122fe2da None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:43.439325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79694d10-0708-4e8c-abb2-fcbe122fe2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:43.456999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-79694d10-0708-4e8c-abb2-fcbe122fe2da None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:43.460890 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-79694d10-0708-4e8c-abb2-fcbe122fe2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:43.479909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:43.481352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:43.532192 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1236/2447] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:43.542858 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79694d10-0708-4e8c-abb2-fcbe122fe2da None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:43.544405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-79694d10-0708-4e8c-abb2-fcbe122fe2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:43.550874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b97a28-fb33-4ed0-9a9a-33920921d551 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:43.556424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:43.557335 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:43.557618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:43.557917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] PATH_INFO: `/v3/users/da82ca5a4e5c4b4c94ff084ba5a457de` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:43.559213 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da82ca5a4e5c4b4c94ff084ba5a457de)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:43.561301 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:43.605816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79694d10-0708-4e8c-abb2-fcbe122fe2da None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:43.609650 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8966725-5ca7-47df-b1ac-e1e6f5c1d746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:43.610285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966725-5ca7-47df-b1ac-e1e6f5c1d746 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:43.610563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966725-5ca7-47df-b1ac-e1e6f5c1d746 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:43.610667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da82ca5a4e5c4b4c94ff084ba5a457de'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:43.610835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966725-5ca7-47df-b1ac-e1e6f5c1d746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:43.617706 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da82ca5a4e5c4b4c94ff084ba5a457de'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:43.620883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8966725-5ca7-47df-b1ac-e1e6f5c1d746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:43.622296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8966725-5ca7-47df-b1ac-e1e6f5c1d746 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:43.624842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da82ca5a4e5c4b4c94ff084ba5a457de'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:43.625526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da82ca5a4e5c4b4c94ff084ba5a457de'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:43.626152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da82ca5a4e5c4b4c94ff084ba5a457de'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:43.632604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1237/2448] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:43.643993 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1212/2449] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:14:43 2022] DELETE /identity/v3/users/da82ca5a4e5c4b4c94ff084ba5a457de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:43.648402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447866f-c59a-4a17-960e-6b2822210856 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:43.648691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447866f-c59a-4a17-960e-6b2822210856 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:43.648969 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447866f-c59a-4a17-960e-6b2822210856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:43.666456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-c447866f-c59a-4a17-960e-6b2822210856 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:43.667705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c447866f-c59a-4a17-960e-6b2822210856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:43.726528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1238/2450] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:43.735758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:43.737197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:43.801049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63bb58-bf80-4f2d-a79a-2add800005b5 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:43.805163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd63fca-c515-4ac1-884d-764e38f3bbd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:43.805932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd63fca-c515-4ac1-884d-764e38f3bbd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:43.806217 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd63fca-c515-4ac1-884d-764e38f3bbd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:43.806491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd63fca-c515-4ac1-884d-764e38f3bbd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:43.816331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd63fca-c515-4ac1-884d-764e38f3bbd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:43.817756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd63fca-c515-4ac1-884d-764e38f3bbd1 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:43.827293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1213/2451] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:14:43.947110 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447866f-c59a-4a17-960e-6b2822210856 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:43.948692 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c447866f-c59a-4a17-960e-6b2822210856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:43.971977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447866f-c59a-4a17-960e-6b2822210856 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:43.977294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:43.978354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:43.978738 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:43.979118 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592 admin admin] PATH_INFO: `/v3/projects/056053aa5e064b0faa8bb4a288cbe046` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:43.980505 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=056053aa5e064b0faa8bb4a288cbe046)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:43.982511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:44.050350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056053aa5e064b0faa8bb4a288cbe046', 'request_id': 'req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:44.059888 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056053aa5e064b0faa8bb4a288cbe046', 'request_id': 'req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:44.066149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056053aa5e064b0faa8bb4a288cbe046', 'request_id': 'req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:44.088489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592 admin admin] The token cache is being invalidate because project 056053aa5e064b0faa8bb4a288cbe046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:44.088489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:44.088489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-eeecb6a9-9bb0-4b2f-9aa8-0931f4ea4592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:44.088489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1239/2452] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:43 2022] DELETE /identity/v3/projects/056053aa5e064b0faa8bb4a288cbe046 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:44.201226 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd63fca-c515-4ac1-884d-764e38f3bbd1 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:44.203282 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-fcd63fca-c515-4ac1-884d-764e38f3bbd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:44.224168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd63fca-c515-4ac1-884d-764e38f3bbd1 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:44.284880 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428c6cf-c668-418e-9478-c6b73b57c61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:44.285732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428c6cf-c668-418e-9478-c6b73b57c61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:44.286011 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428c6cf-c668-418e-9478-c6b73b57c61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:44.286279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428c6cf-c668-418e-9478-c6b73b57c61a admin admin] PATH_INFO: `/v3/projects/54a6c7a983724c98a52bfb901940fe45` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:44.287472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428c6cf-c668-418e-9478-c6b73b57c61a admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a6c7a983724c98a52bfb901940fe45)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:44.289382 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428c6cf-c668-418e-9478-c6b73b57c61a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:44.338751 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0428c6cf-c668-418e-9478-c6b73b57c61a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a6c7a983724c98a52bfb901940fe45', 'request_id': 'req-0428c6cf-c668-418e-9478-c6b73b57c61a'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:44.347240 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0428c6cf-c668-418e-9478-c6b73b57c61a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a6c7a983724c98a52bfb901940fe45', 'request_id': 'req-0428c6cf-c668-418e-9478-c6b73b57c61a'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:44.357113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0428c6cf-c668-418e-9478-c6b73b57c61a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a6c7a983724c98a52bfb901940fe45', 'request_id': 'req-0428c6cf-c668-418e-9478-c6b73b57c61a'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:44.369849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0428c6cf-c668-418e-9478-c6b73b57c61a admin admin] The token cache is being invalidate because project 54a6c7a983724c98a52bfb901940fe45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:14:44.370037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0428c6cf-c668-418e-9478-c6b73b57c61a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:44.370681 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0428c6cf-c668-418e-9478-c6b73b57c61a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:14:44.372328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1214/2453] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:14:44 2022] DELETE /identity/v3/projects/54a6c7a983724c98a52bfb901940fe45 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:44.377227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ea865-fc56-4e6e-ad57-86f669bd006c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:44.377515 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ea865-fc56-4e6e-ad57-86f669bd006c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:44.378368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ea865-fc56-4e6e-ad57-86f669bd006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:44.396334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-cc0ea865-fc56-4e6e-ad57-86f669bd006c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:44.397537 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-cc0ea865-fc56-4e6e-ad57-86f669bd006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:44.454220 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1240/2454] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:44.463233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a394698-f69d-4a0d-9afd-593c1e549f8c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:44.463703 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a394698-f69d-4a0d-9afd-593c1e549f8c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:44.463978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a394698-f69d-4a0d-9afd-593c1e549f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:44.481915 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-6a394698-f69d-4a0d-9afd-593c1e549f8c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:44.483103 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6a394698-f69d-4a0d-9afd-593c1e549f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:44.490903 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1215/2455] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:44.494929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ea865-fc56-4e6e-ad57-86f669bd006c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:44.504781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ea865-fc56-4e6e-ad57-86f669bd006c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:44.509256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a1e65-0101-4359-b647-f4283d939725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:44.509887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a1e65-0101-4359-b647-f4283d939725 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:44.510162 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a1e65-0101-4359-b647-f4283d939725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:44.510427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a1e65-0101-4359-b647-f4283d939725 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:44.511135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a1e65-0101-4359-b647-f4283d939725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:14:44.511434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a1e65-0101-4359-b647-f4283d939725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:44.513024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a1e65-0101-4359-b647-f4283d939725 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:44.524566 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1241/2456] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:14:44.528772 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a394698-f69d-4a0d-9afd-593c1e549f8c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:44.539166 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a394698-f69d-4a0d-9afd-593c1e549f8c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:44.544596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe736a37-a01a-4c59-8286-9b811f52c3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:44.545275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe736a37-a01a-4c59-8286-9b811f52c3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:44.545556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe736a37-a01a-4c59-8286-9b811f52c3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:44.545830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe736a37-a01a-4c59-8286-9b811f52c3c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:44.546576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe736a37-a01a-4c59-8286-9b811f52c3c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:44.548516 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe736a37-a01a-4c59-8286-9b811f52c3c5 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:44.574527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1216/2457] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:14:44 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:44.578588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a1e65-0101-4359-b647-f4283d939725 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:44.589257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a1e65-0101-4359-b647-f4283d939725 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:44.645352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee781539-95a2-4bd6-8fa4-70c6f67899a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:44.645928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee781539-95a2-4bd6-8fa4-70c6f67899a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:44.646205 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee781539-95a2-4bd6-8fa4-70c6f67899a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:44.646473 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee781539-95a2-4bd6-8fa4-70c6f67899a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:44.647148 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee781539-95a2-4bd6-8fa4-70c6f67899a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:44.649062 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee781539-95a2-4bd6-8fa4-70c6f67899a8 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:44.669185 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1242/2458] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:14:44 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:44.673211 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe736a37-a01a-4c59-8286-9b811f52c3c5 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:44.684183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe736a37-a01a-4c59-8286-9b811f52c3c5 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:44.688858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3d9d1-ce84-4994-a328-fd070ef54f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:44.689510 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3d9d1-ce84-4994-a328-fd070ef54f52 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:44.689793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3d9d1-ce84-4994-a328-fd070ef54f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:44.690068 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3d9d1-ce84-4994-a328-fd070ef54f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:44.691348 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3d9d1-ce84-4994-a328-fd070ef54f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:44.692972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3d9d1-ce84-4994-a328-fd070ef54f52 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:44.703294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1217/2459] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:14:44.707382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee781539-95a2-4bd6-8fa4-70c6f67899a8 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:44.717946 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee781539-95a2-4bd6-8fa4-70c6f67899a8 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:44.723456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b638b5-375a-4b3f-91f7-8049945a3057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:44.724598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b638b5-375a-4b3f-91f7-8049945a3057 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:44.724891 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b638b5-375a-4b3f-91f7-8049945a3057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:44.725238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b638b5-375a-4b3f-91f7-8049945a3057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:44.726079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b638b5-375a-4b3f-91f7-8049945a3057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:44.728225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b638b5-375a-4b3f-91f7-8049945a3057 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:44.740596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1243/2460] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:14:44.744855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3d9d1-ce84-4994-a328-fd070ef54f52 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:44.755657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3d9d1-ce84-4994-a328-fd070ef54f52 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:44.760504 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a88048-c98a-4de8-bc76-b7c1975fb310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:44.761411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a88048-c98a-4de8-bc76-b7c1975fb310 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:44.761689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a88048-c98a-4de8-bc76-b7c1975fb310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:44.761958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a88048-c98a-4de8-bc76-b7c1975fb310 admin admin] PATH_INFO: `/v3/projects/d637f953ac02425ca534eafe4fd59ff7/users/1777cac954d5400e86af7ece7a7ae05f/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:44.778167 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a88048-c98a-4de8-bc76-b7c1975fb310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d637f953ac02425ca534eafe4fd59ff7, user_id=1777cac954d5400e86af7ece7a7ae05f, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:44.781122 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a88048-c98a-4de8-bc76-b7c1975fb310 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:44.795482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1218/2461] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:44 2022] PUT /identity/v3/projects/d637f953ac02425ca534eafe4fd59ff7/users/1777cac954d5400e86af7ece7a7ae05f/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:44.801303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ec65-9a37-4033-900d-f8d423dba25e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:44.801683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ec65-9a37-4033-900d-f8d423dba25e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:44.802048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ec65-9a37-4033-900d-f8d423dba25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:44.822484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-4581ec65-9a37-4033-900d-f8d423dba25e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:44.823689 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4581ec65-9a37-4033-900d-f8d423dba25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:44.891064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1244/2462] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:44.901200 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a88048-c98a-4de8-bc76-b7c1975fb310 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:44.903112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-70a88048-c98a-4de8-bc76-b7c1975fb310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:44.957994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a88048-c98a-4de8-bc76-b7c1975fb310 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:44.961571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc6090-5841-4d22-88cd-fee3dc778ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:44.962199 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc6090-5841-4d22-88cd-fee3dc778ccd service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:44.962478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc6090-5841-4d22-88cd-fee3dc778ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:44.962750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc6090-5841-4d22-88cd-fee3dc778ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:44.972560 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc6090-5841-4d22-88cd-fee3dc778ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:44.973971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc6090-5841-4d22-88cd-fee3dc778ccd service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:44.983086 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1219/2463] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:48.784173 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ec65-9a37-4033-900d-f8d423dba25e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:48.805817 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ec65-9a37-4033-900d-f8d423dba25e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:48.813986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a428d-6905-441d-8086-30104752d8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:48.814504 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a428d-6905-441d-8086-30104752d8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:48.814789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a428d-6905-441d-8086-30104752d8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:48.815645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a428d-6905-441d-8086-30104752d8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:48.823640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8d1a428d-6905-441d-8086-30104752d8a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:48.940122 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a428d-6905-441d-8086-30104752d8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:48.942608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a428d-6905-441d-8086-30104752d8a9 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:48.954133 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1245/2464] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:50.466439 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de2bdb-edc7-4922-bae7-21afa508680f None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:50.467262 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de2bdb-edc7-4922-bae7-21afa508680f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:50.467578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de2bdb-edc7-4922-bae7-21afa508680f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:50.538548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-97de2bdb-edc7-4922-bae7-21afa508680f None None] MFA Rules not processed for user `1777cac954d5400e86af7ece7a7ae05f`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:50.539822 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-97de2bdb-edc7-4922-bae7-21afa508680f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:50.608727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1220/2465] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:50.612998 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a428d-6905-441d-8086-30104752d8a9 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:50.623300 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a428d-6905-441d-8086-30104752d8a9 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:50.631920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e320c5-7850-4cef-9639-35ae1d01d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:50.632899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e320c5-7850-4cef-9639-35ae1d01d1fa admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:50.633368 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e320c5-7850-4cef-9639-35ae1d01d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:50.633947 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e320c5-7850-4cef-9639-35ae1d01d1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:50.635611 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e320c5-7850-4cef-9639-35ae1d01d1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:50.637582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e320c5-7850-4cef-9639-35ae1d01d1fa admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:50.665707 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1246/2466] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:14:50 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:50.669686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de2bdb-edc7-4922-bae7-21afa508680f None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:50.680948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de2bdb-edc7-4922-bae7-21afa508680f None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:50.738388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984f56c-e0be-46d0-9909-26847cb97f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:50.739077 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984f56c-e0be-46d0-9909-26847cb97f37 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:50.739359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984f56c-e0be-46d0-9909-26847cb97f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:50.739638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984f56c-e0be-46d0-9909-26847cb97f37 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:50.740381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984f56c-e0be-46d0-9909-26847cb97f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:50.742363 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984f56c-e0be-46d0-9909-26847cb97f37 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:50.776468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1221/2467] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:14:50 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:14:50.780389 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e320c5-7850-4cef-9639-35ae1d01d1fa admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:50.795564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e320c5-7850-4cef-9639-35ae1d01d1fa admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:50.805388 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c16da-06b5-48d3-9d35-cd195a91110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:50.806077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c16da-06b5-48d3-9d35-cd195a91110e admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:50.806355 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c16da-06b5-48d3-9d35-cd195a91110e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:50.806627 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c16da-06b5-48d3-9d35-cd195a91110e admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:50.807354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c16da-06b5-48d3-9d35-cd195a91110e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:50.809096 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c16da-06b5-48d3-9d35-cd195a91110e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:50.827216 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1247/2468] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:14:50.828576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984f56c-e0be-46d0-9909-26847cb97f37 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:50.849239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984f56c-e0be-46d0-9909-26847cb97f37 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:50.854672 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d67331-f92e-43e6-ba4e-6d01ea5803d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:50.855738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d67331-f92e-43e6-ba4e-6d01ea5803d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:50.856143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d67331-f92e-43e6-ba4e-6d01ea5803d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:50.856555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d67331-f92e-43e6-ba4e-6d01ea5803d2 admin admin] PATH_INFO: `/v3/projects/5e22131dd18b498e94dddb8e28587f66/users/34d01cd2f96a43939b391c1a8b2dbb69/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:50.873568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d67331-f92e-43e6-ba4e-6d01ea5803d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e22131dd18b498e94dddb8e28587f66, user_id=34d01cd2f96a43939b391c1a8b2dbb69, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:50.876458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d67331-f92e-43e6-ba4e-6d01ea5803d2 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:50.892127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1222/2469] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:50 2022] PUT /identity/v3/projects/5e22131dd18b498e94dddb8e28587f66/users/34d01cd2f96a43939b391c1a8b2dbb69/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:14:50.896483 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c16da-06b5-48d3-9d35-cd195a91110e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:50.907906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c16da-06b5-48d3-9d35-cd195a91110e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:50.974654 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea098029-de68-40e0-8551-99799e92ffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:50.976127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea098029-de68-40e0-8551-99799e92ffed admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:50.976127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea098029-de68-40e0-8551-99799e92ffed admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:50.976365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea098029-de68-40e0-8551-99799e92ffed admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:50.977101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea098029-de68-40e0-8551-99799e92ffed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:50.978677 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea098029-de68-40e0-8551-99799e92ffed admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:50.992149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1248/2470] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:14:50.996283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d67331-f92e-43e6-ba4e-6d01ea5803d2 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:51.010655 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d67331-f92e-43e6-ba4e-6d01ea5803d2 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:51.021897 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a54010-ba83-440d-a67d-845aaaf8b8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:51.023244 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a54010-ba83-440d-a67d-845aaaf8b8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:51.024392 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a54010-ba83-440d-a67d-845aaaf8b8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:51.025552 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a54010-ba83-440d-a67d-845aaaf8b8f7 admin admin] PATH_INFO: `/v3/projects/5e22131dd18b498e94dddb8e28587f66/users/34d01cd2f96a43939b391c1a8b2dbb69/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:51.028667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a54010-ba83-440d-a67d-845aaaf8b8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e22131dd18b498e94dddb8e28587f66, user_id=34d01cd2f96a43939b391c1a8b2dbb69, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:51.040930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a54010-ba83-440d-a67d-845aaaf8b8f7 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:51.061913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1223/2471] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:14:50 2022] PUT /identity/v3/projects/5e22131dd18b498e94dddb8e28587f66/users/34d01cd2f96a43939b391c1a8b2dbb69/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:14:56.901980 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1bdb2-e0c2-4545-9898-8d216d80f404 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:56.902458 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1bdb2-e0c2-4545-9898-8d216d80f404 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:56.902777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1bdb2-e0c2-4545-9898-8d216d80f404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:56.929619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-d8c1bdb2-e0c2-4545-9898-8d216d80f404 None None] MFA Rules not processed for user `34d01cd2f96a43939b391c1a8b2dbb69`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:56.930809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d8c1bdb2-e0c2-4545-9898-8d216d80f404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:57.014825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1249/2472] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:14:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:57.031769 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a54010-ba83-440d-a67d-845aaaf8b8f7 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:57.034374 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-86a54010-ba83-440d-a67d-845aaaf8b8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:57.106596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a54010-ba83-440d-a67d-845aaaf8b8f7 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:57.110290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394bacb-f856-482b-b2f2-e01bd4e3bcf6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1848679bce324613b4a92de808165ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:57.110934 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394bacb-f856-482b-b2f2-e01bd4e3bcf6 service glance] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:57.111206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394bacb-f856-482b-b2f2-e01bd4e3bcf6 service glance] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:57.111524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394bacb-f856-482b-b2f2-e01bd4e3bcf6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:57.171066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394bacb-f856-482b-b2f2-e01bd4e3bcf6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:57.172624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394bacb-f856-482b-b2f2-e01bd4e3bcf6 service glance] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:57.182374 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1224/2473] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:14:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:14:57.310733 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77d733-32de-44b7-9fa9-9d56deb2d3a4 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:57.311024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77d733-32de-44b7-9fa9-9d56deb2d3a4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:57.311300 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77d733-32de-44b7-9fa9-9d56deb2d3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:57.372118 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-cc77d733-32de-44b7-9fa9-9d56deb2d3a4 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:14:57.373345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-cc77d733-32de-44b7-9fa9-9d56deb2d3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:57.445480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1250/2474] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:14:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:14:57.487241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394bacb-f856-482b-b2f2-e01bd4e3bcf6 service glance] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:14:57.488695 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a394bacb-f856-482b-b2f2-e01bd4e3bcf6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:14:57.585813 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394bacb-f856-482b-b2f2-e01bd4e3bcf6 service glance] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:14:57.592538 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8202159-dc89-4c89-9b08-2f163cfd4631 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:14:57.593212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8202159-dc89-4c89-9b08-2f163cfd4631 service swift] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:14:57.593491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8202159-dc89-4c89-9b08-2f163cfd4631 service swift] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:14:57.593918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8202159-dc89-4c89-9b08-2f163cfd4631 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:14:57.603781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8202159-dc89-4c89-9b08-2f163cfd4631 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:14:57.605437 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8202159-dc89-4c89-9b08-2f163cfd4631 service swift] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:14:57.613895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1225/2475] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:14:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:15:06.559307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01ea85-79f4-4f64-94e6-9d9de3ea62af None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:06.559852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01ea85-79f4-4f64-94e6-9d9de3ea62af None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:06.559852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01ea85-79f4-4f64-94e6-9d9de3ea62af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:06.577927 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-df01ea85-79f4-4f64-94e6-9d9de3ea62af None None] MFA Rules not processed for user `1777cac954d5400e86af7ece7a7ae05f`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:15:06.579116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-df01ea85-79f4-4f64-94e6-9d9de3ea62af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:06.586608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1251/2476] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:15:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:15:11.431074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f74d5-1d32-4d73-83e4-88129eb67081 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:11.431650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f74d5-1d32-4d73-83e4-88129eb67081 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:11.431650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f74d5-1d32-4d73-83e4-88129eb67081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:11.448974 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-fc2f74d5-1d32-4d73-83e4-88129eb67081 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:15:11.450227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-fc2f74d5-1d32-4d73-83e4-88129eb67081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:11.458748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1226/2477] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:15:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:15:11.471559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01ea85-79f4-4f64-94e6-9d9de3ea62af None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:11.487549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01ea85-79f4-4f64-94e6-9d9de3ea62af None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:11.494405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e7a55-dca2-4308-8ba5-12e6feef992a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:11.495474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e7a55-dca2-4308-8ba5-12e6feef992a service swift] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:11.495856 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e7a55-dca2-4308-8ba5-12e6feef992a service swift] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:11.496273 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e7a55-dca2-4308-8ba5-12e6feef992a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:11.506248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e7a55-dca2-4308-8ba5-12e6feef992a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:11.507836 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e7a55-dca2-4308-8ba5-12e6feef992a service swift] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:11.516364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1252/2478] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:15:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:15:35.146498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f74d5-1d32-4d73-83e4-88129eb67081 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:35.147874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-fc2f74d5-1d32-4d73-83e4-88129eb67081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:35.220103 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f74d5-1d32-4d73-83e4-88129eb67081 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:35.224634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:35.225499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:35.225776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:35.226048 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] PATH_INFO: `/v3/users/9023ed3150df41ad90aca2928ab30351` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:35.227243 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9023ed3150df41ad90aca2928ab30351)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:35.229176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:35.273143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9023ed3150df41ad90aca2928ab30351'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:35.279989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9023ed3150df41ad90aca2928ab30351'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:35.286622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9023ed3150df41ad90aca2928ab30351'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:35.287264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9023ed3150df41ad90aca2928ab30351'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:35.287859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9023ed3150df41ad90aca2928ab30351'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:35.304452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1227/2479] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:15:35 2022] DELETE /identity/v3/users/9023ed3150df41ad90aca2928ab30351 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:15:35.309025 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaae4e0-1534-4c70-beaf-982c806faf03 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:35.309567 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaae4e0-1534-4c70-beaf-982c806faf03 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:35.309567 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaae4e0-1534-4c70-beaf-982c806faf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:35.327182 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-dfaae4e0-1534-4c70-beaf-982c806faf03 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:15:35.328428 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-dfaae4e0-1534-4c70-beaf-982c806faf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:35.385427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1253/2480] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:15:35.394924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:35.396963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:35.451808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a65cd2-3a9f-453a-a399-a77e72cb89dc admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:35.455482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc3f1c-662b-4d98-83d4-f50cb4854e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:35.456135 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc3f1c-662b-4d98-83d4-f50cb4854e47 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:35.456418 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc3f1c-662b-4d98-83d4-f50cb4854e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:35.456690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc3f1c-662b-4d98-83d4-f50cb4854e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:35.465969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc3f1c-662b-4d98-83d4-f50cb4854e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:35.467382 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc3f1c-662b-4d98-83d4-f50cb4854e47 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:35.476488 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1228/2481] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:15:35.733307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaae4e0-1534-4c70-beaf-982c806faf03 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:35.735623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-dfaae4e0-1534-4c70-beaf-982c806faf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:35.748835 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaae4e0-1534-4c70-beaf-982c806faf03 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:35.754259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15a4ab-cc51-4958-a15d-eeec653c7855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:35.755724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15a4ab-cc51-4958-a15d-eeec653c7855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:35.755999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15a4ab-cc51-4958-a15d-eeec653c7855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:35.756305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15a4ab-cc51-4958-a15d-eeec653c7855 admin admin] PATH_INFO: `/v3/projects/878f03511c5f4139834201c1a12018a0` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:35.757491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15a4ab-cc51-4958-a15d-eeec653c7855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=878f03511c5f4139834201c1a12018a0)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:35.759384 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15a4ab-cc51-4958-a15d-eeec653c7855 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:35.804233 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-da15a4ab-cc51-4958-a15d-eeec653c7855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '878f03511c5f4139834201c1a12018a0', 'request_id': 'req-da15a4ab-cc51-4958-a15d-eeec653c7855'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:35.810827 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-da15a4ab-cc51-4958-a15d-eeec653c7855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '878f03511c5f4139834201c1a12018a0', 'request_id': 'req-da15a4ab-cc51-4958-a15d-eeec653c7855'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:35.816204 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-da15a4ab-cc51-4958-a15d-eeec653c7855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '878f03511c5f4139834201c1a12018a0', 'request_id': 'req-da15a4ab-cc51-4958-a15d-eeec653c7855'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:35.827196 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-da15a4ab-cc51-4958-a15d-eeec653c7855 admin admin] The token cache is being invalidate because project 878f03511c5f4139834201c1a12018a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:15:35.827476 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-da15a4ab-cc51-4958-a15d-eeec653c7855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:35.828108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-da15a4ab-cc51-4958-a15d-eeec653c7855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:35.829636 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1254/2482] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:15:35 2022] DELETE /identity/v3/projects/878f03511c5f4139834201c1a12018a0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:15:35.834546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f4183-a2c4-41ee-8310-7890fee0dee5 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:35.834839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f4183-a2c4-41ee-8310-7890fee0dee5 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:35.835116 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f4183-a2c4-41ee-8310-7890fee0dee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:35.852222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-630f4183-a2c4-41ee-8310-7890fee0dee5 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:15:35.853411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-630f4183-a2c4-41ee-8310-7890fee0dee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:35.910014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1229/2483] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:15:35.917467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc463f-1d2a-40da-b13a-44982d73a3bf None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:35.917751 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc463f-1d2a-40da-b13a-44982d73a3bf None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:35.918024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc463f-1d2a-40da-b13a-44982d73a3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:35.936477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-5bbc463f-1d2a-40da-b13a-44982d73a3bf None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:15:35.937646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5bbc463f-1d2a-40da-b13a-44982d73a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:35.945962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1255/2484] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:15:35.950028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f4183-a2c4-41ee-8310-7890fee0dee5 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:35.959462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f4183-a2c4-41ee-8310-7890fee0dee5 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:35.963997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6dde9-6be1-4126-9297-c774fb5366a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:35.964695 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6dde9-6be1-4126-9297-c774fb5366a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:35.964978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6dde9-6be1-4126-9297-c774fb5366a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:35.965253 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6dde9-6be1-4126-9297-c774fb5366a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:35.965973 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6dde9-6be1-4126-9297-c774fb5366a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:15:35.966275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6dde9-6be1-4126-9297-c774fb5366a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:35.967849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6dde9-6be1-4126-9297-c774fb5366a0 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:35.979376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1230/2485] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:15:35.983180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc463f-1d2a-40da-b13a-44982d73a3bf None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:35.992586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc463f-1d2a-40da-b13a-44982d73a3bf None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:35.997285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4d564-953b-40a4-9cf8-ba7c00b41c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:35.997919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4d564-953b-40a4-9cf8-ba7c00b41c5e admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:35.998198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4d564-953b-40a4-9cf8-ba7c00b41c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:35.998468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4d564-953b-40a4-9cf8-ba7c00b41c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:35.999157 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4d564-953b-40a4-9cf8-ba7c00b41c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:36.001076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4d564-953b-40a4-9cf8-ba7c00b41c5e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:36.029840 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1256/2486] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:15:35 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:15:36.031028 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6dde9-6be1-4126-9297-c774fb5366a0 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:36.041702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6dde9-6be1-4126-9297-c774fb5366a0 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:36.095946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78398a7-ce41-432b-9c57-1b5bd0aa4f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:36.096665 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78398a7-ce41-432b-9c57-1b5bd0aa4f82 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:36.096952 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78398a7-ce41-432b-9c57-1b5bd0aa4f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:36.097228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78398a7-ce41-432b-9c57-1b5bd0aa4f82 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:36.097941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78398a7-ce41-432b-9c57-1b5bd0aa4f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:36.100394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78398a7-ce41-432b-9c57-1b5bd0aa4f82 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:36.123147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1231/2487] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:15:36 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:15:36.127188 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4d564-953b-40a4-9cf8-ba7c00b41c5e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:36.137187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4d564-953b-40a4-9cf8-ba7c00b41c5e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:36.144530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e4bc0-e5e4-4a9f-83f8-5c3a7d0127ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:36.145237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4bc0-e5e4-4a9f-83f8-5c3a7d0127ac admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:36.145521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4bc0-e5e4-4a9f-83f8-5c3a7d0127ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:36.145919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4bc0-e5e4-4a9f-83f8-5c3a7d0127ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:36.146651 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e4bc0-e5e4-4a9f-83f8-5c3a7d0127ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:36.148260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e4bc0-e5e4-4a9f-83f8-5c3a7d0127ac admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:36.161633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1257/2488] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:15:36.163479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78398a7-ce41-432b-9c57-1b5bd0aa4f82 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:36.173162 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78398a7-ce41-432b-9c57-1b5bd0aa4f82 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:36.178681 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80b760-f920-4bfd-b6e4-3f829fda5148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:36.179328 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80b760-f920-4bfd-b6e4-3f829fda5148 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:36.179612 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80b760-f920-4bfd-b6e4-3f829fda5148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:36.179906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80b760-f920-4bfd-b6e4-3f829fda5148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:36.180776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80b760-f920-4bfd-b6e4-3f829fda5148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:36.182347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80b760-f920-4bfd-b6e4-3f829fda5148 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:36.192461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1232/2489] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:15:36.196332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e4bc0-e5e4-4a9f-83f8-5c3a7d0127ac admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:36.205730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e4bc0-e5e4-4a9f-83f8-5c3a7d0127ac admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:36.210334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abde50-b85c-4107-b892-ba8c0bc7209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:36.211212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abde50-b85c-4107-b892-ba8c0bc7209f admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:36.211499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abde50-b85c-4107-b892-ba8c0bc7209f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:36.211833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abde50-b85c-4107-b892-ba8c0bc7209f admin admin] PATH_INFO: `/v3/projects/a9e680d6732a4716a45431e7be158803/users/0cb3de0903384e77bd8869bba3da5b4f/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:36.227482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abde50-b85c-4107-b892-ba8c0bc7209f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e680d6732a4716a45431e7be158803, user_id=0cb3de0903384e77bd8869bba3da5b4f, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:36.231532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abde50-b85c-4107-b892-ba8c0bc7209f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:36.245073 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1258/2490] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:15:36 2022] PUT /identity/v3/projects/a9e680d6732a4716a45431e7be158803/users/0cb3de0903384e77bd8869bba3da5b4f/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:15:36.255898 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26736989-7030-4742-839e-7936e9b6ae9a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:36.256212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26736989-7030-4742-839e-7936e9b6ae9a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:36.256487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26736989-7030-4742-839e-7936e9b6ae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:36.283212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-26736989-7030-4742-839e-7936e9b6ae9a None None] MFA Rules not processed for user `0cb3de0903384e77bd8869bba3da5b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:15:36.284487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-26736989-7030-4742-839e-7936e9b6ae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:36.346609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1233/2491] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:15:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:15:36.357579 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abde50-b85c-4107-b892-ba8c0bc7209f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:36.359241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f3abde50-b85c-4107-b892-ba8c0bc7209f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:36.413684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abde50-b85c-4107-b892-ba8c0bc7209f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:36.417269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f482cf-665f-4d5c-9fe2-8ebe7c94da80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:36.417904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f482cf-665f-4d5c-9fe2-8ebe7c94da80 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:36.418187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f482cf-665f-4d5c-9fe2-8ebe7c94da80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:36.418461 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f482cf-665f-4d5c-9fe2-8ebe7c94da80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:36.426508 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f482cf-665f-4d5c-9fe2-8ebe7c94da80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:36.428224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f482cf-665f-4d5c-9fe2-8ebe7c94da80 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:36.436696 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1259/2492] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:15:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:15:47.367164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26736989-7030-4742-839e-7936e9b6ae9a None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:47.426919 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26736989-7030-4742-839e-7936e9b6ae9a None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:47.431410 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:47.432284 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:47.432563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:47.432832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] PATH_INFO: `/v3/users/0cb3de0903384e77bd8869bba3da5b4f` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:47.433987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb3de0903384e77bd8869bba3da5b4f)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:47.435868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:47.479070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb3de0903384e77bd8869bba3da5b4f'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:47.485185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb3de0903384e77bd8869bba3da5b4f'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:47.491725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb3de0903384e77bd8869bba3da5b4f'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:47.492401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb3de0903384e77bd8869bba3da5b4f'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:47.493012 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb3de0903384e77bd8869bba3da5b4f'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:47.509679 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1234/2493] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:15:47 2022] DELETE /identity/v3/users/0cb3de0903384e77bd8869bba3da5b4f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:15:47.514272 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1188d5-afa0-4a82-9221-5bb56b948ef4 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:47.514785 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1188d5-afa0-4a82-9221-5bb56b948ef4 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:47.514892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1188d5-afa0-4a82-9221-5bb56b948ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:47.531834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-4d1188d5-afa0-4a82-9221-5bb56b948ef4 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:15:47.533039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4d1188d5-afa0-4a82-9221-5bb56b948ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:47.588393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1260/2494] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:15:47.598618 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:47.600250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:47.656379 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd68599-e176-4d00-aed3-6c28965573de admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:47.660022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619652-2052-49f3-864a-be9c7185ff76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:47.660684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619652-2052-49f3-864a-be9c7185ff76 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:47.660964 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619652-2052-49f3-864a-be9c7185ff76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:47.661242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619652-2052-49f3-864a-be9c7185ff76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:47.670068 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8619652-2052-49f3-864a-be9c7185ff76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:47.671486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8619652-2052-49f3-864a-be9c7185ff76 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:47.681431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1235/2495] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:15:47.930961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1188d5-afa0-4a82-9221-5bb56b948ef4 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:47.932424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4d1188d5-afa0-4a82-9221-5bb56b948ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:47.944058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1188d5-afa0-4a82-9221-5bb56b948ef4 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:47.948897 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:47.949750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:47.950025 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:47.950321 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46 admin admin] PATH_INFO: `/v3/projects/a9e680d6732a4716a45431e7be158803` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:47.951492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e680d6732a4716a45431e7be158803)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:47.953398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:47.998115 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e680d6732a4716a45431e7be158803', 'request_id': 'req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:48.005082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e680d6732a4716a45431e7be158803', 'request_id': 'req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:48.010418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e680d6732a4716a45431e7be158803', 'request_id': 'req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:48.020993 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46 admin admin] The token cache is being invalidate because project a9e680d6732a4716a45431e7be158803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:15:48.021133 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:48.021832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-59dbe4d1-d1e8-4fc5-8703-aba73abb1f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:15:48.023377 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1261/2496] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:15:47 2022] DELETE /identity/v3/projects/a9e680d6732a4716a45431e7be158803 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:15:50.802762 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619652-2052-49f3-864a-be9c7185ff76 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:15:50.804202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d8619652-2052-49f3-864a-be9c7185ff76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:50.814986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619652-2052-49f3-864a-be9c7185ff76 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:15:50.861724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b7eee-8789-49e1-97a7-076edf34df18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:15:50.862358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b7eee-8789-49e1-97a7-076edf34df18 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:15:50.862638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b7eee-8789-49e1-97a7-076edf34df18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:15:50.862911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b7eee-8789-49e1-97a7-076edf34df18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:15:50.864697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6f2b7eee-8789-49e1-97a7-076edf34df18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:15:50.923413 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b7eee-8789-49e1-97a7-076edf34df18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:15:50.924878 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b7eee-8789-49e1-97a7-076edf34df18 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:15:50.934542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1236/2497] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:15:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:12.336436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94226015-65fd-4924-96fb-1fe78dfb9219 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:12.336915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94226015-65fd-4924-96fb-1fe78dfb9219 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:12.337009 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94226015-65fd-4924-96fb-1fe78dfb9219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:12.355162 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-94226015-65fd-4924-96fb-1fe78dfb9219 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:16:12.356372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-94226015-65fd-4924-96fb-1fe78dfb9219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:12.408828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1262/2498] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:16:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:16:12.448339 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b7eee-8789-49e1-97a7-076edf34df18 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:12.449719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6f2b7eee-8789-49e1-97a7-076edf34df18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:12.514490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b7eee-8789-49e1-97a7-076edf34df18 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:12.519976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1efc0-9a60-452f-ac21-0ea0eed5c423 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:12.520658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1efc0-9a60-452f-ac21-0ea0eed5c423 service swift] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:12.520942 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1efc0-9a60-452f-ac21-0ea0eed5c423 service swift] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:12.521739 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1efc0-9a60-452f-ac21-0ea0eed5c423 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:12.530115 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1efc0-9a60-452f-ac21-0ea0eed5c423 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:12.531673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1efc0-9a60-452f-ac21-0ea0eed5c423 service swift] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:12.540152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1237/2499] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:16:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:16:24.508526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94226015-65fd-4924-96fb-1fe78dfb9219 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:24.510065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-94226015-65fd-4924-96fb-1fe78dfb9219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:24.521217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94226015-65fd-4924-96fb-1fe78dfb9219 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:24.525330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa315e6-17f3-4c13-8987-f052a16fa527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:24.525957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa315e6-17f3-4c13-8987-f052a16fa527 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:24.526257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa315e6-17f3-4c13-8987-f052a16fa527 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:24.526531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa315e6-17f3-4c13-8987-f052a16fa527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:24.528283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-daa315e6-17f3-4c13-8987-f052a16fa527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:24.607017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa315e6-17f3-4c13-8987-f052a16fa527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:24.608459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa315e6-17f3-4c13-8987-f052a16fa527 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:24.629982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1263/2500] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:16:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:25.802629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1efc0-9a60-452f-ac21-0ea0eed5c423 service swift] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:25.804592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-83f1efc0-9a60-452f-ac21-0ea0eed5c423 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:25.816191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1efc0-9a60-452f-ac21-0ea0eed5c423 service swift] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:25.820375 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e64ff0-a307-415d-bb1c-358c1f2ff4cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:25.820995 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e64ff0-a307-415d-bb1c-358c1f2ff4cc service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:25.821273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e64ff0-a307-415d-bb1c-358c1f2ff4cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:25.821548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e64ff0-a307-415d-bb1c-358c1f2ff4cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:25.823247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-51e64ff0-a307-415d-bb1c-358c1f2ff4cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:25.835852 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e64ff0-a307-415d-bb1c-358c1f2ff4cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:25.837302 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e64ff0-a307-415d-bb1c-358c1f2ff4cc service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:25.848367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1238/2501] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:16:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:27.584191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa315e6-17f3-4c13-8987-f052a16fa527 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:27.592393 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa315e6-17f3-4c13-8987-f052a16fa527 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:27.595977 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daec941-5d46-47ee-a977-62852f64dcdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:27.596636 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daec941-5d46-47ee-a977-62852f64dcdb service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:27.596918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daec941-5d46-47ee-a977-62852f64dcdb service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:27.597189 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daec941-5d46-47ee-a977-62852f64dcdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:27.598970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-7daec941-5d46-47ee-a977-62852f64dcdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:27.609263 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daec941-5d46-47ee-a977-62852f64dcdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:27.610661 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daec941-5d46-47ee-a977-62852f64dcdb service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:27.619406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1264/2502] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:16:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:27.718476 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386498e-f601-4b88-a62c-10319d1416b9 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:27.719027 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386498e-f601-4b88-a62c-10319d1416b9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:27.719133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386498e-f601-4b88-a62c-10319d1416b9 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:27.720478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1239/2503] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 09:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:16:27.727514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db6bd3-c53f-4be9-af1f-ddeb2d9e4fcb None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:27.727805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db6bd3-c53f-4be9-af1f-ddeb2d9e4fcb None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:27.728105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db6bd3-c53f-4be9-af1f-ddeb2d9e4fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:27.764582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-35db6bd3-c53f-4be9-af1f-ddeb2d9e4fcb None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:16:27.765789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-35db6bd3-c53f-4be9-af1f-ddeb2d9e4fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:27.775357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1265/2504] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 09:16:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:16:27.788836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386498e-f601-4b88-a62c-10319d1416b9 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:27.790599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f386498e-f601-4b88-a62c-10319d1416b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:27.850443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386498e-f601-4b88-a62c-10319d1416b9 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:27.853955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2f407-f43f-4b1d-b7b2-204f56575214 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1848679bce324613b4a92de808165ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:27.854587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2f407-f43f-4b1d-b7b2-204f56575214 service glance] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:27.854864 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2f407-f43f-4b1d-b7b2-204f56575214 service glance] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:27.855136 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2f407-f43f-4b1d-b7b2-204f56575214 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:27.864909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2f407-f43f-4b1d-b7b2-204f56575214 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:27.866918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2f407-f43f-4b1d-b7b2-204f56575214 service glance] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:27.877272 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1240/2505] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:16:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:16:27.941948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b8b4c-81bb-4695-bfd6-4d1255c5aca1 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:27.942253 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b8b4c-81bb-4695-bfd6-4d1255c5aca1 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:27.942523 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b8b4c-81bb-4695-bfd6-4d1255c5aca1 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:27.943881 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1266/2506] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 09:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:16:27.948469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5efc5-d2bc-403f-945c-9f349aa3342a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:27.948757 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5efc5-d2bc-403f-945c-9f349aa3342a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:27.949036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5efc5-d2bc-403f-945c-9f349aa3342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:27.968982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-36b5efc5-d2bc-403f-945c-9f349aa3342a None None] MFA Rules not processed for user `418178b7e70f47d291e239a1297ccf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:16:27.970259 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-36b5efc5-d2bc-403f-945c-9f349aa3342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:27.977388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1241/2507] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 09:16:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:16:27.988945 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b8b4c-81bb-4695-bfd6-4d1255c5aca1 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:27.999721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b8b4c-81bb-4695-bfd6-4d1255c5aca1 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:28.003307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540af3d-1bf6-49a7-a7a4-75002213cc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:28.003923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540af3d-1bf6-49a7-a7a4-75002213cc51 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:28.004227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540af3d-1bf6-49a7-a7a4-75002213cc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:28.004498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540af3d-1bf6-49a7-a7a4-75002213cc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:28.011180 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540af3d-1bf6-49a7-a7a4-75002213cc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:28.012604 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540af3d-1bf6-49a7-a7a4-75002213cc51 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:28.019971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1267/2508] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:16:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:28.100658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0462b-4ee5-411d-af37-064efc8ada77 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:28.100943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0462b-4ee5-411d-af37-064efc8ada77 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:28.101239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0462b-4ee5-411d-af37-064efc8ada77 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:28.102616 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1242/2509] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 09:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:16:28.107712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d9ddd-9fc2-443d-aa18-4ccbd0c61b26 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:28.107996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d9ddd-9fc2-443d-aa18-4ccbd0c61b26 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:28.108305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d9ddd-9fc2-443d-aa18-4ccbd0c61b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:28.126200 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-6a7d9ddd-9fc2-443d-aa18-4ccbd0c61b26 None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:16:28.127445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6a7d9ddd-9fc2-443d-aa18-4ccbd0c61b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:28.136582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1268/2510] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 09:16:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:16:28.146522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0462b-4ee5-411d-af37-064efc8ada77 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:28.157588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0462b-4ee5-411d-af37-064efc8ada77 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:28.161080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97901795-3b49-4668-ab0e-02cd6c754ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:28.161687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97901795-3b49-4668-ab0e-02cd6c754ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:28.161963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97901795-3b49-4668-ab0e-02cd6c754ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:28.162827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97901795-3b49-4668-ab0e-02cd6c754ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:28.172698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97901795-3b49-4668-ab0e-02cd6c754ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:28.174105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97901795-3b49-4668-ab0e-02cd6c754ef2 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:28.184659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1243/2511] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:16:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:31.035744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6cdab-a6f0-4ce3-ac7b-0a240dca2ace None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:31.036257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6cdab-a6f0-4ce3-ac7b-0a240dca2ace None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:31.036352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6cdab-a6f0-4ce3-ac7b-0a240dca2ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:31.054526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f8c6cdab-a6f0-4ce3-ac7b-0a240dca2ace None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:16:31.055717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f8c6cdab-a6f0-4ce3-ac7b-0a240dca2ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:31.063049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1269/2512] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:16:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:16:31.074738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97901795-3b49-4668-ab0e-02cd6c754ef2 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:31.086182 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97901795-3b49-4668-ab0e-02cd6c754ef2 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:31.091104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7afb9b-e92b-4d3e-bef7-f3c9f8d14c8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:31.091738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7afb9b-e92b-4d3e-bef7-f3c9f8d14c8d service swift] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:31.092017 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7afb9b-e92b-4d3e-bef7-f3c9f8d14c8d service swift] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:31.092392 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7afb9b-e92b-4d3e-bef7-f3c9f8d14c8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:31.100958 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7afb9b-e92b-4d3e-bef7-f3c9f8d14c8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:31.102521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7afb9b-e92b-4d3e-bef7-f3c9f8d14c8d service swift] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:31.110473 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1244/2513] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:16:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:16:34.898698 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6cdab-a6f0-4ce3-ac7b-0a240dca2ace None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:34.908633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6cdab-a6f0-4ce3-ac7b-0a240dca2ace None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:34.912749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b9f30-2006-48b7-bbbb-e8fa4e8d534d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:34.913391 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b9f30-2006-48b7-bbbb-e8fa4e8d534d service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:34.913667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b9f30-2006-48b7-bbbb-e8fa4e8d534d service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:34.913936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b9f30-2006-48b7-bbbb-e8fa4e8d534d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:34.915823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a82b9f30-2006-48b7-bbbb-e8fa4e8d534d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:34.983993 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b9f30-2006-48b7-bbbb-e8fa4e8d534d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:34.985523 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b9f30-2006-48b7-bbbb-e8fa4e8d534d service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:34.995133 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1270/2514] 10.222.0.23 () {60 vars in 1396 bytes} [Tue May 3 09:16:34 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:44.211081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7afb9b-e92b-4d3e-bef7-f3c9f8d14c8d service swift] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:44.220673 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7afb9b-e92b-4d3e-bef7-f3c9f8d14c8d service swift] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:44.225438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d13e7-f025-47d9-b6c0-ce817cb45fe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:44.226090 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d13e7-f025-47d9-b6c0-ce817cb45fe4 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:44.226386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d13e7-f025-47d9-b6c0-ce817cb45fe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:44.226663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d13e7-f025-47d9-b6c0-ce817cb45fe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:44.229063 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a74d13e7-f025-47d9-b6c0-ce817cb45fe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:44.238292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d13e7-f025-47d9-b6c0-ce817cb45fe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:44.240400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d13e7-f025-47d9-b6c0-ce817cb45fe4 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:44.248228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1245/2515] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:16:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:53.910944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b9f30-2006-48b7-bbbb-e8fa4e8d534d service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:53.913023 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a82b9f30-2006-48b7-bbbb-e8fa4e8d534d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:53.929147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b9f30-2006-48b7-bbbb-e8fa4e8d534d service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:53.934499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243bab2-adc9-408e-b107-ee707c5e21dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:53.935125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243bab2-adc9-408e-b107-ee707c5e21dc service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:53.935405 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243bab2-adc9-408e-b107-ee707c5e21dc service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:53.935678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243bab2-adc9-408e-b107-ee707c5e21dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:53.937387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3243bab2-adc9-408e-b107-ee707c5e21dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:53.992397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243bab2-adc9-408e-b107-ee707c5e21dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:53.993905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243bab2-adc9-408e-b107-ee707c5e21dc service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:54.002555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1271/2516] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:16:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:16:58.462274 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12de9-849d-4a6d-a894-48a37fa6f862 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:58.462741 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12de9-849d-4a6d-a894-48a37fa6f862 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:58.462860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12de9-849d-4a6d-a894-48a37fa6f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:58.480003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-55c12de9-849d-4a6d-a894-48a37fa6f862 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:16:58.481164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-55c12de9-849d-4a6d-a894-48a37fa6f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:16:58.488675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1246/2517] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 3 09:16:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:16:58.500981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243bab2-adc9-408e-b107-ee707c5e21dc service nova] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:16:58.512488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243bab2-adc9-408e-b107-ee707c5e21dc service nova] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:16:58.517410 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1de71-4b03-4f5d-b702-5e05f5026081 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:16:58.518039 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1de71-4b03-4f5d-b702-5e05f5026081 service swift] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:16:58.518325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1de71-4b03-4f5d-b702-5e05f5026081 service swift] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:16:58.518596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1de71-4b03-4f5d-b702-5e05f5026081 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:16:58.527192 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1de71-4b03-4f5d-b702-5e05f5026081 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:16:58.528759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1de71-4b03-4f5d-b702-5e05f5026081 service swift] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:16:58.536519 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1272/2518] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:16:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:17:18.400606 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9ef1b-465a-4327-a264-e4b8640f2eea None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:17:18.401154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9ef1b-465a-4327-a264-e4b8640f2eea None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:17:18.401154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9ef1b-465a-4327-a264-e4b8640f2eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:17:18.417957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f2f9ef1b-465a-4327-a264-e4b8640f2eea None None] MFA Rules not processed for user `1e4b30ac01a84009b41f6c83de99cfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:17:18.419144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f2f9ef1b-465a-4327-a264-e4b8640f2eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:17:18.426482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1247/2519] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:17:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:17:24.816354 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1de71-4b03-4f5d-b702-5e05f5026081 service swift] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:17:24.829308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1de71-4b03-4f5d-b702-5e05f5026081 service swift] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:17:24.836164 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e925e6f-e0db-4b3c-b47f-f0030f969175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:17:24.837257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e925e6f-e0db-4b3c-b47f-f0030f969175 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:17:24.837542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e925e6f-e0db-4b3c-b47f-f0030f969175 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:17:24.838262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e925e6f-e0db-4b3c-b47f-f0030f969175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:17:24.840212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3e925e6f-e0db-4b3c-b47f-f0030f969175 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:17:24.853330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e925e6f-e0db-4b3c-b47f-f0030f969175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:17:24.854991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e925e6f-e0db-4b3c-b47f-f0030f969175 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:17:24.867780 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1273/2520] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:17:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:17:57.333999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9ef1b-465a-4327-a264-e4b8640f2eea None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:17:57.345537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9ef1b-465a-4327-a264-e4b8640f2eea None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:17:57.351152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058273e-7164-48ab-af7e-f30bfd788950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:17:57.352313 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058273e-7164-48ab-af7e-f30bfd788950 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:17:57.352604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058273e-7164-48ab-af7e-f30bfd788950 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:17:57.352875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058273e-7164-48ab-af7e-f30bfd788950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:17:57.354670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e058273e-7164-48ab-af7e-f30bfd788950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:17:57.364428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058273e-7164-48ab-af7e-f30bfd788950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:17:57.365895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058273e-7164-48ab-af7e-f30bfd788950 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:17:57.373736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1248/2521] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:17:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:17:58.483132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381dc3-31a2-4bd3-b163-e78a01ab90d3 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:17:58.483662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381dc3-31a2-4bd3-b163-e78a01ab90d3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:17:58.483662 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381dc3-31a2-4bd3-b163-e78a01ab90d3 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:17:58.485171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1274/2522] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 09:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:17:58.491279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee5807-a1e5-472c-9258-6a79da0ecf15 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:17:58.491757 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee5807-a1e5-472c-9258-6a79da0ecf15 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:17:58.491980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee5807-a1e5-472c-9258-6a79da0ecf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:17:58.511614 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-21ee5807-a1e5-472c-9258-6a79da0ecf15 None None] MFA Rules not processed for user `418178b7e70f47d291e239a1297ccf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:17:58.512839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-21ee5807-a1e5-472c-9258-6a79da0ecf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:17:58.519411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1249/2523] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 09:17:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:17:58.535592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66381dc3-31a2-4bd3-b163-e78a01ab90d3 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:17:58.546237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66381dc3-31a2-4bd3-b163-e78a01ab90d3 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:17:58.549956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783afe9-7359-41cb-95ae-867467add7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:17:58.550619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783afe9-7359-41cb-95ae-867467add7cd service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:17:58.550867 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783afe9-7359-41cb-95ae-867467add7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:17:58.551140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783afe9-7359-41cb-95ae-867467add7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:17:58.558962 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783afe9-7359-41cb-95ae-867467add7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:17:58.560404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783afe9-7359-41cb-95ae-867467add7cd service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:17:58.568145 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1275/2524] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:17:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:17:59.677702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d71f6-fbee-45b7-9ac7-420f77a18ae9 None None] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:17:59.678173 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d71f6-fbee-45b7-9ac7-420f77a18ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:17:59.678386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d71f6-fbee-45b7-9ac7-420f77a18ae9 None None] PATH_INFO: `/` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:17:59.679853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1250/2525] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 09:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:17:59.685906 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51a2fd-61bd-4349-8974-a6dac0527923 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:17:59.686372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51a2fd-61bd-4349-8974-a6dac0527923 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:17:59.686477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51a2fd-61bd-4349-8974-a6dac0527923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:17:59.704868 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-5b51a2fd-61bd-4349-8974-a6dac0527923 None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:17:59.706309 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5b51a2fd-61bd-4349-8974-a6dac0527923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:17:59.715746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1276/2526] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 09:17:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:17:59.726426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d71f6-fbee-45b7-9ac7-420f77a18ae9 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:17:59.737986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d71f6-fbee-45b7-9ac7-420f77a18ae9 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:17:59.741568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42082b07-b7ad-49ea-b0c0-7d6f729516f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:17:59.742291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082b07-b7ad-49ea-b0c0-7d6f729516f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:17:59.742586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082b07-b7ad-49ea-b0c0-7d6f729516f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:17:59.743592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082b07-b7ad-49ea-b0c0-7d6f729516f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:17:59.754123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42082b07-b7ad-49ea-b0c0-7d6f729516f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:17:59.755764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42082b07-b7ad-49ea-b0c0-7d6f729516f3 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:17:59.767369 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1251/2527] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:17:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:17:59.830539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51a2fd-61bd-4349-8974-a6dac0527923 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:17:59.834111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42082b07-b7ad-49ea-b0c0-7d6f729516f3 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:17:59.835713 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-42082b07-b7ad-49ea-b0c0-7d6f729516f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:17:59.842225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51a2fd-61bd-4349-8974-a6dac0527923 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:17:59.847999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82926d2e-2404-4d43-a576-873a9b706911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:17:59.848864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82926d2e-2404-4d43-a576-873a9b706911 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:17:59.849147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82926d2e-2404-4d43-a576-873a9b706911 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:17:59.849601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82926d2e-2404-4d43-a576-873a9b706911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:17:59.851374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-82926d2e-2404-4d43-a576-873a9b706911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:17:59.864353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82926d2e-2404-4d43-a576-873a9b706911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:17:59.865998 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82926d2e-2404-4d43-a576-873a9b706911 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:17:59.877577 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1277/2528] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:17:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:17:59.909989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42082b07-b7ad-49ea-b0c0-7d6f729516f3 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:17:59.915471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f22d4f-7c07-4321-b0c1-6d8cf95be09d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7f2aea3e494546a04e20d8cedccc9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:17:59.916130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f22d4f-7c07-4321-b0c1-6d8cf95be09d service placement] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:17:59.916414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f22d4f-7c07-4321-b0c1-6d8cf95be09d service placement] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:17:59.916685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f22d4f-7c07-4321-b0c1-6d8cf95be09d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:17:59.918591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a4f22d4f-7c07-4321-b0c1-6d8cf95be09d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:17:59.931383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f22d4f-7c07-4321-b0c1-6d8cf95be09d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:17:59.932971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f22d4f-7c07-4321-b0c1-6d8cf95be09d service placement] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:17:59.942490 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1252/2529] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:17:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:18:04.325557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82926d2e-2404-4d43-a576-873a9b706911 service nova] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:04.336109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82926d2e-2404-4d43-a576-873a9b706911 service nova] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:04.342281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c71b2-c60b-4afb-a745-0315758ef1be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:04.342913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c71b2-c60b-4afb-a745-0315758ef1be service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:04.343198 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c71b2-c60b-4afb-a745-0315758ef1be service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:04.343477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c71b2-c60b-4afb-a745-0315758ef1be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:04.345300 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-671c71b2-c60b-4afb-a745-0315758ef1be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:04.403992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c71b2-c60b-4afb-a745-0315758ef1be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:04.405586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c71b2-c60b-4afb-a745-0315758ef1be service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:04.414406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1278/2530] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:18:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:18:16.932275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f603-2b29-4e16-97ce-5bca582f202c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:16.932823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f603-2b29-4e16-97ce-5bca582f202c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:16.932823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f603-2b29-4e16-97ce-5bca582f202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:16.949782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-e096f603-2b29-4e16-97ce-5bca582f202c None None] MFA Rules not processed for user `adc15a08f9f94c71bc1e0a092e1b7818`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:18:16.950953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e096f603-2b29-4e16-97ce-5bca582f202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:16.957659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1253/2531] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:18:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:18:48.836551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c71b2-c60b-4afb-a745-0315758ef1be service nova] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:48.846137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c71b2-c60b-4afb-a745-0315758ef1be service nova] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:48.849671 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7ac5d-7f8e-415e-a5d8-3d7d35742260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:48.850295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7ac5d-7f8e-415e-a5d8-3d7d35742260 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:48.850575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7ac5d-7f8e-415e-a5d8-3d7d35742260 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:48.850851 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7ac5d-7f8e-415e-a5d8-3d7d35742260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:48.852601 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-1cd7ac5d-7f8e-415e-a5d8-3d7d35742260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:48.913203 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7ac5d-7f8e-415e-a5d8-3d7d35742260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:48.914640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7ac5d-7f8e-415e-a5d8-3d7d35742260 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:48.927340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1279/2532] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:18:52.727653 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096f603-2b29-4e16-97ce-5bca582f202c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:52.729110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e096f603-2b29-4e16-97ce-5bca582f202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:52.742609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096f603-2b29-4e16-97ce-5bca582f202c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:52.747835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a39fda-0422-4cf6-bc88-f5c32587a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:52.748736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39fda-0422-4cf6-bc88-f5c32587a426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:52.749017 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39fda-0422-4cf6-bc88-f5c32587a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:52.749292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39fda-0422-4cf6-bc88-f5c32587a426 admin admin] PATH_INFO: `/v3/users/1e4b30ac01a84009b41f6c83de99cfb3` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:52.750498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39fda-0422-4cf6-bc88-f5c32587a426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4b30ac01a84009b41f6c83de99cfb3)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:52.752678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39fda-0422-4cf6-bc88-f5c32587a426 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:52.799784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-88a39fda-0422-4cf6-bc88-f5c32587a426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4b30ac01a84009b41f6c83de99cfb3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:18:52.806141 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-88a39fda-0422-4cf6-bc88-f5c32587a426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4b30ac01a84009b41f6c83de99cfb3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:18:52.814824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-88a39fda-0422-4cf6-bc88-f5c32587a426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4b30ac01a84009b41f6c83de99cfb3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:18:52.815145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-88a39fda-0422-4cf6-bc88-f5c32587a426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4b30ac01a84009b41f6c83de99cfb3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:18:52.816193 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-88a39fda-0422-4cf6-bc88-f5c32587a426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4b30ac01a84009b41f6c83de99cfb3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:18:52.837285 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1254/2533] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:18:52 2022] DELETE /identity/v3/users/1e4b30ac01a84009b41f6c83de99cfb3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:18:53.419364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7ac5d-7f8e-415e-a5d8-3d7d35742260 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:53.429265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7ac5d-7f8e-415e-a5d8-3d7d35742260 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:53.489204 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:53.490069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:53.490346 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:53.490617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf admin admin] PATH_INFO: `/v3/projects/7842b8edaf5847d387b8390dc4cf09b4` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:53.492013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7842b8edaf5847d387b8390dc4cf09b4)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:53.494229 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:53.539572 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7842b8edaf5847d387b8390dc4cf09b4', 'request_id': 'req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:18:53.548037 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7842b8edaf5847d387b8390dc4cf09b4', 'request_id': 'req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:18:53.553603 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7842b8edaf5847d387b8390dc4cf09b4', 'request_id': 'req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:18:53.564971 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf admin admin] The token cache is being invalidate because project 7842b8edaf5847d387b8390dc4cf09b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:18:53.565258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:18:53.565892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dd6e18a8-b96a-42a6-aa4f-f66aee502caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:18:53.567437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1280/2534] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:18:53 2022] DELETE /identity/v3/projects/7842b8edaf5847d387b8390dc4cf09b4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:18:53.572761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe373f-0d33-4ec1-96f0-86e919a7023f None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:53.573015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe373f-0d33-4ec1-96f0-86e919a7023f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:53.573290 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe373f-0d33-4ec1-96f0-86e919a7023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:53.591288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-41fe373f-0d33-4ec1-96f0-86e919a7023f None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:18:53.592530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-41fe373f-0d33-4ec1-96f0-86e919a7023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:53.651029 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1255/2535] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:18:53.658484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bd65c-061a-4313-9ed1-5a1d0e6b08b9 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:53.658844 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bd65c-061a-4313-9ed1-5a1d0e6b08b9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:53.659230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bd65c-061a-4313-9ed1-5a1d0e6b08b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:53.679315 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-684bd65c-061a-4313-9ed1-5a1d0e6b08b9 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:18:53.680626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-684bd65c-061a-4313-9ed1-5a1d0e6b08b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:53.689340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1281/2536] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:18:53.693656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe373f-0d33-4ec1-96f0-86e919a7023f None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:53.703483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe373f-0d33-4ec1-96f0-86e919a7023f None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:53.708249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9484c0-8638-4a14-830a-272f199336a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:53.708901 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9484c0-8638-4a14-830a-272f199336a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:53.709178 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9484c0-8638-4a14-830a-272f199336a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:53.709450 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9484c0-8638-4a14-830a-272f199336a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:53.710204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9484c0-8638-4a14-830a-272f199336a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:18:53.710505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9484c0-8638-4a14-830a-272f199336a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:53.712143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9484c0-8638-4a14-830a-272f199336a2 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:53.724195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1256/2537] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:18:53.727996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bd65c-061a-4313-9ed1-5a1d0e6b08b9 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:53.737761 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bd65c-061a-4313-9ed1-5a1d0e6b08b9 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:53.742348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f015b2-2af5-42f8-b354-cee93d5bc43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:53.742992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f015b2-2af5-42f8-b354-cee93d5bc43e admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:53.743266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f015b2-2af5-42f8-b354-cee93d5bc43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:53.743535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f015b2-2af5-42f8-b354-cee93d5bc43e admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:53.744250 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f015b2-2af5-42f8-b354-cee93d5bc43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:53.747007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f015b2-2af5-42f8-b354-cee93d5bc43e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:53.789127 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1282/2538] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:18:53 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:18:53.790832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9484c0-8638-4a14-830a-272f199336a2 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:53.801656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9484c0-8638-4a14-830a-272f199336a2 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:53.858814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de13f61-d6c8-431a-9b42-6741d30c5901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:53.859744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de13f61-d6c8-431a-9b42-6741d30c5901 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:53.860031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de13f61-d6c8-431a-9b42-6741d30c5901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:53.860450 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de13f61-d6c8-431a-9b42-6741d30c5901 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:53.861159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de13f61-d6c8-431a-9b42-6741d30c5901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:53.863073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de13f61-d6c8-431a-9b42-6741d30c5901 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:53.883818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1257/2539] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:18:53 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:18:53.888135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f015b2-2af5-42f8-b354-cee93d5bc43e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:53.898459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f015b2-2af5-42f8-b354-cee93d5bc43e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:53.903769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1590b3-9457-4ed3-8509-09ff5d3fe8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:53.904458 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1590b3-9457-4ed3-8509-09ff5d3fe8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:53.904740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1590b3-9457-4ed3-8509-09ff5d3fe8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:53.905013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1590b3-9457-4ed3-8509-09ff5d3fe8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:53.905781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1590b3-9457-4ed3-8509-09ff5d3fe8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:53.907388 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1590b3-9457-4ed3-8509-09ff5d3fe8d7 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:53.918930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1283/2540] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:18:53.922661 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de13f61-d6c8-431a-9b42-6741d30c5901 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:53.935097 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de13f61-d6c8-431a-9b42-6741d30c5901 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:53.940079 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69592c-0528-4543-88ce-ba839f8275aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:53.940920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69592c-0528-4543-88ce-ba839f8275aa admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:53.941233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69592c-0528-4543-88ce-ba839f8275aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:53.941504 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69592c-0528-4543-88ce-ba839f8275aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:53.942234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69592c-0528-4543-88ce-ba839f8275aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:53.943814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69592c-0528-4543-88ce-ba839f8275aa admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:53.957122 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1258/2541] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:18:53.961266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1590b3-9457-4ed3-8509-09ff5d3fe8d7 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:53.972276 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1590b3-9457-4ed3-8509-09ff5d3fe8d7 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:53.977085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59418c8-757a-4c7e-9693-cd33d781c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:53.978052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59418c8-757a-4c7e-9693-cd33d781c59e admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:53.978412 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59418c8-757a-4c7e-9693-cd33d781c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:53.978761 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59418c8-757a-4c7e-9693-cd33d781c59e admin admin] PATH_INFO: `/v3/projects/2c46713419c64f88b550ff6b057cdcc6/users/6c0e27f69f7944a7b1f42f71fb389ab2/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:53.994218 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59418c8-757a-4c7e-9693-cd33d781c59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c46713419c64f88b550ff6b057cdcc6, user_id=6c0e27f69f7944a7b1f42f71fb389ab2, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:53.997243 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59418c8-757a-4c7e-9693-cd33d781c59e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:54.011495 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1284/2542] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:18:53 2022] PUT /identity/v3/projects/2c46713419c64f88b550ff6b057cdcc6/users/6c0e27f69f7944a7b1f42f71fb389ab2/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:18:54.016718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5a515-b03a-4dbd-b09a-2bed65c4855c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:54.017011 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5a515-b03a-4dbd-b09a-2bed65c4855c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:54.017361 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5a515-b03a-4dbd-b09a-2bed65c4855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:54.035190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-52a5a515-b03a-4dbd-b09a-2bed65c4855c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:18:54.036414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-52a5a515-b03a-4dbd-b09a-2bed65c4855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:54.092439 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1259/2543] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:18:54.102007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59418c8-757a-4c7e-9693-cd33d781c59e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:54.103772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d59418c8-757a-4c7e-9693-cd33d781c59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:54.159743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59418c8-757a-4c7e-9693-cd33d781c59e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:54.163419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05ab06-8deb-4bd0-b718-3197eb35e641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:54.164065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05ab06-8deb-4bd0-b718-3197eb35e641 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:54.164371 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05ab06-8deb-4bd0-b718-3197eb35e641 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:54.164643 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05ab06-8deb-4bd0-b718-3197eb35e641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:54.174432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05ab06-8deb-4bd0-b718-3197eb35e641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:54.175846 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05ab06-8deb-4bd0-b718-3197eb35e641 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:54.185065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1285/2544] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:18:58.613686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d53e2f-e435-413a-aac9-00e41595088a None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:58.614760 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d53e2f-e435-413a-aac9-00e41595088a None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:58.615065 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d53e2f-e435-413a-aac9-00e41595088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:58.656373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-50d53e2f-e435-413a-aac9-00e41595088a None None] MFA Rules not processed for user `6c0e27f69f7944a7b1f42f71fb389ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:18:58.658563 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-50d53e2f-e435-413a-aac9-00e41595088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:58.733724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1260/2545] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:18:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:18:58.746728 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05ab06-8deb-4bd0-b718-3197eb35e641 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:18:58.748267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4d05ab06-8deb-4bd0-b718-3197eb35e641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:18:58.825991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05ab06-8deb-4bd0-b718-3197eb35e641 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:18:58.831530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f869b16-09f7-48c3-92ab-8b588aa850a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:18:58.832350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f869b16-09f7-48c3-92ab-8b588aa850a9 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:18:58.832629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f869b16-09f7-48c3-92ab-8b588aa850a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:18:58.832914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f869b16-09f7-48c3-92ab-8b588aa850a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:18:58.841262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f869b16-09f7-48c3-92ab-8b588aa850a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:18:58.842842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f869b16-09f7-48c3-92ab-8b588aa850a9 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:18:58.852609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1286/2546] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:18:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:19:00.989875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df48597-cab1-400e-8e0a-f7e35e2af6ee None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:00.990676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df48597-cab1-400e-8e0a-f7e35e2af6ee None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:00.991123 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df48597-cab1-400e-8e0a-f7e35e2af6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:01.023986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-6df48597-cab1-400e-8e0a-f7e35e2af6ee None None] MFA Rules not processed for user `6c0e27f69f7944a7b1f42f71fb389ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:19:01.025878 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6df48597-cab1-400e-8e0a-f7e35e2af6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:01.056435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1261/2547] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:19:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:19:02.372308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea743b98-5fb6-41a5-9dfa-a48e5e650b29 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:02.372818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea743b98-5fb6-41a5-9dfa-a48e5e650b29 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:02.373032 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea743b98-5fb6-41a5-9dfa-a48e5e650b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:02.396390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ea743b98-5fb6-41a5-9dfa-a48e5e650b29 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:19:02.397600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ea743b98-5fb6-41a5-9dfa-a48e5e650b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:02.454632 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1287/2548] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 3 09:19:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:19:02.514051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df48597-cab1-400e-8e0a-f7e35e2af6ee None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:02.515525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6df48597-cab1-400e-8e0a-f7e35e2af6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:02.585428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df48597-cab1-400e-8e0a-f7e35e2af6ee None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:02.590547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188df092-37c0-4af3-b973-ec960264c783 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:02.591203 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188df092-37c0-4af3-b973-ec960264c783 service swift] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:02.591487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188df092-37c0-4af3-b973-ec960264c783 service swift] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:02.591763 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188df092-37c0-4af3-b973-ec960264c783 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:02.600507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188df092-37c0-4af3-b973-ec960264c783 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:02.602160 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188df092-37c0-4af3-b973-ec960264c783 service swift] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:02.611622 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1262/2549] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:19:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:19:10.169518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea743b98-5fb6-41a5-9dfa-a48e5e650b29 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:10.170948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ea743b98-5fb6-41a5-9dfa-a48e5e650b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:10.185482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea743b98-5fb6-41a5-9dfa-a48e5e650b29 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:10.190380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:10.191253 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:10.191529 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:10.191801 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] PATH_INFO: `/v3/users/1777cac954d5400e86af7ece7a7ae05f` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:10.202059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1777cac954d5400e86af7ece7a7ae05f)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:10.203989 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:10.262118 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1777cac954d5400e86af7ece7a7ae05f'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.270333 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1777cac954d5400e86af7ece7a7ae05f'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.271150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1777cac954d5400e86af7ece7a7ae05f'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.271825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1777cac954d5400e86af7ece7a7ae05f'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.287052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1777cac954d5400e86af7ece7a7ae05f'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.303092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1288/2550] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:19:10 2022] DELETE /identity/v3/users/1777cac954d5400e86af7ece7a7ae05f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:19:10.590421 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188df092-37c0-4af3-b973-ec960264c783 service swift] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:10.602642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188df092-37c0-4af3-b973-ec960264c783 service swift] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:10.661457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:10.662307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:10.662587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:10.662855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] PATH_INFO: `/v3/projects/d637f953ac02425ca534eafe4fd59ff7` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:10.664019 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d637f953ac02425ca534eafe4fd59ff7)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:10.665955 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:10.709491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd637f953ac02425ca534eafe4fd59ff7', 'request_id': 'req-e96b655d-4d8b-453b-9916-84d141ab6f1d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.714654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd637f953ac02425ca534eafe4fd59ff7', 'request_id': 'req-e96b655d-4d8b-453b-9916-84d141ab6f1d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.722625 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd637f953ac02425ca534eafe4fd59ff7', 'request_id': 'req-e96b655d-4d8b-453b-9916-84d141ab6f1d'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.733615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] The token cache is being invalidate because project d637f953ac02425ca534eafe4fd59ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:19:10.733895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.734519 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.736122 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1263/2551] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:19:10 2022] DELETE /identity/v3/projects/d637f953ac02425ca534eafe4fd59ff7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:19:10.740680 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:10.742595 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:10.755668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3793f-ddac-4050-bd8f-2ec8db8bf9e0 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:10.810002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7987455-30d0-4013-82ec-d89af3505d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:10.810797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7987455-30d0-4013-82ec-d89af3505d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:10.811105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7987455-30d0-4013-82ec-d89af3505d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:10.811382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7987455-30d0-4013-82ec-d89af3505d31 admin admin] PATH_INFO: `/v3/users/34d01cd2f96a43939b391c1a8b2dbb69` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:10.812582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7987455-30d0-4013-82ec-d89af3505d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34d01cd2f96a43939b391c1a8b2dbb69)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:10.814475 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7987455-30d0-4013-82ec-d89af3505d31 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:10.857253 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c7987455-30d0-4013-82ec-d89af3505d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34d01cd2f96a43939b391c1a8b2dbb69'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.863589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c7987455-30d0-4013-82ec-d89af3505d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34d01cd2f96a43939b391c1a8b2dbb69'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.864252 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c7987455-30d0-4013-82ec-d89af3505d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34d01cd2f96a43939b391c1a8b2dbb69'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.864843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c7987455-30d0-4013-82ec-d89af3505d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34d01cd2f96a43939b391c1a8b2dbb69'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.876854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c7987455-30d0-4013-82ec-d89af3505d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34d01cd2f96a43939b391c1a8b2dbb69'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:10.889798 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1289/2552] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:19:10 2022] DELETE /identity/v3/users/34d01cd2f96a43939b391c1a8b2dbb69 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:19:11.061775 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:11.063176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:11.076954 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b655d-4d8b-453b-9916-84d141ab6f1d admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:11.131701 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518d730-c6af-4afb-b0d6-83af645c1de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:11.132583 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518d730-c6af-4afb-b0d6-83af645c1de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:11.132859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518d730-c6af-4afb-b0d6-83af645c1de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:11.133127 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518d730-c6af-4afb-b0d6-83af645c1de9 admin admin] PATH_INFO: `/v3/projects/5e22131dd18b498e94dddb8e28587f66` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:11.134352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518d730-c6af-4afb-b0d6-83af645c1de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e22131dd18b498e94dddb8e28587f66)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:11.136304 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518d730-c6af-4afb-b0d6-83af645c1de9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:11.180452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d518d730-c6af-4afb-b0d6-83af645c1de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e22131dd18b498e94dddb8e28587f66', 'request_id': 'req-d518d730-c6af-4afb-b0d6-83af645c1de9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:11.185735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d518d730-c6af-4afb-b0d6-83af645c1de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e22131dd18b498e94dddb8e28587f66', 'request_id': 'req-d518d730-c6af-4afb-b0d6-83af645c1de9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:11.192720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d518d730-c6af-4afb-b0d6-83af645c1de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e22131dd18b498e94dddb8e28587f66', 'request_id': 'req-d518d730-c6af-4afb-b0d6-83af645c1de9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:11.203250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d518d730-c6af-4afb-b0d6-83af645c1de9 admin admin] The token cache is being invalidate because project 5e22131dd18b498e94dddb8e28587f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:19:11.203531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d518d730-c6af-4afb-b0d6-83af645c1de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:11.204188 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d518d730-c6af-4afb-b0d6-83af645c1de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:19:11.205700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1264/2553] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:19:11 2022] DELETE /identity/v3/projects/5e22131dd18b498e94dddb8e28587f66 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:19:11.210667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5d138-907a-4c30-b7dc-542058cfca12 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:11.211133 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5d138-907a-4c30-b7dc-542058cfca12 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:11.211230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5d138-907a-4c30-b7dc-542058cfca12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:11.230723 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-bab5d138-907a-4c30-b7dc-542058cfca12 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:19:11.231896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-bab5d138-907a-4c30-b7dc-542058cfca12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:11.287396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1290/2554] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:19:11.296832 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0a4d8-8bcb-4bd3-897e-0b94c8326ce5 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:11.297118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0a4d8-8bcb-4bd3-897e-0b94c8326ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:11.297388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0a4d8-8bcb-4bd3-897e-0b94c8326ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:11.315299 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-9af0a4d8-8bcb-4bd3-897e-0b94c8326ce5 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:19:11.316527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9af0a4d8-8bcb-4bd3-897e-0b94c8326ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:11.328592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1265/2555] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:19:11.332941 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5d138-907a-4c30-b7dc-542058cfca12 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:11.342853 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5d138-907a-4c30-b7dc-542058cfca12 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:11.347329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14109eba-cc91-4a1c-8389-d45120c4cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:11.347967 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14109eba-cc91-4a1c-8389-d45120c4cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:11.348462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14109eba-cc91-4a1c-8389-d45120c4cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:11.348740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14109eba-cc91-4a1c-8389-d45120c4cd2d admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:11.349460 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14109eba-cc91-4a1c-8389-d45120c4cd2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:19:11.349765 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14109eba-cc91-4a1c-8389-d45120c4cd2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:11.351330 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14109eba-cc91-4a1c-8389-d45120c4cd2d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:11.364838 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1291/2556] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:19:11.369082 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0a4d8-8bcb-4bd3-897e-0b94c8326ce5 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:11.378066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0a4d8-8bcb-4bd3-897e-0b94c8326ce5 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:11.382729 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81221259-42ef-4d89-80f7-87cd70170e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:11.383362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81221259-42ef-4d89-80f7-87cd70170e22 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:11.383640 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81221259-42ef-4d89-80f7-87cd70170e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:11.383912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81221259-42ef-4d89-80f7-87cd70170e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:11.384633 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81221259-42ef-4d89-80f7-87cd70170e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:11.386555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81221259-42ef-4d89-80f7-87cd70170e22 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:11.412062 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1266/2557] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:19:11 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:19:11.416825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14109eba-cc91-4a1c-8389-d45120c4cd2d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:11.426969 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14109eba-cc91-4a1c-8389-d45120c4cd2d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:11.481360 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9c39b-3b8a-4501-ae4d-8585e65750c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:11.482017 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9c39b-3b8a-4501-ae4d-8585e65750c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:11.482300 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9c39b-3b8a-4501-ae4d-8585e65750c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:11.482574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9c39b-3b8a-4501-ae4d-8585e65750c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:11.483265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9c39b-3b8a-4501-ae4d-8585e65750c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:11.485184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9c39b-3b8a-4501-ae4d-8585e65750c1 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:11.503800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1292/2558] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:19:11 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:19:11.507908 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81221259-42ef-4d89-80f7-87cd70170e22 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:11.517836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81221259-42ef-4d89-80f7-87cd70170e22 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:11.522283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c76ed-9230-4048-bac8-8e0cfe2db76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:11.522917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c76ed-9230-4048-bac8-8e0cfe2db76a admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:11.523190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c76ed-9230-4048-bac8-8e0cfe2db76a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:11.523458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c76ed-9230-4048-bac8-8e0cfe2db76a admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:11.524246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c76ed-9230-4048-bac8-8e0cfe2db76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:11.526323 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c76ed-9230-4048-bac8-8e0cfe2db76a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:11.536345 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1267/2559] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:19:11.540053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9c39b-3b8a-4501-ae4d-8585e65750c1 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:11.550477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9c39b-3b8a-4501-ae4d-8585e65750c1 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:11.555114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02ed21-eb25-431e-835a-fd4f8707607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:11.555753 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02ed21-eb25-431e-835a-fd4f8707607f admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:11.556036 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02ed21-eb25-431e-835a-fd4f8707607f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:11.556345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02ed21-eb25-431e-835a-fd4f8707607f admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:11.557187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02ed21-eb25-431e-835a-fd4f8707607f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:11.558756 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02ed21-eb25-431e-835a-fd4f8707607f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:11.570366 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1293/2560] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:19:11.574429 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c76ed-9230-4048-bac8-8e0cfe2db76a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:11.583881 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c76ed-9230-4048-bac8-8e0cfe2db76a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:11.589057 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8166a4-7d0c-4e4b-9992-011c06860701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:11.589912 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8166a4-7d0c-4e4b-9992-011c06860701 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:11.590187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8166a4-7d0c-4e4b-9992-011c06860701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:11.590459 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8166a4-7d0c-4e4b-9992-011c06860701 admin admin] PATH_INFO: `/v3/projects/d92efab60f874aa8a197ab70fc582487/users/bafeedb9a9ad47e4b434b3680f6ccec2/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:11.605916 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8166a4-7d0c-4e4b-9992-011c06860701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92efab60f874aa8a197ab70fc582487, user_id=bafeedb9a9ad47e4b434b3680f6ccec2, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:11.608632 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8166a4-7d0c-4e4b-9992-011c06860701 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:11.621998 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1268/2561] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:19:11 2022] PUT /identity/v3/projects/d92efab60f874aa8a197ab70fc582487/users/bafeedb9a9ad47e4b434b3680f6ccec2/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:19:11.627267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5acb8-e1a6-48da-961e-eeb8cec31808 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:11.627626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5acb8-e1a6-48da-961e-eeb8cec31808 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:11.627973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5acb8-e1a6-48da-961e-eeb8cec31808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:11.645653 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-0ce5acb8-e1a6-48da-961e-eeb8cec31808 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:19:11.646957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0ce5acb8-e1a6-48da-961e-eeb8cec31808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:11.704863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1294/2562] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:19:11.715013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8166a4-7d0c-4e4b-9992-011c06860701 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:11.716769 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0c8166a4-7d0c-4e4b-9992-011c06860701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:11.772684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8166a4-7d0c-4e4b-9992-011c06860701 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:11.776890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c5f53-0f9d-405b-ba85-e5029f23f3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:11.777511 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c5f53-0f9d-405b-ba85-e5029f23f3aa service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:11.777784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c5f53-0f9d-405b-ba85-e5029f23f3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:11.778052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c5f53-0f9d-405b-ba85-e5029f23f3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:11.786755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c5f53-0f9d-405b-ba85-e5029f23f3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:11.788187 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c5f53-0f9d-405b-ba85-e5029f23f3aa service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:11.797496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1269/2563] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:19:14.470165 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5acb8-e1a6-48da-961e-eeb8cec31808 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:14.472255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0ce5acb8-e1a6-48da-961e-eeb8cec31808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:14.552489 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5acb8-e1a6-48da-961e-eeb8cec31808 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:14.559262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfe44c-284e-4d99-a27f-daaad63cbb98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:14.559915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfe44c-284e-4d99-a27f-daaad63cbb98 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:14.560223 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfe44c-284e-4d99-a27f-daaad63cbb98 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:14.560496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfe44c-284e-4d99-a27f-daaad63cbb98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:14.562358 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-bfbfe44c-284e-4d99-a27f-daaad63cbb98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:14.575957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfe44c-284e-4d99-a27f-daaad63cbb98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:14.577585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfe44c-284e-4d99-a27f-daaad63cbb98 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:14.591743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1295/2564] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:19:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:19:16.742478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3434bd-8c26-409f-8d70-d294f9efbe2b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:16.742976 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3434bd-8c26-409f-8d70-d294f9efbe2b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:16.743108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3434bd-8c26-409f-8d70-d294f9efbe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:16.769980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0a3434bd-8c26-409f-8d70-d294f9efbe2b None None] MFA Rules not processed for user `bafeedb9a9ad47e4b434b3680f6ccec2`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:19:16.771118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0a3434bd-8c26-409f-8d70-d294f9efbe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:16.836898 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1270/2565] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:19:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:19:16.841462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfe44c-284e-4d99-a27f-daaad63cbb98 service nova] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:16.851592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfe44c-284e-4d99-a27f-daaad63cbb98 service nova] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:16.856803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2ed5-09d7-475b-8e91-48ecb9d62835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:16.857442 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2ed5-09d7-475b-8e91-48ecb9d62835 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:16.857723 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2ed5-09d7-475b-8e91-48ecb9d62835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:16.857996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2ed5-09d7-475b-8e91-48ecb9d62835 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:16.858688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f2ed5-09d7-475b-8e91-48ecb9d62835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:16.860608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f2ed5-09d7-475b-8e91-48ecb9d62835 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:16.885294 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1296/2566] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:19:16 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:19:16.889383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3434bd-8c26-409f-8d70-d294f9efbe2b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:16.899720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3434bd-8c26-409f-8d70-d294f9efbe2b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:16.953667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c8de0-e14c-409a-a868-6ab249df3e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:16.954319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c8de0-e14c-409a-a868-6ab249df3e76 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:16.954599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c8de0-e14c-409a-a868-6ab249df3e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:16.954874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c8de0-e14c-409a-a868-6ab249df3e76 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:16.955581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c8de0-e14c-409a-a868-6ab249df3e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:16.957534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c8de0-e14c-409a-a868-6ab249df3e76 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:16.982472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1271/2567] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:19:16 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:19:16.983585 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2ed5-09d7-475b-8e91-48ecb9d62835 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:16.997469 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2ed5-09d7-475b-8e91-48ecb9d62835 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:17.003899 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d56426-c880-451d-8dac-717beeb54b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:17.004617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d56426-c880-451d-8dac-717beeb54b3d admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:17.004897 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d56426-c880-451d-8dac-717beeb54b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:17.005167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d56426-c880-451d-8dac-717beeb54b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:17.005968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d56426-c880-451d-8dac-717beeb54b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:17.007610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d56426-c880-451d-8dac-717beeb54b3d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:17.024211 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1297/2568] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:19:17.029535 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c8de0-e14c-409a-a868-6ab249df3e76 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:17.045722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c8de0-e14c-409a-a868-6ab249df3e76 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:17.051414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ea6ed-fa69-4eaf-9ab8-87dbf8282855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:17.052422 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ea6ed-fa69-4eaf-9ab8-87dbf8282855 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:17.052784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ea6ed-fa69-4eaf-9ab8-87dbf8282855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:17.053130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ea6ed-fa69-4eaf-9ab8-87dbf8282855 admin admin] PATH_INFO: `/v3/projects/5fda1e1131c447b2bd182e5435d6db65/users/c86712a0c2f8414e98f12ca818b78210/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:17.069373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ea6ed-fa69-4eaf-9ab8-87dbf8282855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fda1e1131c447b2bd182e5435d6db65, user_id=c86712a0c2f8414e98f12ca818b78210, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:17.073020 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ea6ed-fa69-4eaf-9ab8-87dbf8282855 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:17.095764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1272/2569] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:19:17 2022] PUT /identity/v3/projects/5fda1e1131c447b2bd182e5435d6db65/users/c86712a0c2f8414e98f12ca818b78210/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:19:17.100031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d56426-c880-451d-8dac-717beeb54b3d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:17.110795 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d56426-c880-451d-8dac-717beeb54b3d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:17.174717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda77eb-20fc-48c5-a554-3e24145906ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:17.175388 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda77eb-20fc-48c5-a554-3e24145906ff admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:17.175676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda77eb-20fc-48c5-a554-3e24145906ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:17.175935 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda77eb-20fc-48c5-a554-3e24145906ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:17.176693 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda77eb-20fc-48c5-a554-3e24145906ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:17.178276 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda77eb-20fc-48c5-a554-3e24145906ff admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:17.188531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1298/2570] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:19:17.192668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ea6ed-fa69-4eaf-9ab8-87dbf8282855 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:17.204297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ea6ed-fa69-4eaf-9ab8-87dbf8282855 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:17.209454 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efa8b5-c79c-4e6f-be7f-bc72e545ea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:17.210480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efa8b5-c79c-4e6f-be7f-bc72e545ea04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:17.213707 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efa8b5-c79c-4e6f-be7f-bc72e545ea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:17.213874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efa8b5-c79c-4e6f-be7f-bc72e545ea04 admin admin] PATH_INFO: `/v3/projects/5fda1e1131c447b2bd182e5435d6db65/users/c86712a0c2f8414e98f12ca818b78210/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:17.216017 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efa8b5-c79c-4e6f-be7f-bc72e545ea04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fda1e1131c447b2bd182e5435d6db65, user_id=c86712a0c2f8414e98f12ca818b78210, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:17.218806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efa8b5-c79c-4e6f-be7f-bc72e545ea04 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:17.230525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1273/2571] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:19:17 2022] PUT /identity/v3/projects/5fda1e1131c447b2bd182e5435d6db65/users/c86712a0c2f8414e98f12ca818b78210/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:19:21.257163 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbb740-8b89-4548-822f-95dfc72fe84e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:21.257665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbb740-8b89-4548-822f-95dfc72fe84e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:21.257783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbb740-8b89-4548-822f-95dfc72fe84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:21.286298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-77dbb740-8b89-4548-822f-95dfc72fe84e None None] MFA Rules not processed for user `c86712a0c2f8414e98f12ca818b78210`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:19:21.287514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-77dbb740-8b89-4548-822f-95dfc72fe84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:21.367902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1299/2572] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:19:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:19:21.379234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efa8b5-c79c-4e6f-be7f-bc72e545ea04 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:21.381166 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-22efa8b5-c79c-4e6f-be7f-bc72e545ea04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:21.486314 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efa8b5-c79c-4e6f-be7f-bc72e545ea04 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:21.493159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962e1dc-1795-4bd3-a00e-36e776535a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:21.493911 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962e1dc-1795-4bd3-a00e-36e776535a1e service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:21.494386 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962e1dc-1795-4bd3-a00e-36e776535a1e service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:21.494659 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962e1dc-1795-4bd3-a00e-36e776535a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:21.555164 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962e1dc-1795-4bd3-a00e-36e776535a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:21.557389 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962e1dc-1795-4bd3-a00e-36e776535a1e service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:21.570851 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1274/2573] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:19:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:19:46.309706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b30b4-c9a0-48b0-97fc-554e574b1e6e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:46.310225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b30b4-c9a0-48b0-97fc-554e574b1e6e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:46.310331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b30b4-c9a0-48b0-97fc-554e574b1e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:46.327623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-c33b30b4-c9a0-48b0-97fc-554e574b1e6e None None] MFA Rules not processed for user `bafeedb9a9ad47e4b434b3680f6ccec2`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:19:46.328883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c33b30b4-c9a0-48b0-97fc-554e574b1e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:46.335596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1300/2574] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:19:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:19:47.735884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962e1dc-1795-4bd3-a00e-36e776535a1e service nova] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:19:47.737297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7962e1dc-1795-4bd3-a00e-36e776535a1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:47.803176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962e1dc-1795-4bd3-a00e-36e776535a1e service nova] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:19:47.808567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761ceb7-6936-4c2d-b154-57e7676c98c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7f2aea3e494546a04e20d8cedccc9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:19:47.809191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761ceb7-6936-4c2d-b154-57e7676c98c9 service placement] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:19:47.809463 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761ceb7-6936-4c2d-b154-57e7676c98c9 service placement] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:19:47.809729 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761ceb7-6936-4c2d-b154-57e7676c98c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:19:47.811440 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2761ceb7-6936-4c2d-b154-57e7676c98c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:19:47.822591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761ceb7-6936-4c2d-b154-57e7676c98c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:19:47.824928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761ceb7-6936-4c2d-b154-57e7676c98c9 service placement] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:19:47.834401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1275/2575] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:19:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:20:03.946057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b30b4-c9a0-48b0-97fc-554e574b1e6e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:20:04.001649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b30b4-c9a0-48b0-97fc-554e574b1e6e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:20:04.005177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e136a1-3596-4445-8ad6-a23004d55984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:20:04.005805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e136a1-3596-4445-8ad6-a23004d55984 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:04.006081 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e136a1-3596-4445-8ad6-a23004d55984 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:04.006348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e136a1-3596-4445-8ad6-a23004d55984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:04.015825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e136a1-3596-4445-8ad6-a23004d55984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:20:04.017285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e136a1-3596-4445-8ad6-a23004d55984 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:20:04.027013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1301/2576] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:20:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:20:04.651407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761ceb7-6936-4c2d-b154-57e7676c98c9 service placement] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:20:04.652860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2761ceb7-6936-4c2d-b154-57e7676c98c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:20:04.663956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761ceb7-6936-4c2d-b154-57e7676c98c9 service placement] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:20:04.668500 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564213ef-7fa2-4dd0-960e-ad31a6f9cf89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:20:04.669136 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564213ef-7fa2-4dd0-960e-ad31a6f9cf89 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:04.669413 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564213ef-7fa2-4dd0-960e-ad31a6f9cf89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:04.669685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564213ef-7fa2-4dd0-960e-ad31a6f9cf89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:04.671422 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-564213ef-7fa2-4dd0-960e-ad31a6f9cf89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:20:04.733174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564213ef-7fa2-4dd0-960e-ad31a6f9cf89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:20:04.734857 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564213ef-7fa2-4dd0-960e-ad31a6f9cf89 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:20:04.744623 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1276/2577] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:20:11.305238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e136a1-3596-4445-8ad6-a23004d55984 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:20:11.306795 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f9e136a1-3596-4445-8ad6-a23004d55984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:20:11.322109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e136a1-3596-4445-8ad6-a23004d55984 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:20:11.327359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:20:11.328254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:11.328539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:11.328808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] PATH_INFO: `/v3/users/0d48a4385c524710b422f853f03d14db` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:11.330008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d48a4385c524710b422f853f03d14db)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:20:11.331884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:20:11.378099 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d48a4385c524710b422f853f03d14db'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.384471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d48a4385c524710b422f853f03d14db'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.385116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d48a4385c524710b422f853f03d14db'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.386242 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d48a4385c524710b422f853f03d14db'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.397894 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d48a4385c524710b422f853f03d14db'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.412166 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1302/2578] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:20:11 2022] DELETE /identity/v3/users/0d48a4385c524710b422f853f03d14db => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:20:11.592045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564213ef-7fa2-4dd0-960e-ad31a6f9cf89 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:20:11.607738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564213ef-7fa2-4dd0-960e-ad31a6f9cf89 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:20:11.674046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:20:11.675095 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:11.675372 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:11.675648 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] PATH_INFO: `/v3/projects/3444fc5e89a24b7c9ec0e18369085501` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:11.676848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3444fc5e89a24b7c9ec0e18369085501)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:20:11.678938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:20:11.726548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3444fc5e89a24b7c9ec0e18369085501', 'request_id': 'req-5d8253c3-edcd-4cc7-9a89-ec7c64764189'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.731646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3444fc5e89a24b7c9ec0e18369085501', 'request_id': 'req-5d8253c3-edcd-4cc7-9a89-ec7c64764189'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.740465 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3444fc5e89a24b7c9ec0e18369085501', 'request_id': 'req-5d8253c3-edcd-4cc7-9a89-ec7c64764189'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.751843 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] The token cache is being invalidate because project 3444fc5e89a24b7c9ec0e18369085501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:20:11.752155 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.752803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.754330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1277/2579] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:20:11 2022] DELETE /identity/v3/projects/3444fc5e89a24b7c9ec0e18369085501 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:20:11.758271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:20:11.759621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:20:11.773217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c34d22-f1cb-4620-a027-6b781761af9f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:20:11.827726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a984d7-25fb-47ba-a450-a0ebac6a191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:20:11.828665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a984d7-25fb-47ba-a450-a0ebac6a191f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:11.828948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a984d7-25fb-47ba-a450-a0ebac6a191f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:11.829224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a984d7-25fb-47ba-a450-a0ebac6a191f admin admin] PATH_INFO: `/v3/users/0c7a3a55f5404ad6ba0fd0a8cba88f37` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:11.830394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a984d7-25fb-47ba-a450-a0ebac6a191f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c7a3a55f5404ad6ba0fd0a8cba88f37)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:20:11.832315 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a984d7-25fb-47ba-a450-a0ebac6a191f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:20:11.877283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-55a984d7-25fb-47ba-a450-a0ebac6a191f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c7a3a55f5404ad6ba0fd0a8cba88f37'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.883686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-55a984d7-25fb-47ba-a450-a0ebac6a191f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c7a3a55f5404ad6ba0fd0a8cba88f37'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.884362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-55a984d7-25fb-47ba-a450-a0ebac6a191f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c7a3a55f5404ad6ba0fd0a8cba88f37'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.884972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-55a984d7-25fb-47ba-a450-a0ebac6a191f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c7a3a55f5404ad6ba0fd0a8cba88f37'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.896775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-55a984d7-25fb-47ba-a450-a0ebac6a191f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c7a3a55f5404ad6ba0fd0a8cba88f37'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:11.908973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1303/2580] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:20:11 2022] DELETE /identity/v3/users/0c7a3a55f5404ad6ba0fd0a8cba88f37 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:20:12.088131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:20:12.089815 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:20:12.102709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8253c3-edcd-4cc7-9a89-ec7c64764189 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:20:12.156603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:20:12.157446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:12.157722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:12.157990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] PATH_INFO: `/v3/projects/d7a19b2a1ef24312ac5a2c74173ce3d0` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:12.159197 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a19b2a1ef24312ac5a2c74173ce3d0)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:20:12.161106 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:20:12.205591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a19b2a1ef24312ac5a2c74173ce3d0', 'request_id': 'req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:12.210968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a19b2a1ef24312ac5a2c74173ce3d0', 'request_id': 'req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:12.217943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a19b2a1ef24312ac5a2c74173ce3d0', 'request_id': 'req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:12.228782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] The token cache is being invalidate because project d7a19b2a1ef24312ac5a2c74173ce3d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:20:12.229669 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:12.230297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:20:12.231829 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1278/2581] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:20:12 2022] DELETE /identity/v3/projects/d7a19b2a1ef24312ac5a2c74173ce3d0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:20:31.621512 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81392072-5cee-49e0-8ed0-2007ce955927 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:31.622046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81392072-5cee-49e0-8ed0-2007ce955927 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:31.622046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81392072-5cee-49e0-8ed0-2007ce955927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:31.643019 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-81392072-5cee-49e0-8ed0-2007ce955927 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:20:31.644288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-81392072-5cee-49e0-8ed0-2007ce955927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:20:31.698664 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1304/2582] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:20:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:20:31.745271 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:20:31.746650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:20:31.814295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a022-ee8a-4e8e-9bc6-7fa2148d33e5 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:20:31.819348 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74702980-4329-49f9-8b5b-b67f5ae900d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:20:31.819987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74702980-4329-49f9-8b5b-b67f5ae900d6 service swift] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:31.820296 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74702980-4329-49f9-8b5b-b67f5ae900d6 service swift] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:31.820599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74702980-4329-49f9-8b5b-b67f5ae900d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:31.829554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74702980-4329-49f9-8b5b-b67f5ae900d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:20:31.831117 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74702980-4329-49f9-8b5b-b67f5ae900d6 service swift] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:20:31.838975 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1279/2583] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:20:47.332344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd020662-1087-4b9a-acc9-ac769ee11984 None None] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:47.332909 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd020662-1087-4b9a-acc9-ac769ee11984 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:47.332909 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd020662-1087-4b9a-acc9-ac769ee11984 None None] PATH_INFO: `/` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:47.334234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1305/2584] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 09:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:20:47.339629 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f59d2-ea1d-4ea2-b435-378b4a7ce779 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:47.340135 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f59d2-ea1d-4ea2-b435-378b4a7ce779 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:47.340356 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f59d2-ea1d-4ea2-b435-378b4a7ce779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:47.358307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-be8f59d2-ea1d-4ea2-b435-378b4a7ce779 None None] MFA Rules not processed for user `2b863628035e4767b08fb5efc5c80958`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:20:47.359601 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-be8f59d2-ea1d-4ea2-b435-378b4a7ce779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:20:47.424031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1280/2585] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 09:20:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:20:47.436220 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd020662-1087-4b9a-acc9-ac769ee11984 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:20:47.438233 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-bd020662-1087-4b9a-acc9-ac769ee11984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:20:47.492717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd020662-1087-4b9a-acc9-ac769ee11984 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:20:47.496666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff7cf-b9d6-4568-9452-db816cf69004 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1848679bce324613b4a92de808165ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:20:47.497287 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff7cf-b9d6-4568-9452-db816cf69004 service glance] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:47.497562 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff7cf-b9d6-4568-9452-db816cf69004 service glance] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:47.497830 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff7cf-b9d6-4568-9452-db816cf69004 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:47.507270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbff7cf-b9d6-4568-9452-db816cf69004 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:20:47.508777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbff7cf-b9d6-4568-9452-db816cf69004 service glance] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:20:47.519508 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1306/2586] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:20:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:20:49.300573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1293b6-f524-4e8e-bc87-dacc1fedbcb2 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:49.301013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1293b6-f524-4e8e-bc87-dacc1fedbcb2 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:49.301121 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1293b6-f524-4e8e-bc87-dacc1fedbcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:49.318394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-4a1293b6-f524-4e8e-bc87-dacc1fedbcb2 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:20:49.319580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4a1293b6-f524-4e8e-bc87-dacc1fedbcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:20:49.327256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1281/2587] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:20:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:20:49.341716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff7cf-b9d6-4568-9452-db816cf69004 service glance] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:20:49.362463 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff7cf-b9d6-4568-9452-db816cf69004 service glance] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:20:49.367372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0fc23-d4f0-4ce9-ac49-f9e82b9b27a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:20:49.368003 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0fc23-d4f0-4ce9-ac49-f9e82b9b27a3 service swift] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:20:49.368317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0fc23-d4f0-4ce9-ac49-f9e82b9b27a3 service swift] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:20:49.368586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0fc23-d4f0-4ce9-ac49-f9e82b9b27a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:20:49.376940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0fc23-d4f0-4ce9-ac49-f9e82b9b27a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:20:49.378502 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0fc23-d4f0-4ce9-ac49-f9e82b9b27a3 service swift] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:20:49.386833 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1307/2588] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:20:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:21:11.099468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9e614-fa57-491d-b9c9-24dfb7154574 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:21:11.099936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9e614-fa57-491d-b9c9-24dfb7154574 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:21:11.100046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9e614-fa57-491d-b9c9-24dfb7154574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:21:11.118228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-1de9e614-fa57-491d-b9c9-24dfb7154574 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:21:11.119395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1de9e614-fa57-491d-b9c9-24dfb7154574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:21:11.126790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1282/2589] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 3 09:21:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:21:11.139387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0fc23-d4f0-4ce9-ac49-f9e82b9b27a3 service swift] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:21:11.149551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0fc23-d4f0-4ce9-ac49-f9e82b9b27a3 service swift] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:21:11.155074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99372c83-611b-4c95-8023-b202aebf9f92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:21:11.155689 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99372c83-611b-4c95-8023-b202aebf9f92 service swift] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:21:11.155968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99372c83-611b-4c95-8023-b202aebf9f92 service swift] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:21:11.156293 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99372c83-611b-4c95-8023-b202aebf9f92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:21:11.164290 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99372c83-611b-4c95-8023-b202aebf9f92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:21:11.165848 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99372c83-611b-4c95-8023-b202aebf9f92 service swift] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:21:11.173608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1308/2590] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:21:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:21:23.112261 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9e614-fa57-491d-b9c9-24dfb7154574 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:21:23.113642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1de9e614-fa57-491d-b9c9-24dfb7154574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:21:23.168540 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9e614-fa57-491d-b9c9-24dfb7154574 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:21:23.172277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c625b-7012-40cf-9e8f-5a9054e72a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:21:23.173053 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c625b-7012-40cf-9e8f-5a9054e72a95 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:21:23.173320 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c625b-7012-40cf-9e8f-5a9054e72a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:21:23.173588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c625b-7012-40cf-9e8f-5a9054e72a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:21:23.175357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-092c625b-7012-40cf-9e8f-5a9054e72a95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:21:23.188910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c625b-7012-40cf-9e8f-5a9054e72a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:21:23.190342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c625b-7012-40cf-9e8f-5a9054e72a95 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:21:23.200784 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1283/2591] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:21:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:21:26.691574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99372c83-611b-4c95-8023-b202aebf9f92 service swift] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:21:26.693074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-99372c83-611b-4c95-8023-b202aebf9f92 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:21:26.704803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99372c83-611b-4c95-8023-b202aebf9f92 service swift] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:21:26.708423 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41127653-f5bf-4d72-b4c6-780ecfaab811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:21:26.709045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41127653-f5bf-4d72-b4c6-780ecfaab811 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:21:26.709328 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41127653-f5bf-4d72-b4c6-780ecfaab811 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:21:26.709603 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41127653-f5bf-4d72-b4c6-780ecfaab811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:21:26.711302 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-41127653-f5bf-4d72-b4c6-780ecfaab811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:21:26.724937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41127653-f5bf-4d72-b4c6-780ecfaab811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:21:26.726331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41127653-f5bf-4d72-b4c6-780ecfaab811 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:21:26.737592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1309/2592] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:21:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:22:15.872024 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c625b-7012-40cf-9e8f-5a9054e72a95 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:15.873428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-092c625b-7012-40cf-9e8f-5a9054e72a95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:15.927814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c625b-7012-40cf-9e8f-5a9054e72a95 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:15.932141 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9aa6b-8617-4945-b2e0-cd35668cbc5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:15.932803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9aa6b-8617-4945-b2e0-cd35668cbc5f service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:15.933213 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9aa6b-8617-4945-b2e0-cd35668cbc5f service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:15.933493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9aa6b-8617-4945-b2e0-cd35668cbc5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:15.935306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-aef9aa6b-8617-4945-b2e0-cd35668cbc5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:16.020968 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9aa6b-8617-4945-b2e0-cd35668cbc5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:16.022406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9aa6b-8617-4945-b2e0-cd35668cbc5f service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:16.040946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1284/2593] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:22:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:22:22.765307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41127653-f5bf-4d72-b4c6-780ecfaab811 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:22.773802 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41127653-f5bf-4d72-b4c6-780ecfaab811 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:22.778372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d325fcf-bfc2-41e6-af21-054910d127f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:22.778996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d325fcf-bfc2-41e6-af21-054910d127f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:22.779274 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d325fcf-bfc2-41e6-af21-054910d127f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:22.779547 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d325fcf-bfc2-41e6-af21-054910d127f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:22.781317 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6d325fcf-bfc2-41e6-af21-054910d127f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:22.840821 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d325fcf-bfc2-41e6-af21-054910d127f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:22.842224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d325fcf-bfc2-41e6-af21-054910d127f0 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:22.851484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1310/2594] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:22:26.002893 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9aa6b-8617-4945-b2e0-cd35668cbc5f service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:26.005969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-aef9aa6b-8617-4945-b2e0-cd35668cbc5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:26.021697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9aa6b-8617-4945-b2e0-cd35668cbc5f service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:26.026710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be42403-e563-4dbf-886c-c5fb7fc63441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:26.027602 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be42403-e563-4dbf-886c-c5fb7fc63441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:26.027883 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be42403-e563-4dbf-886c-c5fb7fc63441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:26.028230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be42403-e563-4dbf-886c-c5fb7fc63441 admin admin] PATH_INFO: `/v3/users/adc15a08f9f94c71bc1e0a092e1b7818` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:26.029436 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be42403-e563-4dbf-886c-c5fb7fc63441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc15a08f9f94c71bc1e0a092e1b7818)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:26.031337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be42403-e563-4dbf-886c-c5fb7fc63441 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:26.081628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0be42403-e563-4dbf-886c-c5fb7fc63441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc15a08f9f94c71bc1e0a092e1b7818'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:22:26.087874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0be42403-e563-4dbf-886c-c5fb7fc63441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc15a08f9f94c71bc1e0a092e1b7818'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:22:26.094397 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0be42403-e563-4dbf-886c-c5fb7fc63441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc15a08f9f94c71bc1e0a092e1b7818'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:22:26.095015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0be42403-e563-4dbf-886c-c5fb7fc63441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc15a08f9f94c71bc1e0a092e1b7818'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:22:26.095605 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-0be42403-e563-4dbf-886c-c5fb7fc63441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc15a08f9f94c71bc1e0a092e1b7818'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:22:26.112249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1285/2595] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:22:26 2022] DELETE /identity/v3/users/adc15a08f9f94c71bc1e0a092e1b7818 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:22:26.283044 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d325fcf-bfc2-41e6-af21-054910d127f0 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:26.297991 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d325fcf-bfc2-41e6-af21-054910d127f0 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:26.354501 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:26.355281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:26.355557 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:26.355828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7 admin admin] PATH_INFO: `/v3/projects/dd20006a6f1b4ef0951f86c839eb33ec` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:26.357027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd20006a6f1b4ef0951f86c839eb33ec)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:26.358895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:26.401555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd20006a6f1b4ef0951f86c839eb33ec', 'request_id': 'req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:22:26.408059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd20006a6f1b4ef0951f86c839eb33ec', 'request_id': 'req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:22:26.413166 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd20006a6f1b4ef0951f86c839eb33ec', 'request_id': 'req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:22:26.424914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7 admin admin] The token cache is being invalidate because project dd20006a6f1b4ef0951f86c839eb33ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:22:26.425224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:22:26.425843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-dee14d10-d7c6-44f4-87e6-136b3e89b4a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:22:26.427339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1311/2596] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:22:26 2022] DELETE /identity/v3/projects/dd20006a6f1b4ef0951f86c839eb33ec => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:22:26.432348 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff3658-b8ee-4903-b65f-a2265ae09556 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:26.432639 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff3658-b8ee-4903-b65f-a2265ae09556 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:26.432921 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff3658-b8ee-4903-b65f-a2265ae09556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:26.450321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a9ff3658-b8ee-4903-b65f-a2265ae09556 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:22:26.451505 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a9ff3658-b8ee-4903-b65f-a2265ae09556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:26.507551 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1286/2597] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:22:26.515248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a952c-39d9-4af2-9408-54902e1392cd None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:26.515555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a952c-39d9-4af2-9408-54902e1392cd None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:26.515816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a952c-39d9-4af2-9408-54902e1392cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:26.533908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-e82a952c-39d9-4af2-9408-54902e1392cd None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:22:26.535130 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e82a952c-39d9-4af2-9408-54902e1392cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:26.543656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1312/2598] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:22:26.547647 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff3658-b8ee-4903-b65f-a2265ae09556 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:26.557125 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff3658-b8ee-4903-b65f-a2265ae09556 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:26.561634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20676ec7-f10f-462a-8d46-bb15388524c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:26.562268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20676ec7-f10f-462a-8d46-bb15388524c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:26.562547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20676ec7-f10f-462a-8d46-bb15388524c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:26.562820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20676ec7-f10f-462a-8d46-bb15388524c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:26.563535 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20676ec7-f10f-462a-8d46-bb15388524c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:22:26.563839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20676ec7-f10f-462a-8d46-bb15388524c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:26.565454 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20676ec7-f10f-462a-8d46-bb15388524c2 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:26.576583 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1287/2599] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:22:26.580805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a952c-39d9-4af2-9408-54902e1392cd None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:26.590528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a952c-39d9-4af2-9408-54902e1392cd None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:26.595526 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f64299-1990-4791-baea-6b22a9e460b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:26.596199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f64299-1990-4791-baea-6b22a9e460b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:26.596481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f64299-1990-4791-baea-6b22a9e460b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:26.596752 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f64299-1990-4791-baea-6b22a9e460b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:26.597438 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f64299-1990-4791-baea-6b22a9e460b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:26.599308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f64299-1990-4791-baea-6b22a9e460b8 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:26.625048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1313/2600] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:22:26 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:22:26.629529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20676ec7-f10f-462a-8d46-bb15388524c2 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:26.639354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20676ec7-f10f-462a-8d46-bb15388524c2 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:26.693464 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c843686-7f52-47ef-9b37-d40be25db211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:26.694114 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c843686-7f52-47ef-9b37-d40be25db211 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:26.694391 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c843686-7f52-47ef-9b37-d40be25db211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:26.694663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c843686-7f52-47ef-9b37-d40be25db211 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:26.695336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c843686-7f52-47ef-9b37-d40be25db211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:26.697255 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c843686-7f52-47ef-9b37-d40be25db211 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:26.717519 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1288/2601] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:22:26 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:22:26.721553 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f64299-1990-4791-baea-6b22a9e460b8 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:26.731507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f64299-1990-4791-baea-6b22a9e460b8 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:26.736080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e707c-9e8d-464d-82bc-e7e4425d9d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:26.736752 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e707c-9e8d-464d-82bc-e7e4425d9d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:26.737032 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e707c-9e8d-464d-82bc-e7e4425d9d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:26.737298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e707c-9e8d-464d-82bc-e7e4425d9d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:26.738010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e707c-9e8d-464d-82bc-e7e4425d9d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:26.739573 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e707c-9e8d-464d-82bc-e7e4425d9d97 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:26.749672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1314/2602] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:22:26.753496 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c843686-7f52-47ef-9b37-d40be25db211 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:26.763657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c843686-7f52-47ef-9b37-d40be25db211 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:26.768150 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5ba82-37e8-40e1-92b1-23be5eb159ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:26.768781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5ba82-37e8-40e1-92b1-23be5eb159ac admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:26.769060 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5ba82-37e8-40e1-92b1-23be5eb159ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:26.769332 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5ba82-37e8-40e1-92b1-23be5eb159ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:26.770048 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5ba82-37e8-40e1-92b1-23be5eb159ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:26.771595 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5ba82-37e8-40e1-92b1-23be5eb159ac admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:26.781758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1289/2603] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:22:26.785588 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e707c-9e8d-464d-82bc-e7e4425d9d97 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:26.795499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e707c-9e8d-464d-82bc-e7e4425d9d97 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:26.799981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df36f5-54a9-4b90-9a0d-93834a2b322b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:26.800862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df36f5-54a9-4b90-9a0d-93834a2b322b admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:26.801140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df36f5-54a9-4b90-9a0d-93834a2b322b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:26.801408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df36f5-54a9-4b90-9a0d-93834a2b322b admin admin] PATH_INFO: `/v3/projects/6506fb00a31e4161b2be9c0c7f82b950/users/d69aad2f908c4f9e98ce80a44193125e/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:26.816046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df36f5-54a9-4b90-9a0d-93834a2b322b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6506fb00a31e4161b2be9c0c7f82b950, user_id=d69aad2f908c4f9e98ce80a44193125e, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:26.818736 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df36f5-54a9-4b90-9a0d-93834a2b322b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:26.831571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1315/2604] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:22:26 2022] PUT /identity/v3/projects/6506fb00a31e4161b2be9c0c7f82b950/users/d69aad2f908c4f9e98ce80a44193125e/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:22:26.836799 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e500fd-1bbf-4761-be35-3ec473a5c3e1 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:26.837066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e500fd-1bbf-4761-be35-3ec473a5c3e1 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:26.837340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e500fd-1bbf-4761-be35-3ec473a5c3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:26.855124 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-74e500fd-1bbf-4761-be35-3ec473a5c3e1 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:22:26.856337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-74e500fd-1bbf-4761-be35-3ec473a5c3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:26.911732 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1290/2605] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:22:26.922411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df36f5-54a9-4b90-9a0d-93834a2b322b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:26.924112 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-77df36f5-54a9-4b90-9a0d-93834a2b322b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:26.977512 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df36f5-54a9-4b90-9a0d-93834a2b322b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:26.981231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19817c94-bbfe-48df-95f6-5e2c7ec56817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:26.981849 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19817c94-bbfe-48df-95f6-5e2c7ec56817 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:26.982128 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19817c94-bbfe-48df-95f6-5e2c7ec56817 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:26.982399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19817c94-bbfe-48df-95f6-5e2c7ec56817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:26.990998 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19817c94-bbfe-48df-95f6-5e2c7ec56817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:26.992421 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19817c94-bbfe-48df-95f6-5e2c7ec56817 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:27.001434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1316/2606] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:22:30.937523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58815b01-4e4c-46bc-bd4a-4cc869ea62ec None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:30.937959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58815b01-4e4c-46bc-bd4a-4cc869ea62ec None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:30.938085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58815b01-4e4c-46bc-bd4a-4cc869ea62ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:30.965093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-58815b01-4e4c-46bc-bd4a-4cc869ea62ec None None] MFA Rules not processed for user `d69aad2f908c4f9e98ce80a44193125e`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:22:30.966382 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-58815b01-4e4c-46bc-bd4a-4cc869ea62ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:31.038322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1291/2607] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:22:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:22:31.059675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19817c94-bbfe-48df-95f6-5e2c7ec56817 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:31.061329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-19817c94-bbfe-48df-95f6-5e2c7ec56817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:31.150098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19817c94-bbfe-48df-95f6-5e2c7ec56817 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:31.157008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065efdb-543d-4bd8-a5ec-1c8dd00fe668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:31.157767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065efdb-543d-4bd8-a5ec-1c8dd00fe668 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:31.158050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065efdb-543d-4bd8-a5ec-1c8dd00fe668 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:31.158596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065efdb-543d-4bd8-a5ec-1c8dd00fe668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:31.167910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065efdb-543d-4bd8-a5ec-1c8dd00fe668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:31.169551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065efdb-543d-4bd8-a5ec-1c8dd00fe668 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:31.179321 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1317/2608] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:22:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:22:33.519390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971863-b59d-4cdb-bf47-4c2fb70aaa78 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:33.519927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971863-b59d-4cdb-bf47-4c2fb70aaa78 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:33.519927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971863-b59d-4cdb-bf47-4c2fb70aaa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:33.537478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-75971863-b59d-4cdb-bf47-4c2fb70aaa78 None None] MFA Rules not processed for user `d69aad2f908c4f9e98ce80a44193125e`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:22:33.539176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-75971863-b59d-4cdb-bf47-4c2fb70aaa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:33.546489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1292/2609] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:22:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:22:33.886245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065efdb-543d-4bd8-a5ec-1c8dd00fe668 service nova] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:33.887832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b065efdb-543d-4bd8-a5ec-1c8dd00fe668 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:33.899720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065efdb-543d-4bd8-a5ec-1c8dd00fe668 service nova] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:33.903383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8ceeb-42c7-4b33-a61f-2dd8c3061ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:33.904019 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8ceeb-42c7-4b33-a61f-2dd8c3061ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:33.904350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8ceeb-42c7-4b33-a61f-2dd8c3061ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:33.904624 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8ceeb-42c7-4b33-a61f-2dd8c3061ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:33.906362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-37c8ceeb-42c7-4b33-a61f-2dd8c3061ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:33.916748 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8ceeb-42c7-4b33-a61f-2dd8c3061ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:33.918182 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8ceeb-42c7-4b33-a61f-2dd8c3061ba2 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:33.927764 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1318/2610] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:22:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:22:37.947088 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75971863-b59d-4cdb-bf47-4c2fb70aaa78 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:37.980612 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75971863-b59d-4cdb-bf47-4c2fb70aaa78 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:37.988809 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a64c47-46c7-4798-bead-eda3296bc4e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:37.989738 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a64c47-46c7-4798-bead-eda3296bc4e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:37.990225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a64c47-46c7-4798-bead-eda3296bc4e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:37.990727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a64c47-46c7-4798-bead-eda3296bc4e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:37.992851 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-b5a64c47-46c7-4798-bead-eda3296bc4e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:38.004430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a64c47-46c7-4798-bead-eda3296bc4e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:38.006554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a64c47-46c7-4798-bead-eda3296bc4e3 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:38.018075 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1293/2611] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:22:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:22:38.200984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8ceeb-42c7-4b33-a61f-2dd8c3061ba2 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:22:38.216061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8ceeb-42c7-4b33-a61f-2dd8c3061ba2 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:22:38.225140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da783ff2-c007-4032-b166-2dc194b49c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:22:38.226390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da783ff2-c007-4032-b166-2dc194b49c57 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:38.229496 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da783ff2-c007-4032-b166-2dc194b49c57 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:38.229960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da783ff2-c007-4032-b166-2dc194b49c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:38.231898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-da783ff2-c007-4032-b166-2dc194b49c57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:38.246053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da783ff2-c007-4032-b166-2dc194b49c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:22:38.247670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da783ff2-c007-4032-b166-2dc194b49c57 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:22:38.258517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1319/2612] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:22:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:22:40.313499 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e770ff6-ba0f-45c0-af93-31fc5a214f4e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:22:40.314000 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e770ff6-ba0f-45c0-af93-31fc5a214f4e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:22:40.314097 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e770ff6-ba0f-45c0-af93-31fc5a214f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:22:40.331820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0e770ff6-ba0f-45c0-af93-31fc5a214f4e None None] MFA Rules not processed for user `bafeedb9a9ad47e4b434b3680f6ccec2`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:22:40.333045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0e770ff6-ba0f-45c0-af93-31fc5a214f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:22:40.387885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1294/2613] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:22:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:23:59.083239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da783ff2-c007-4032-b166-2dc194b49c57 service nova] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:23:59.084727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-da783ff2-c007-4032-b166-2dc194b49c57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:23:59.144539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da783ff2-c007-4032-b166-2dc194b49c57 service nova] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:23:59.150046 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d7c94-610f-46ee-8a50-816a8fb2af13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:23:59.150675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d7c94-610f-46ee-8a50-816a8fb2af13 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:23:59.150957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d7c94-610f-46ee-8a50-816a8fb2af13 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:23:59.151234 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d7c94-610f-46ee-8a50-816a8fb2af13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:23:59.153656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e66d7c94-610f-46ee-8a50-816a8fb2af13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:23:59.210468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d7c94-610f-46ee-8a50-816a8fb2af13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:23:59.212106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d7c94-610f-46ee-8a50-816a8fb2af13 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:23:59.221970 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1320/2614] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:23:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:24:05.042010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061d4d4-cd96-4348-aeb3-599a261595f5 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:24:05.043064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061d4d4-cd96-4348-aeb3-599a261595f5 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:24:05.043064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061d4d4-cd96-4348-aeb3-599a261595f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:24:05.060703 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-c061d4d4-cd96-4348-aeb3-599a261595f5 None None] MFA Rules not processed for user `6c0e27f69f7944a7b1f42f71fb389ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:24:05.061887 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c061d4d4-cd96-4348-aeb3-599a261595f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:24:05.068699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1295/2615] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:24:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:24:05.360631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d7c94-610f-46ee-8a50-816a8fb2af13 service nova] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:24:05.378528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d7c94-610f-46ee-8a50-816a8fb2af13 service nova] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:24:05.382096 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ed2ce-5314-4149-bcfd-acc9b18e752f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:24:05.382721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ed2ce-5314-4149-bcfd-acc9b18e752f service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:24:05.383001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ed2ce-5314-4149-bcfd-acc9b18e752f service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:24:05.383273 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ed2ce-5314-4149-bcfd-acc9b18e752f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:24:05.385057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f58ed2ce-5314-4149-bcfd-acc9b18e752f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:24:05.406827 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ed2ce-5314-4149-bcfd-acc9b18e752f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:24:05.408251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ed2ce-5314-4149-bcfd-acc9b18e752f service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:24:05.416230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1321/2616] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:24:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:24:05.731625 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061d4d4-cd96-4348-aeb3-599a261595f5 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:24:05.733093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c061d4d4-cd96-4348-aeb3-599a261595f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:24:05.800056 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061d4d4-cd96-4348-aeb3-599a261595f5 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:24:05.804979 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465b93e-7466-4e15-8ad8-c60afbe3f7ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7f2aea3e494546a04e20d8cedccc9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:24:05.805609 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465b93e-7466-4e15-8ad8-c60afbe3f7ed service placement] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:24:05.805890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465b93e-7466-4e15-8ad8-c60afbe3f7ed service placement] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:24:05.806163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465b93e-7466-4e15-8ad8-c60afbe3f7ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:24:05.807915 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4465b93e-7466-4e15-8ad8-c60afbe3f7ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:24:05.819453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465b93e-7466-4e15-8ad8-c60afbe3f7ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:24:05.820986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465b93e-7466-4e15-8ad8-c60afbe3f7ed service placement] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:24:05.833191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1296/2617] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:24:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:24:15.783459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ed2ce-5314-4149-bcfd-acc9b18e752f service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:24:15.799352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ed2ce-5314-4149-bcfd-acc9b18e752f service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:24:15.804932 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc40c4-ddd8-46a7-a55e-930fe42359fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:24:15.805570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc40c4-ddd8-46a7-a55e-930fe42359fa service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:24:15.805852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc40c4-ddd8-46a7-a55e-930fe42359fa service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:24:15.806126 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc40c4-ddd8-46a7-a55e-930fe42359fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:24:15.807905 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-cacc40c4-ddd8-46a7-a55e-930fe42359fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:24:15.820319 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc40c4-ddd8-46a7-a55e-930fe42359fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:24:15.821873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc40c4-ddd8-46a7-a55e-930fe42359fa service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:24:15.833004 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1322/2618] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:24:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:24:28.894404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c372a5-ecb9-4c30-ac7c-e667c58edc4b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:24:28.894922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c372a5-ecb9-4c30-ac7c-e667c58edc4b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:24:28.895030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c372a5-ecb9-4c30-ac7c-e667c58edc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:24:28.912913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-e7c372a5-ecb9-4c30-ac7c-e667c58edc4b None None] MFA Rules not processed for user `d69aad2f908c4f9e98ce80a44193125e`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:24:28.914110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e7c372a5-ecb9-4c30-ac7c-e667c58edc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:24:28.922329 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1297/2619] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:24:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:25:13.866688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc40c4-ddd8-46a7-a55e-930fe42359fa service nova] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:25:13.868137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-cacc40c4-ddd8-46a7-a55e-930fe42359fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:25:13.947590 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc40c4-ddd8-46a7-a55e-930fe42359fa service nova] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:25:13.951444 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9058398-ab39-4d8e-bfd0-cdb3f68e3f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:25:13.952079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9058398-ab39-4d8e-bfd0-cdb3f68e3f6e service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:25:13.952390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9058398-ab39-4d8e-bfd0-cdb3f68e3f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:25:13.952666 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9058398-ab39-4d8e-bfd0-cdb3f68e3f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:25:13.954404 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f9058398-ab39-4d8e-bfd0-cdb3f68e3f6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:25:13.965171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9058398-ab39-4d8e-bfd0-cdb3f68e3f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:25:13.966615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9058398-ab39-4d8e-bfd0-cdb3f68e3f6e service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:25:13.975440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1323/2620] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:25:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:25:25.945861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336a04e-ab39-4c33-85ef-4175d9ce4a52 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:25:25.946355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336a04e-ab39-4c33-85ef-4175d9ce4a52 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:25:25.946462 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336a04e-ab39-4c33-85ef-4175d9ce4a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:25:25.963686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5336a04e-ab39-4c33-85ef-4175d9ce4a52 None None] MFA Rules not processed for user `bafeedb9a9ad47e4b434b3680f6ccec2`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:25:25.964905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5336a04e-ab39-4c33-85ef-4175d9ce4a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:25:25.972174 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1298/2621] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:25:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:25:27.111989 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9058398-ab39-4d8e-bfd0-cdb3f68e3f6e service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:25:27.135626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9058398-ab39-4d8e-bfd0-cdb3f68e3f6e service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:25:27.141589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39b915-2d9b-40ca-b737-336863470bbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7f2aea3e494546a04e20d8cedccc9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:25:27.142219 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b915-2d9b-40ca-b737-336863470bbb service placement] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:25:27.142498 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b915-2d9b-40ca-b737-336863470bbb service placement] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:25:27.142767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b915-2d9b-40ca-b737-336863470bbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:25:27.144535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-3c39b915-2d9b-40ca-b737-336863470bbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:25:27.172005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39b915-2d9b-40ca-b737-336863470bbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:25:27.173611 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39b915-2d9b-40ca-b737-336863470bbb service placement] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:25:27.183298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1324/2622] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:25:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:25:44.391530 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336a04e-ab39-4c33-85ef-4175d9ce4a52 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:25:44.400894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336a04e-ab39-4c33-85ef-4175d9ce4a52 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:25:44.404502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9feff6d-5b69-464b-b486-3fc59e196a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:25:44.405119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9feff6d-5b69-464b-b486-3fc59e196a6c service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:25:44.405395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9feff6d-5b69-464b-b486-3fc59e196a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:25:44.405664 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9feff6d-5b69-464b-b486-3fc59e196a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:25:44.407408 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a9feff6d-5b69-464b-b486-3fc59e196a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:25:44.467611 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9feff6d-5b69-464b-b486-3fc59e196a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:25:44.469096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9feff6d-5b69-464b-b486-3fc59e196a6c service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:25:44.479552 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1299/2623] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:25:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:25:46.045274 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39b915-2d9b-40ca-b737-336863470bbb service placement] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:25:46.064029 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39b915-2d9b-40ca-b737-336863470bbb service placement] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:25:46.069506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884901f-911a-43da-86dc-1cf7c515b9d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:25:46.070154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884901f-911a-43da-86dc-1cf7c515b9d5 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:25:46.070433 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884901f-911a-43da-86dc-1cf7c515b9d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:25:46.070706 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884901f-911a-43da-86dc-1cf7c515b9d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:25:46.072505 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5884901f-911a-43da-86dc-1cf7c515b9d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:25:46.084455 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884901f-911a-43da-86dc-1cf7c515b9d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:25:46.086024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884901f-911a-43da-86dc-1cf7c515b9d5 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:25:46.096285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1325/2624] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:25:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:26:25.841923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9feff6d-5b69-464b-b486-3fc59e196a6c service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:25.850214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9feff6d-5b69-464b-b486-3fc59e196a6c service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:25.854151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d02d98-88e6-4f1d-a122-923789f24042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:25.854790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d02d98-88e6-4f1d-a122-923789f24042 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:25.855070 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d02d98-88e6-4f1d-a122-923789f24042 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:25.855344 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d02d98-88e6-4f1d-a122-923789f24042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:25.857159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-46d02d98-88e6-4f1d-a122-923789f24042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:25.900734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d02d98-88e6-4f1d-a122-923789f24042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:25.902862 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d02d98-88e6-4f1d-a122-923789f24042 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:25.935688 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1300/2625] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:26:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:26:27.452364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884901f-911a-43da-86dc-1cf7c515b9d5 service nova] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:27.462879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884901f-911a-43da-86dc-1cf7c515b9d5 service nova] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:27.466569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8cb52-7fe0-4013-ad64-bc52dd60f407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:27.467244 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8cb52-7fe0-4013-ad64-bc52dd60f407 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:27.467517 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8cb52-7fe0-4013-ad64-bc52dd60f407 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:27.467788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8cb52-7fe0-4013-ad64-bc52dd60f407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:27.469667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-12a8cb52-7fe0-4013-ad64-bc52dd60f407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:27.486066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8cb52-7fe0-4013-ad64-bc52dd60f407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:27.488421 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8cb52-7fe0-4013-ad64-bc52dd60f407 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:27.502623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1326/2626] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:26:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:26:32.488616 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d02d98-88e6-4f1d-a122-923789f24042 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:32.497196 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d02d98-88e6-4f1d-a122-923789f24042 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:32.501612 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ed7c-6034-4082-bc8f-a641891530ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:32.502241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ed7c-6034-4082-bc8f-a641891530ac service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:32.502521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ed7c-6034-4082-bc8f-a641891530ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:32.502793 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ed7c-6034-4082-bc8f-a641891530ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:32.504600 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-fa62ed7c-6034-4082-bc8f-a641891530ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:32.538190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62ed7c-6034-4082-bc8f-a641891530ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:32.539646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62ed7c-6034-4082-bc8f-a641891530ac service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:32.557628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1301/2627] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:26:36.199176 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8cb52-7fe0-4013-ad64-bc52dd60f407 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:36.200671 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-12a8cb52-7fe0-4013-ad64-bc52dd60f407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:36.216895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8cb52-7fe0-4013-ad64-bc52dd60f407 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:36.221959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878fa24-7294-4e88-bd6b-b9fe6c27fb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:36.222834 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878fa24-7294-4e88-bd6b-b9fe6c27fb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:36.223303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878fa24-7294-4e88-bd6b-b9fe6c27fb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:36.223749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878fa24-7294-4e88-bd6b-b9fe6c27fb2b admin admin] PATH_INFO: `/v3/users/6c0e27f69f7944a7b1f42f71fb389ab2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:36.225281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878fa24-7294-4e88-bd6b-b9fe6c27fb2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0e27f69f7944a7b1f42f71fb389ab2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:36.227387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878fa24-7294-4e88-bd6b-b9fe6c27fb2b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:36.290505 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b878fa24-7294-4e88-bd6b-b9fe6c27fb2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0e27f69f7944a7b1f42f71fb389ab2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:36.300734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b878fa24-7294-4e88-bd6b-b9fe6c27fb2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0e27f69f7944a7b1f42f71fb389ab2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:36.301966 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b878fa24-7294-4e88-bd6b-b9fe6c27fb2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0e27f69f7944a7b1f42f71fb389ab2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:36.303177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b878fa24-7294-4e88-bd6b-b9fe6c27fb2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0e27f69f7944a7b1f42f71fb389ab2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:36.317938 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b878fa24-7294-4e88-bd6b-b9fe6c27fb2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0e27f69f7944a7b1f42f71fb389ab2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:36.338993 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1327/2628] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:26:36 2022] DELETE /identity/v3/users/6c0e27f69f7944a7b1f42f71fb389ab2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:26:36.548310 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ed7c-6034-4082-bc8f-a641891530ac service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:36.567012 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ed7c-6034-4082-bc8f-a641891530ac service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:36.634938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8043c7-4254-474e-bff4-458539303ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:36.637069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8043c7-4254-474e-bff4-458539303ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:36.637359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8043c7-4254-474e-bff4-458539303ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:36.637636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8043c7-4254-474e-bff4-458539303ff3 admin admin] PATH_INFO: `/v3/projects/2c46713419c64f88b550ff6b057cdcc6` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:36.639120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8043c7-4254-474e-bff4-458539303ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c46713419c64f88b550ff6b057cdcc6)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:36.641081 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8043c7-4254-474e-bff4-458539303ff3 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:36.696830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ac8043c7-4254-474e-bff4-458539303ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c46713419c64f88b550ff6b057cdcc6', 'request_id': 'req-ac8043c7-4254-474e-bff4-458539303ff3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:36.702444 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ac8043c7-4254-474e-bff4-458539303ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c46713419c64f88b550ff6b057cdcc6', 'request_id': 'req-ac8043c7-4254-474e-bff4-458539303ff3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:36.711559 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ac8043c7-4254-474e-bff4-458539303ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c46713419c64f88b550ff6b057cdcc6', 'request_id': 'req-ac8043c7-4254-474e-bff4-458539303ff3'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:36.726321 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ac8043c7-4254-474e-bff4-458539303ff3 admin admin] The token cache is being invalidate because project 2c46713419c64f88b550ff6b057cdcc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:26:36.726855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ac8043c7-4254-474e-bff4-458539303ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:36.727526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ac8043c7-4254-474e-bff4-458539303ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:36.729295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1302/2629] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:26:36 2022] DELETE /identity/v3/projects/2c46713419c64f88b550ff6b057cdcc6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:26:36.734859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200e4f0-30e0-4fa3-b20f-1a600d13a8b0 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:36.735223 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200e4f0-30e0-4fa3-b20f-1a600d13a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:36.735565 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200e4f0-30e0-4fa3-b20f-1a600d13a8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:36.814974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-8200e4f0-30e0-4fa3-b20f-1a600d13a8b0 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:26:36.816570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8200e4f0-30e0-4fa3-b20f-1a600d13a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:36.881332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1328/2630] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:26:36.889151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc32b7-5185-4a3d-a304-ca4123ad4e7d None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:36.889654 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc32b7-5185-4a3d-a304-ca4123ad4e7d None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:36.890038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc32b7-5185-4a3d-a304-ca4123ad4e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:36.908715 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a2fc32b7-5185-4a3d-a304-ca4123ad4e7d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:26:36.910083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a2fc32b7-5185-4a3d-a304-ca4123ad4e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:36.918865 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1303/2631] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:26:36.923374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200e4f0-30e0-4fa3-b20f-1a600d13a8b0 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:36.933048 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200e4f0-30e0-4fa3-b20f-1a600d13a8b0 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:36.938266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51a82b-d61d-4331-b396-a25494ac6ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:36.938939 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51a82b-d61d-4331-b396-a25494ac6ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:36.939225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51a82b-d61d-4331-b396-a25494ac6ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:36.939503 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51a82b-d61d-4331-b396-a25494ac6ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:36.940278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51a82b-d61d-4331-b396-a25494ac6ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:26:36.940589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51a82b-d61d-4331-b396-a25494ac6ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:36.942189 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51a82b-d61d-4331-b396-a25494ac6ad0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:36.954502 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1329/2632] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:26:36.958471 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc32b7-5185-4a3d-a304-ca4123ad4e7d None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:36.968922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc32b7-5185-4a3d-a304-ca4123ad4e7d None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:36.973921 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7ca8e-1772-4bfb-bea7-1c11d11ff792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:36.974796 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7ca8e-1772-4bfb-bea7-1c11d11ff792 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:36.975231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7ca8e-1772-4bfb-bea7-1c11d11ff792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:36.975502 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7ca8e-1772-4bfb-bea7-1c11d11ff792 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:36.976519 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7ca8e-1772-4bfb-bea7-1c11d11ff792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:36.978734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7ca8e-1772-4bfb-bea7-1c11d11ff792 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:37.027761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1304/2633] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:26:36 2022] POST /identity/v3/projects => generated 365 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:26:37.032441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51a82b-d61d-4331-b396-a25494ac6ad0 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:37.050175 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51a82b-d61d-4331-b396-a25494ac6ad0 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:37.116950 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7baf97-9339-4b89-be7e-10c244a623da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:37.118459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7baf97-9339-4b89-be7e-10c244a623da admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:37.118812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7baf97-9339-4b89-be7e-10c244a623da admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:37.119155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7baf97-9339-4b89-be7e-10c244a623da admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:37.119937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7baf97-9339-4b89-be7e-10c244a623da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:37.122249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7baf97-9339-4b89-be7e-10c244a623da admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:37.148227 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1330/2634] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:26:37 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:26:37.150167 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7ca8e-1772-4bfb-bea7-1c11d11ff792 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:37.163957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7ca8e-1772-4bfb-bea7-1c11d11ff792 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:37.169546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906076c-901f-4f8b-bbb4-00330279bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:37.170535 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906076c-901f-4f8b-bbb4-00330279bac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:37.170814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906076c-901f-4f8b-bbb4-00330279bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:37.171115 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906076c-901f-4f8b-bbb4-00330279bac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:37.171843 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906076c-901f-4f8b-bbb4-00330279bac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:37.173683 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906076c-901f-4f8b-bbb4-00330279bac9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:37.188680 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1305/2635] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:26:37.190904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7baf97-9339-4b89-be7e-10c244a623da admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:37.202892 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7baf97-9339-4b89-be7e-10c244a623da admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:37.215980 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048a17b-aee2-4930-a7c9-24a97699b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:37.229280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048a17b-aee2-4930-a7c9-24a97699b427 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:37.229280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048a17b-aee2-4930-a7c9-24a97699b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:37.229494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048a17b-aee2-4930-a7c9-24a97699b427 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:37.231928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048a17b-aee2-4930-a7c9-24a97699b427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:37.233676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048a17b-aee2-4930-a7c9-24a97699b427 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:37.249663 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906076c-901f-4f8b-bbb4-00330279bac9 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:37.249923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1331/2636] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:26:37.261470 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906076c-901f-4f8b-bbb4-00330279bac9 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:37.269169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1e26a-972d-4bc4-abda-ff4c3996c819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:37.270412 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1e26a-972d-4bc4-abda-ff4c3996c819 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:37.270681 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1e26a-972d-4bc4-abda-ff4c3996c819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:37.270967 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1e26a-972d-4bc4-abda-ff4c3996c819 admin admin] PATH_INFO: `/v3/projects/83a845d5f6e242818d06a1ed9d183e17/users/ac1c2156990b4d7a8ddf5de16e8a54a7/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:37.291391 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1e26a-972d-4bc4-abda-ff4c3996c819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a845d5f6e242818d06a1ed9d183e17, user_id=ac1c2156990b4d7a8ddf5de16e8a54a7, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:37.294849 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1e26a-972d-4bc4-abda-ff4c3996c819 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:37.316147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1306/2637] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:26:37 2022] PUT /identity/v3/projects/83a845d5f6e242818d06a1ed9d183e17/users/ac1c2156990b4d7a8ddf5de16e8a54a7/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:26:37.320011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dd640-2af6-4afd-b4f9-d803eea7068f None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:37.320329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dd640-2af6-4afd-b4f9-d803eea7068f None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:37.320606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dd640-2af6-4afd-b4f9-d803eea7068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:37.349120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-812dd640-2af6-4afd-b4f9-d803eea7068f None None] MFA Rules not processed for user `ac1c2156990b4d7a8ddf5de16e8a54a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:26:37.350325 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-812dd640-2af6-4afd-b4f9-d803eea7068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:37.425400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1332/2638] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:26:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:26:37.436508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1e26a-972d-4bc4-abda-ff4c3996c819 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:37.438861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-12c1e26a-972d-4bc4-abda-ff4c3996c819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:37.501619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1e26a-972d-4bc4-abda-ff4c3996c819 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:37.505265 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcbff8-d060-4edf-b724-7b9045463184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:37.505907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcbff8-d060-4edf-b724-7b9045463184 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:37.506190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcbff8-d060-4edf-b724-7b9045463184 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:37.506465 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcbff8-d060-4edf-b724-7b9045463184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:37.514709 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcbff8-d060-4edf-b724-7b9045463184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:37.516730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcbff8-d060-4edf-b724-7b9045463184 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:37.525417 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1307/2639] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:26:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:26:38.867895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d40642-e152-408c-b2e2-e138db38fcba None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:38.868361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d40642-e152-408c-b2e2-e138db38fcba None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:38.868482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d40642-e152-408c-b2e2-e138db38fcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:38.888726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-63d40642-e152-408c-b2e2-e138db38fcba None None] MFA Rules not processed for user `d69aad2f908c4f9e98ce80a44193125e`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:26:38.890436 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-63d40642-e152-408c-b2e2-e138db38fcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:38.945491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1333/2640] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:26:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:26:45.814810 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcbff8-d060-4edf-b724-7b9045463184 service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:45.877493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcbff8-d060-4edf-b724-7b9045463184 service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:45.882031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:45.882879 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:45.883159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:45.883431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] PATH_INFO: `/v3/users/ac1c2156990b4d7a8ddf5de16e8a54a7` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:45.884675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1c2156990b4d7a8ddf5de16e8a54a7)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:45.886620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:45.932973 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1c2156990b4d7a8ddf5de16e8a54a7'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:45.942498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1c2156990b4d7a8ddf5de16e8a54a7'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:45.949261 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1c2156990b4d7a8ddf5de16e8a54a7'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:45.949901 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1c2156990b4d7a8ddf5de16e8a54a7'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:45.950508 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1c2156990b4d7a8ddf5de16e8a54a7'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:45.966648 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1308/2641] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:26:45 2022] DELETE /identity/v3/users/ac1c2156990b4d7a8ddf5de16e8a54a7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:26:45.971609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838c412-8d05-4edf-93d5-4e9b5f74d3e9 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:45.972131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838c412-8d05-4edf-93d5-4e9b5f74d3e9 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:45.972265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838c412-8d05-4edf-93d5-4e9b5f74d3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:45.990121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-5838c412-8d05-4edf-93d5-4e9b5f74d3e9 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:26:45.991290 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5838c412-8d05-4edf-93d5-4e9b5f74d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:46.045567 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1334/2642] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:26:46.055539 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:46.056957 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:46.111234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679602b-3fe0-4f87-86c3-9a9052c63bd7 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:46.114838 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9a76b-681f-4cd9-84e1-74a9f8f31d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:46.115461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9a76b-681f-4cd9-84e1-74a9f8f31d76 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:46.115742 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9a76b-681f-4cd9-84e1-74a9f8f31d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:46.116014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9a76b-681f-4cd9-84e1-74a9f8f31d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:46.124728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9a76b-681f-4cd9-84e1-74a9f8f31d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:46.126137 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9a76b-681f-4cd9-84e1-74a9f8f31d76 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:46.135273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1309/2643] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:26:46.399904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838c412-8d05-4edf-93d5-4e9b5f74d3e9 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:46.401373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5838c412-8d05-4edf-93d5-4e9b5f74d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:46.413542 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838c412-8d05-4edf-93d5-4e9b5f74d3e9 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:46.418506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:46.420121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:46.420540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:46.420839 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2 admin admin] PATH_INFO: `/v3/projects/83a845d5f6e242818d06a1ed9d183e17` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:46.422239 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a845d5f6e242818d06a1ed9d183e17)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:46.424171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:46.472878 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a845d5f6e242818d06a1ed9d183e17', 'request_id': 'req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:46.481385 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a845d5f6e242818d06a1ed9d183e17', 'request_id': 'req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:46.487090 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a845d5f6e242818d06a1ed9d183e17', 'request_id': 'req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:46.498493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2 admin admin] The token cache is being invalidate because project 83a845d5f6e242818d06a1ed9d183e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:26:46.498779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:46.500107 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-387d3e6f-c08f-43fb-b9f2-3764e6c86dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:26:46.501656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1335/2644] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:26:46 2022] DELETE /identity/v3/projects/83a845d5f6e242818d06a1ed9d183e17 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:26:46.506672 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40388eaa-95be-4684-8e14-25fcd68153e4 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:46.507058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40388eaa-95be-4684-8e14-25fcd68153e4 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:46.507431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40388eaa-95be-4684-8e14-25fcd68153e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:46.525867 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-40388eaa-95be-4684-8e14-25fcd68153e4 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:26:46.527073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-40388eaa-95be-4684-8e14-25fcd68153e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:46.584725 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1310/2645] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:26:46.592420 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b6e3-ef31-43bb-8f82-8a5b516cae8c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:46.592759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b6e3-ef31-43bb-8f82-8a5b516cae8c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:46.593222 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b6e3-ef31-43bb-8f82-8a5b516cae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:46.611929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ed02b6e3-ef31-43bb-8f82-8a5b516cae8c None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:26:46.613169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ed02b6e3-ef31-43bb-8f82-8a5b516cae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:46.621295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1336/2646] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:26:46.626176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40388eaa-95be-4684-8e14-25fcd68153e4 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:46.635431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40388eaa-95be-4684-8e14-25fcd68153e4 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:46.640522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a74e0-e420-47f3-acdb-8d94e6bb3f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:46.641166 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a74e0-e420-47f3-acdb-8d94e6bb3f92 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:46.641438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a74e0-e420-47f3-acdb-8d94e6bb3f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:46.641703 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a74e0-e420-47f3-acdb-8d94e6bb3f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:46.642420 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a74e0-e420-47f3-acdb-8d94e6bb3f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:26:46.642716 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a74e0-e420-47f3-acdb-8d94e6bb3f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:46.644315 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a74e0-e420-47f3-acdb-8d94e6bb3f92 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:46.656391 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1311/2647] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:26:46.660683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b6e3-ef31-43bb-8f82-8a5b516cae8c None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:46.670128 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b6e3-ef31-43bb-8f82-8a5b516cae8c None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:46.674775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cba5a-2eaf-406c-a4ca-4a6e83345802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:46.675412 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cba5a-2eaf-406c-a4ca-4a6e83345802 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:46.675695 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cba5a-2eaf-406c-a4ca-4a6e83345802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:46.675972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cba5a-2eaf-406c-a4ca-4a6e83345802 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:46.676738 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cba5a-2eaf-406c-a4ca-4a6e83345802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:46.678613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cba5a-2eaf-406c-a4ca-4a6e83345802 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:46.705082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1337/2648] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:26:46 2022] POST /identity/v3/projects => generated 357 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:26:46.708570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a74e0-e420-47f3-acdb-8d94e6bb3f92 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:46.718165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a74e0-e420-47f3-acdb-8d94e6bb3f92 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:46.778001 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa068206-4227-49ee-9fb6-6828ec13467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:46.778656 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa068206-4227-49ee-9fb6-6828ec13467a admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:46.778932 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa068206-4227-49ee-9fb6-6828ec13467a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:46.779201 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa068206-4227-49ee-9fb6-6828ec13467a admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:46.779886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa068206-4227-49ee-9fb6-6828ec13467a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:46.781854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa068206-4227-49ee-9fb6-6828ec13467a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:46.801686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1312/2649] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:26:46 2022] POST /identity/v3/users => generated 279 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:26:46.805800 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cba5a-2eaf-406c-a4ca-4a6e83345802 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:46.816426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cba5a-2eaf-406c-a4ca-4a6e83345802 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:46.821028 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eedad1-4031-404c-9344-ba18cc127e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:46.821671 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eedad1-4031-404c-9344-ba18cc127e3b admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:46.821953 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eedad1-4031-404c-9344-ba18cc127e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:46.822221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eedad1-4031-404c-9344-ba18cc127e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:46.822956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eedad1-4031-404c-9344-ba18cc127e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:46.824558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eedad1-4031-404c-9344-ba18cc127e3b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:46.836395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1338/2650] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:26:46.840159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa068206-4227-49ee-9fb6-6828ec13467a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:46.849986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa068206-4227-49ee-9fb6-6828ec13467a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:46.854752 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede3dac-f920-41f8-9944-30e919e9b02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:46.855533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede3dac-f920-41f8-9944-30e919e9b02b admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:46.855817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede3dac-f920-41f8-9944-30e919e9b02b admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:46.856107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede3dac-f920-41f8-9944-30e919e9b02b admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:46.856885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede3dac-f920-41f8-9944-30e919e9b02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:46.859062 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede3dac-f920-41f8-9944-30e919e9b02b admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:46.869923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1313/2651] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:26:46.874728 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eedad1-4031-404c-9344-ba18cc127e3b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:46.884762 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eedad1-4031-404c-9344-ba18cc127e3b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:46.889370 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d39647-52ef-42fd-bc95-0960eac37b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:46.890352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d39647-52ef-42fd-bc95-0960eac37b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:46.890682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d39647-52ef-42fd-bc95-0960eac37b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:46.890989 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d39647-52ef-42fd-bc95-0960eac37b35 admin admin] PATH_INFO: `/v3/projects/8ed35c0a70ad4b87bd7d1c5c566acb71/users/2991832761d64c63b2b30950e139390b/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:46.905243 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d39647-52ef-42fd-bc95-0960eac37b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed35c0a70ad4b87bd7d1c5c566acb71, user_id=2991832761d64c63b2b30950e139390b, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:46.907866 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d39647-52ef-42fd-bc95-0960eac37b35 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:46.922721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1339/2652] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:26:46 2022] PUT /identity/v3/projects/8ed35c0a70ad4b87bd7d1c5c566acb71/users/2991832761d64c63b2b30950e139390b/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:26:46.934527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3536d-9368-4d7e-8efd-214c868ac382 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:46.934819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3536d-9368-4d7e-8efd-214c868ac382 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:46.935102 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3536d-9368-4d7e-8efd-214c868ac382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:46.960960 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f3a3536d-9368-4d7e-8efd-214c868ac382 None None] MFA Rules not processed for user `2991832761d64c63b2b30950e139390b`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:26:46.962156 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f3a3536d-9368-4d7e-8efd-214c868ac382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:47.023521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1314/2653] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:26:46 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:26:47.028005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d39647-52ef-42fd-bc95-0960eac37b35 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:47.086973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d39647-52ef-42fd-bc95-0960eac37b35 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:47.091536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574d301-ca4d-435d-baee-b5c11fad031b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:47.092212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574d301-ca4d-435d-baee-b5c11fad031b admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:47.092492 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574d301-ca4d-435d-baee-b5c11fad031b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:47.092770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574d301-ca4d-435d-baee-b5c11fad031b admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:47.093458 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574d301-ca4d-435d-baee-b5c11fad031b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:47.095332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574d301-ca4d-435d-baee-b5c11fad031b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:47.119237 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1340/2654] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:26:47 2022] POST /identity/v3/projects => generated 355 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:26:47.123242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3536d-9368-4d7e-8efd-214c868ac382 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:47.134191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3536d-9368-4d7e-8efd-214c868ac382 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:47.190565 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe77089-52fa-4396-8072-247c67a3ed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:47.191216 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe77089-52fa-4396-8072-247c67a3ed60 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:47.191507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe77089-52fa-4396-8072-247c67a3ed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:47.191756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe77089-52fa-4396-8072-247c67a3ed60 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:47.192459 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe77089-52fa-4396-8072-247c67a3ed60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:47.194531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe77089-52fa-4396-8072-247c67a3ed60 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:47.213728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1315/2655] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:26:47 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:26:47.218252 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574d301-ca4d-435d-baee-b5c11fad031b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:47.228254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574d301-ca4d-435d-baee-b5c11fad031b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:47.232799 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcf658-0b2a-4efe-81e3-34dc0f918e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:47.234185 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcf658-0b2a-4efe-81e3-34dc0f918e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:47.234472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcf658-0b2a-4efe-81e3-34dc0f918e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:47.234744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcf658-0b2a-4efe-81e3-34dc0f918e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:47.235456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcf658-0b2a-4efe-81e3-34dc0f918e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:47.237050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcf658-0b2a-4efe-81e3-34dc0f918e5a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:47.247138 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1341/2656] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:26:47.251189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe77089-52fa-4396-8072-247c67a3ed60 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:47.260868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe77089-52fa-4396-8072-247c67a3ed60 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:47.266119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8689941-b580-4f29-8740-4804a94884fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:47.266999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8689941-b580-4f29-8740-4804a94884fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:47.267284 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8689941-b580-4f29-8740-4804a94884fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:47.267554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8689941-b580-4f29-8740-4804a94884fc admin admin] PATH_INFO: `/v3/projects/c488a227587d4a08b7080cacaf5610b9/users/373085fd65e14557afff376dd90e2417/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:47.283209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8689941-b580-4f29-8740-4804a94884fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c488a227587d4a08b7080cacaf5610b9, user_id=373085fd65e14557afff376dd90e2417, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:47.285886 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8689941-b580-4f29-8740-4804a94884fc admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:47.299710 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1316/2657] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:26:47 2022] PUT /identity/v3/projects/c488a227587d4a08b7080cacaf5610b9/users/373085fd65e14557afff376dd90e2417/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:26:47.303685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcf658-0b2a-4efe-81e3-34dc0f918e5a admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:47.313390 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcf658-0b2a-4efe-81e3-34dc0f918e5a admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:47.366108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd85663-ca91-481d-b1f3-49b878e3be94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:47.366682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85663-ca91-481d-b1f3-49b878e3be94 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:47.367343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85663-ca91-481d-b1f3-49b878e3be94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:47.367617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85663-ca91-481d-b1f3-49b878e3be94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:47.368359 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd85663-ca91-481d-b1f3-49b878e3be94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:47.369921 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd85663-ca91-481d-b1f3-49b878e3be94 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:47.379275 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1342/2658] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:26:47.383352 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8689941-b580-4f29-8740-4804a94884fc admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:47.393555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8689941-b580-4f29-8740-4804a94884fc admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:47.398171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d40e4-5e07-4d7d-bb10-b8b9b2f951e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:47.399837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d40e4-5e07-4d7d-bb10-b8b9b2f951e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:47.400147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d40e4-5e07-4d7d-bb10-b8b9b2f951e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:47.400422 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d40e4-5e07-4d7d-bb10-b8b9b2f951e2 admin admin] PATH_INFO: `/v3/projects/c488a227587d4a08b7080cacaf5610b9/users/373085fd65e14557afff376dd90e2417/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:47.402366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d40e4-5e07-4d7d-bb10-b8b9b2f951e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c488a227587d4a08b7080cacaf5610b9, user_id=373085fd65e14557afff376dd90e2417, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:47.405844 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d40e4-5e07-4d7d-bb10-b8b9b2f951e2 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:47.415594 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1317/2659] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:26:47 2022] PUT /identity/v3/projects/c488a227587d4a08b7080cacaf5610b9/users/373085fd65e14557afff376dd90e2417/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:26:47.426539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d79ca1-5fb1-4399-ab24-993aa1b7e61e None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:47.426828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d79ca1-5fb1-4399-ab24-993aa1b7e61e None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:47.427106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d79ca1-5fb1-4399-ab24-993aa1b7e61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:47.452790 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b4d79ca1-5fb1-4399-ab24-993aa1b7e61e None None] MFA Rules not processed for user `373085fd65e14557afff376dd90e2417`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:26:47.453963 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b4d79ca1-5fb1-4399-ab24-993aa1b7e61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:47.518212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1343/2660] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:26:47 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:26:47.529186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d40e4-5e07-4d7d-bb10-b8b9b2f951e2 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:47.531340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d63d40e4-5e07-4d7d-bb10-b8b9b2f951e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:26:47.585315 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d40e4-5e07-4d7d-bb10-b8b9b2f951e2 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:47.588885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbc163-97f5-4f43-afe4-bfc93768ec45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:47.589498 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbc163-97f5-4f43-afe4-bfc93768ec45 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:47.589773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbc163-97f5-4f43-afe4-bfc93768ec45 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:47.590044 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbc163-97f5-4f43-afe4-bfc93768ec45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:47.599571 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbc163-97f5-4f43-afe4-bfc93768ec45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:47.600994 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbc163-97f5-4f43-afe4-bfc93768ec45 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:47.610445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1318/2661] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:26:47 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:26:47.681448 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d79ca1-5fb1-4399-ab24-993aa1b7e61e None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:26:47.691375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d79ca1-5fb1-4399-ab24-993aa1b7e61e None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:26:47.695093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399aa90-8130-4436-ad42-9072284c3079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:26:47.695797 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399aa90-8130-4436-ad42-9072284c3079 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:26:47.696202 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399aa90-8130-4436-ad42-9072284c3079 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:26:47.696539 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399aa90-8130-4436-ad42-9072284c3079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:26:47.752494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399aa90-8130-4436-ad42-9072284c3079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:26:47.753916 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399aa90-8130-4436-ad42-9072284c3079 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:26:47.762742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1344/2662] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:26:47 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:27:02.315312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbc163-97f5-4f43-afe4-bfc93768ec45 service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:02.375892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbc163-97f5-4f43-afe4-bfc93768ec45 service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:02.385176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:02.386128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:02.386312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:02.386581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] PATH_INFO: `/v3/users/2991832761d64c63b2b30950e139390b` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:02.387792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2991832761d64c63b2b30950e139390b)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:02.389744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:02.433860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2991832761d64c63b2b30950e139390b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:02.440547 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2991832761d64c63b2b30950e139390b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:02.447458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2991832761d64c63b2b30950e139390b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:02.448110 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2991832761d64c63b2b30950e139390b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:02.448735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2991832761d64c63b2b30950e139390b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:02.465172 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1319/2663] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:27:02 2022] DELETE /identity/v3/users/2991832761d64c63b2b30950e139390b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:27:02.469813 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e44bb-90ad-44f5-b400-541a1f0fa03b None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:02.470812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e44bb-90ad-44f5-b400-541a1f0fa03b None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:02.470933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e44bb-90ad-44f5-b400-541a1f0fa03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:02.488352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f74e44bb-90ad-44f5-b400-541a1f0fa03b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:02.489720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f74e44bb-90ad-44f5-b400-541a1f0fa03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:02.546367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1345/2664] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:27:02.556276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:02.557596 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:02.612845 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8d0bc-fe07-4786-9534-cb273b2fa451 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:02.616446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5fac1-d13f-47e1-8fb3-cf534ae655f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:02.617082 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5fac1-d13f-47e1-8fb3-cf534ae655f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:02.617362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5fac1-d13f-47e1-8fb3-cf534ae655f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:02.617633 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5fac1-d13f-47e1-8fb3-cf534ae655f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:02.626353 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5fac1-d13f-47e1-8fb3-cf534ae655f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:02.627768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5fac1-d13f-47e1-8fb3-cf534ae655f9 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:02.636984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1320/2665] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:27:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:27:02.897388 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e44bb-90ad-44f5-b400-541a1f0fa03b None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:02.898910 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f74e44bb-90ad-44f5-b400-541a1f0fa03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:02.911734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e44bb-90ad-44f5-b400-541a1f0fa03b None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:02.916434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:02.917647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:02.917993 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:02.918858 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] PATH_INFO: `/v3/projects/8ed35c0a70ad4b87bd7d1c5c566acb71` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:02.919772 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed35c0a70ad4b87bd7d1c5c566acb71)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:02.922123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:02.967710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed35c0a70ad4b87bd7d1c5c566acb71', 'request_id': 'req-1193875d-43e4-45b3-8540-eae7168ff2b2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:02.974147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed35c0a70ad4b87bd7d1c5c566acb71', 'request_id': 'req-1193875d-43e4-45b3-8540-eae7168ff2b2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:02.979427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed35c0a70ad4b87bd7d1c5c566acb71', 'request_id': 'req-1193875d-43e4-45b3-8540-eae7168ff2b2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:02.990364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] The token cache is being invalidate because project 8ed35c0a70ad4b87bd7d1c5c566acb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:27:02.990647 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:02.991309 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:02.992865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1346/2666] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:27:02 2022] DELETE /identity/v3/projects/8ed35c0a70ad4b87bd7d1c5c566acb71 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:27:02.996797 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5fac1-d13f-47e1-8fb3-cf534ae655f9 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:03.007858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5fac1-d13f-47e1-8fb3-cf534ae655f9 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:03.061820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be77cd7-d22f-4245-b0cb-18d7900fa236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:03.062667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be77cd7-d22f-4245-b0cb-18d7900fa236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:03.062941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be77cd7-d22f-4245-b0cb-18d7900fa236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:03.063209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be77cd7-d22f-4245-b0cb-18d7900fa236 admin admin] PATH_INFO: `/v3/users/373085fd65e14557afff376dd90e2417` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:03.064419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be77cd7-d22f-4245-b0cb-18d7900fa236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=373085fd65e14557afff376dd90e2417)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:03.066296 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be77cd7-d22f-4245-b0cb-18d7900fa236 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:03.111433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-6be77cd7-d22f-4245-b0cb-18d7900fa236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '373085fd65e14557afff376dd90e2417'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:03.118039 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-6be77cd7-d22f-4245-b0cb-18d7900fa236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '373085fd65e14557afff376dd90e2417'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:03.124577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-6be77cd7-d22f-4245-b0cb-18d7900fa236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '373085fd65e14557afff376dd90e2417'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:03.125198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-6be77cd7-d22f-4245-b0cb-18d7900fa236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '373085fd65e14557afff376dd90e2417'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:03.125797 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-6be77cd7-d22f-4245-b0cb-18d7900fa236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '373085fd65e14557afff376dd90e2417'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:03.142168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1321/2667] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:27:02 2022] DELETE /identity/v3/users/373085fd65e14557afff376dd90e2417 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:27:03.400423 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:03.401823 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:03.417250 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193875d-43e4-45b3-8540-eae7168ff2b2 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:03.471688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c13841-7ae4-4b94-a07e-ab060187679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:03.472563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c13841-7ae4-4b94-a07e-ab060187679b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:03.472839 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c13841-7ae4-4b94-a07e-ab060187679b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:03.473108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c13841-7ae4-4b94-a07e-ab060187679b admin admin] PATH_INFO: `/v3/projects/c488a227587d4a08b7080cacaf5610b9` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:03.474278 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c13841-7ae4-4b94-a07e-ab060187679b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c488a227587d4a08b7080cacaf5610b9)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:03.476282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c13841-7ae4-4b94-a07e-ab060187679b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:03.519694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c4c13841-7ae4-4b94-a07e-ab060187679b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c488a227587d4a08b7080cacaf5610b9', 'request_id': 'req-c4c13841-7ae4-4b94-a07e-ab060187679b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:03.525966 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c4c13841-7ae4-4b94-a07e-ab060187679b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c488a227587d4a08b7080cacaf5610b9', 'request_id': 'req-c4c13841-7ae4-4b94-a07e-ab060187679b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:03.531418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c4c13841-7ae4-4b94-a07e-ab060187679b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c488a227587d4a08b7080cacaf5610b9', 'request_id': 'req-c4c13841-7ae4-4b94-a07e-ab060187679b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:03.541714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c4c13841-7ae4-4b94-a07e-ab060187679b admin admin] The token cache is being invalidate because project c488a227587d4a08b7080cacaf5610b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:27:03.542258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c4c13841-7ae4-4b94-a07e-ab060187679b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:03.542874 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c4c13841-7ae4-4b94-a07e-ab060187679b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:03.544418 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1347/2668] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:27:03 2022] DELETE /identity/v3/projects/c488a227587d4a08b7080cacaf5610b9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:27:03.549726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf88c3f-52b3-41b5-9c29-995806f8d424 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:03.550195 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf88c3f-52b3-41b5-9c29-995806f8d424 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:03.550322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf88c3f-52b3-41b5-9c29-995806f8d424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:03.568433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-aaf88c3f-52b3-41b5-9c29-995806f8d424 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:03.569616 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-aaf88c3f-52b3-41b5-9c29-995806f8d424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:03.624861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1322/2669] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:27:03.633097 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7189f4-5374-46d6-b06d-db96d0223e07 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:03.633386 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7189f4-5374-46d6-b06d-db96d0223e07 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:03.633685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7189f4-5374-46d6-b06d-db96d0223e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:03.652757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-aa7189f4-5374-46d6-b06d-db96d0223e07 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:03.653956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-aa7189f4-5374-46d6-b06d-db96d0223e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:03.662324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1348/2670] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:27:03.666518 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf88c3f-52b3-41b5-9c29-995806f8d424 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:03.676866 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf88c3f-52b3-41b5-9c29-995806f8d424 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:03.681468 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a7e75-41e7-45e1-b0f3-846a4abaff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:03.682108 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a7e75-41e7-45e1-b0f3-846a4abaff92 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:03.682390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a7e75-41e7-45e1-b0f3-846a4abaff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:03.682667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a7e75-41e7-45e1-b0f3-846a4abaff92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:03.683420 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a7e75-41e7-45e1-b0f3-846a4abaff92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:27:03.683724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a7e75-41e7-45e1-b0f3-846a4abaff92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:03.685340 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a7e75-41e7-45e1-b0f3-846a4abaff92 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:03.696493 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1323/2671] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:27:03.700613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7189f4-5374-46d6-b06d-db96d0223e07 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:03.709512 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7189f4-5374-46d6-b06d-db96d0223e07 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:03.714074 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a982fc5-94b9-47de-aef4-944f380b9728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:03.714707 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a982fc5-94b9-47de-aef4-944f380b9728 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:03.714987 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a982fc5-94b9-47de-aef4-944f380b9728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:03.715260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a982fc5-94b9-47de-aef4-944f380b9728 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:03.715960 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a982fc5-94b9-47de-aef4-944f380b9728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:03.717842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a982fc5-94b9-47de-aef4-944f380b9728 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:03.742563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1349/2672] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:27:03 2022] POST /identity/v3/projects => generated 365 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:27:03.746523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a7e75-41e7-45e1-b0f3-846a4abaff92 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:03.755978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a7e75-41e7-45e1-b0f3-846a4abaff92 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:03.809555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd00a68-0533-4ddc-9660-dd6818631252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:03.810210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd00a68-0533-4ddc-9660-dd6818631252 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:03.810491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd00a68-0533-4ddc-9660-dd6818631252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:03.810765 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd00a68-0533-4ddc-9660-dd6818631252 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:03.811455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd00a68-0533-4ddc-9660-dd6818631252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:03.813631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd00a68-0533-4ddc-9660-dd6818631252 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:03.831573 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1324/2673] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:27:03 2022] POST /identity/v3/users => generated 283 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:27:03.835808 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a982fc5-94b9-47de-aef4-944f380b9728 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:03.846381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a982fc5-94b9-47de-aef4-944f380b9728 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:03.851070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecb934-74d5-47e4-aa3f-e5ec40e54220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:03.851722 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecb934-74d5-47e4-aa3f-e5ec40e54220 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:03.852002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecb934-74d5-47e4-aa3f-e5ec40e54220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:03.852306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecb934-74d5-47e4-aa3f-e5ec40e54220 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:03.853034 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecb934-74d5-47e4-aa3f-e5ec40e54220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:03.854637 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecb934-74d5-47e4-aa3f-e5ec40e54220 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:03.865491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1350/2674] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:27:03.869105 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd00a68-0533-4ddc-9660-dd6818631252 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:03.878598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd00a68-0533-4ddc-9660-dd6818631252 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:03.883181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8efe3-9413-40b7-a23f-aa334b8eca96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:03.883819 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8efe3-9413-40b7-a23f-aa334b8eca96 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:03.884112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8efe3-9413-40b7-a23f-aa334b8eca96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:03.884406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8efe3-9413-40b7-a23f-aa334b8eca96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:03.885124 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8efe3-9413-40b7-a23f-aa334b8eca96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:03.886685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8efe3-9413-40b7-a23f-aa334b8eca96 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:03.896874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1325/2675] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:27:03.900702 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecb934-74d5-47e4-aa3f-e5ec40e54220 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:03.910817 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecb934-74d5-47e4-aa3f-e5ec40e54220 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:03.915240 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759614-cd53-434e-beb7-4ad774666507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:03.916108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759614-cd53-434e-beb7-4ad774666507 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:03.916394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759614-cd53-434e-beb7-4ad774666507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:03.916663 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759614-cd53-434e-beb7-4ad774666507 admin admin] PATH_INFO: `/v3/projects/295dfbdb155c4e7ea232545e88938fee/users/4a9c7f9db72940c08508b1c808cde536/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:03.931898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb759614-cd53-434e-beb7-4ad774666507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=295dfbdb155c4e7ea232545e88938fee, user_id=4a9c7f9db72940c08508b1c808cde536, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:03.934552 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb759614-cd53-434e-beb7-4ad774666507 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:03.946896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1351/2676] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:27:03 2022] PUT /identity/v3/projects/295dfbdb155c4e7ea232545e88938fee/users/4a9c7f9db72940c08508b1c808cde536/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:27:03.957868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9de4bc-9698-4a2a-94c7-2628eb1fd7c3 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:03.958156 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9de4bc-9698-4a2a-94c7-2628eb1fd7c3 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:03.958455 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9de4bc-9698-4a2a-94c7-2628eb1fd7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:03.985154 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-3b9de4bc-9698-4a2a-94c7-2628eb1fd7c3 None None] MFA Rules not processed for user `4a9c7f9db72940c08508b1c808cde536`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:03.986903 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3b9de4bc-9698-4a2a-94c7-2628eb1fd7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:04.048689 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1326/2677] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:27:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:27:04.053137 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759614-cd53-434e-beb7-4ad774666507 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:04.111648 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759614-cd53-434e-beb7-4ad774666507 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:04.116806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a32c2a-ca9e-437d-bca8-8c60fb82fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:04.117439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a32c2a-ca9e-437d-bca8-8c60fb82fbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:04.117715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a32c2a-ca9e-437d-bca8-8c60fb82fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:04.117984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a32c2a-ca9e-437d-bca8-8c60fb82fbc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:04.118649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a32c2a-ca9e-437d-bca8-8c60fb82fbc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:04.120536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a32c2a-ca9e-437d-bca8-8c60fb82fbc6 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:04.144075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1352/2678] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:27:04 2022] POST /identity/v3/projects => generated 369 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:27:04.148005 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9de4bc-9698-4a2a-94c7-2628eb1fd7c3 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:04.158990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9de4bc-9698-4a2a-94c7-2628eb1fd7c3 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:04.211234 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c1c4b-904a-463f-a305-19dde20d6acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:04.211817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c1c4b-904a-463f-a305-19dde20d6acc admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:04.212109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c1c4b-904a-463f-a305-19dde20d6acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:04.212391 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c1c4b-904a-463f-a305-19dde20d6acc admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:04.213080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c1c4b-904a-463f-a305-19dde20d6acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:04.215273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c1c4b-904a-463f-a305-19dde20d6acc admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:04.235326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1327/2679] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:27:04 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:27:04.239287 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a32c2a-ca9e-437d-bca8-8c60fb82fbc6 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:04.249295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a32c2a-ca9e-437d-bca8-8c60fb82fbc6 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:04.253890 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6309e-1e21-40a3-842f-63d79057d74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:04.254527 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6309e-1e21-40a3-842f-63d79057d74c admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:04.254805 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6309e-1e21-40a3-842f-63d79057d74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:04.255075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6309e-1e21-40a3-842f-63d79057d74c admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:04.255784 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6309e-1e21-40a3-842f-63d79057d74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:04.257376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6309e-1e21-40a3-842f-63d79057d74c admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:04.267979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1353/2680] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:27:04.271861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c1c4b-904a-463f-a305-19dde20d6acc admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:04.281735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c1c4b-904a-463f-a305-19dde20d6acc admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:04.286931 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399db482-a960-4b67-8a05-b0a93cb33377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:04.287790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399db482-a960-4b67-8a05-b0a93cb33377 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:04.288071 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399db482-a960-4b67-8a05-b0a93cb33377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:04.288379 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399db482-a960-4b67-8a05-b0a93cb33377 admin admin] PATH_INFO: `/v3/projects/ffde4a4a71b643f7b5a5c58b04f9fde7/users/59ed22e4bf0243ed9e55121d67a68116/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:04.302936 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399db482-a960-4b67-8a05-b0a93cb33377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffde4a4a71b643f7b5a5c58b04f9fde7, user_id=59ed22e4bf0243ed9e55121d67a68116, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:04.305705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399db482-a960-4b67-8a05-b0a93cb33377 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:04.318635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1328/2681] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:27:04 2022] PUT /identity/v3/projects/ffde4a4a71b643f7b5a5c58b04f9fde7/users/59ed22e4bf0243ed9e55121d67a68116/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:27:04.322502 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6309e-1e21-40a3-842f-63d79057d74c admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:04.332593 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6309e-1e21-40a3-842f-63d79057d74c admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:04.385345 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c157d-0185-44fe-9163-febc886a9f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:04.386001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c157d-0185-44fe-9163-febc886a9f37 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:04.386277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c157d-0185-44fe-9163-febc886a9f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:04.386549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c157d-0185-44fe-9163-febc886a9f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:04.387286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c157d-0185-44fe-9163-febc886a9f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:04.388921 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c157d-0185-44fe-9163-febc886a9f37 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:04.402246 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1354/2682] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:27:04.403598 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399db482-a960-4b67-8a05-b0a93cb33377 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:04.415292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399db482-a960-4b67-8a05-b0a93cb33377 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:04.420237 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb181e2-bbdb-4d0d-b32f-d48a17ac01ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:04.421104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb181e2-bbdb-4d0d-b32f-d48a17ac01ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:04.421388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb181e2-bbdb-4d0d-b32f-d48a17ac01ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:04.421660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb181e2-bbdb-4d0d-b32f-d48a17ac01ce admin admin] PATH_INFO: `/v3/projects/ffde4a4a71b643f7b5a5c58b04f9fde7/users/59ed22e4bf0243ed9e55121d67a68116/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:04.423604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb181e2-bbdb-4d0d-b32f-d48a17ac01ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffde4a4a71b643f7b5a5c58b04f9fde7, user_id=59ed22e4bf0243ed9e55121d67a68116, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:04.426240 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb181e2-bbdb-4d0d-b32f-d48a17ac01ce admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:04.436025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1329/2683] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:27:04 2022] PUT /identity/v3/projects/ffde4a4a71b643f7b5a5c58b04f9fde7/users/59ed22e4bf0243ed9e55121d67a68116/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:27:04.446490 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f5f8e-81d0-4e86-b89f-83f98b35ccc6 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:04.446775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f5f8e-81d0-4e86-b89f-83f98b35ccc6 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:04.447047 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f5f8e-81d0-4e86-b89f-83f98b35ccc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:04.472652 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-933f5f8e-81d0-4e86-b89f-83f98b35ccc6 None None] MFA Rules not processed for user `59ed22e4bf0243ed9e55121d67a68116`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:04.473756 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-933f5f8e-81d0-4e86-b89f-83f98b35ccc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:04.539446 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1355/2684] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:27:04 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:27:04.550325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb181e2-bbdb-4d0d-b32f-d48a17ac01ce admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:04.552032 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ccb181e2-bbdb-4d0d-b32f-d48a17ac01ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:04.606128 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb181e2-bbdb-4d0d-b32f-d48a17ac01ce admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:04.609754 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592db7ff-d2eb-48e9-bbf9-2c9291f5926c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:04.610371 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592db7ff-d2eb-48e9-bbf9-2c9291f5926c service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:04.610676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592db7ff-d2eb-48e9-bbf9-2c9291f5926c service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:04.610949 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592db7ff-d2eb-48e9-bbf9-2c9291f5926c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:04.619584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592db7ff-d2eb-48e9-bbf9-2c9291f5926c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:04.621016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592db7ff-d2eb-48e9-bbf9-2c9291f5926c service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:04.630574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1330/2685] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:27:04 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:27:05.884996 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f5f8e-81d0-4e86-b89f-83f98b35ccc6 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:05.944243 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f5f8e-81d0-4e86-b89f-83f98b35ccc6 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:05.948649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:05.949499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:05.949777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:05.950044 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] PATH_INFO: `/v3/users/4a9c7f9db72940c08508b1c808cde536` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:05.951213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9c7f9db72940c08508b1c808cde536)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:05.953155 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:05.995989 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9c7f9db72940c08508b1c808cde536'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.002961 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9c7f9db72940c08508b1c808cde536'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.003593 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9c7f9db72940c08508b1c808cde536'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.004298 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9c7f9db72940c08508b1c808cde536'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.015968 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9c7f9db72940c08508b1c808cde536'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.028606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1356/2686] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:27:05 2022] DELETE /identity/v3/users/4a9c7f9db72940c08508b1c808cde536 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:27:06.033273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87af583-b588-4459-a07e-2b5682643465 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:06.033771 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87af583-b588-4459-a07e-2b5682643465 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:06.033872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87af583-b588-4459-a07e-2b5682643465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:06.051183 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f87af583-b588-4459-a07e-2b5682643465 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:06.052425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f87af583-b588-4459-a07e-2b5682643465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:06.107064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1331/2687] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:27:06.116879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:06.118258 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:06.172809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c999ba-755c-4998-b2d2-c25c5328a440 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:06.176468 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd611846-259d-42e8-a12f-90a8676c7b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:06.177096 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd611846-259d-42e8-a12f-90a8676c7b7b service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:06.177376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd611846-259d-42e8-a12f-90a8676c7b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:06.177650 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd611846-259d-42e8-a12f-90a8676c7b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:06.186256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd611846-259d-42e8-a12f-90a8676c7b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:06.187678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd611846-259d-42e8-a12f-90a8676c7b7b service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:06.197305 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1357/2688] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:27:06.448747 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87af583-b588-4459-a07e-2b5682643465 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:06.450161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f87af583-b588-4459-a07e-2b5682643465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:06.467741 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87af583-b588-4459-a07e-2b5682643465 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:06.472687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:06.473450 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:06.473756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:06.474076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] PATH_INFO: `/v3/projects/295dfbdb155c4e7ea232545e88938fee` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:06.475184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=295dfbdb155c4e7ea232545e88938fee)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:06.477082 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:06.522698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '295dfbdb155c4e7ea232545e88938fee', 'request_id': 'req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.527884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '295dfbdb155c4e7ea232545e88938fee', 'request_id': 'req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.534728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '295dfbdb155c4e7ea232545e88938fee', 'request_id': 'req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.545524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] The token cache is being invalidate because project 295dfbdb155c4e7ea232545e88938fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:27:06.545805 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.546414 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.548458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1332/2689] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:27:06 2022] DELETE /identity/v3/projects/295dfbdb155c4e7ea232545e88938fee => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:27:06.552385 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd611846-259d-42e8-a12f-90a8676c7b7b service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:06.561767 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd611846-259d-42e8-a12f-90a8676c7b7b service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:06.615841 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab137086-8a11-4c96-ab93-20e68b955591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:06.616729 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137086-8a11-4c96-ab93-20e68b955591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:06.617008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137086-8a11-4c96-ab93-20e68b955591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:06.617282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137086-8a11-4c96-ab93-20e68b955591 admin admin] PATH_INFO: `/v3/users/59ed22e4bf0243ed9e55121d67a68116` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:06.618451 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab137086-8a11-4c96-ab93-20e68b955591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ed22e4bf0243ed9e55121d67a68116)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:06.620367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab137086-8a11-4c96-ab93-20e68b955591 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:06.664958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ab137086-8a11-4c96-ab93-20e68b955591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ed22e4bf0243ed9e55121d67a68116'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.671692 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ab137086-8a11-4c96-ab93-20e68b955591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ed22e4bf0243ed9e55121d67a68116'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.672361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ab137086-8a11-4c96-ab93-20e68b955591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ed22e4bf0243ed9e55121d67a68116'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.672954 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ab137086-8a11-4c96-ab93-20e68b955591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ed22e4bf0243ed9e55121d67a68116'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.684440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ab137086-8a11-4c96-ab93-20e68b955591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ed22e4bf0243ed9e55121d67a68116'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:06.696144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1358/2690] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:27:06 2022] DELETE /identity/v3/users/59ed22e4bf0243ed9e55121d67a68116 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:27:06.961076 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:06.962477 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:06.975884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06e24b-0f3d-4c04-9bfd-4f5f87248832 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:07.031712 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cab08-1f27-459d-9821-31b8fc104976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:07.033176 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cab08-1f27-459d-9821-31b8fc104976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:07.033459 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cab08-1f27-459d-9821-31b8fc104976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:07.034014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cab08-1f27-459d-9821-31b8fc104976 admin admin] PATH_INFO: `/v3/projects/ffde4a4a71b643f7b5a5c58b04f9fde7` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:07.034892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37cab08-1f27-459d-9821-31b8fc104976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffde4a4a71b643f7b5a5c58b04f9fde7)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:07.036831 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37cab08-1f27-459d-9821-31b8fc104976 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:07.081327 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d37cab08-1f27-459d-9821-31b8fc104976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffde4a4a71b643f7b5a5c58b04f9fde7', 'request_id': 'req-d37cab08-1f27-459d-9821-31b8fc104976'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:07.086404 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d37cab08-1f27-459d-9821-31b8fc104976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffde4a4a71b643f7b5a5c58b04f9fde7', 'request_id': 'req-d37cab08-1f27-459d-9821-31b8fc104976'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:07.092924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d37cab08-1f27-459d-9821-31b8fc104976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffde4a4a71b643f7b5a5c58b04f9fde7', 'request_id': 'req-d37cab08-1f27-459d-9821-31b8fc104976'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:07.104230 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d37cab08-1f27-459d-9821-31b8fc104976 admin admin] The token cache is being invalidate because project ffde4a4a71b643f7b5a5c58b04f9fde7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:27:07.104513 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d37cab08-1f27-459d-9821-31b8fc104976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:07.105347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-d37cab08-1f27-459d-9821-31b8fc104976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:27:07.106872 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1333/2691] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:27:06 2022] DELETE /identity/v3/projects/ffde4a4a71b643f7b5a5c58b04f9fde7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:27:07.112923 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f8163-8f25-4428-82ca-9e2d81a77909 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:07.113395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f8163-8f25-4428-82ca-9e2d81a77909 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:07.113513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f8163-8f25-4428-82ca-9e2d81a77909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:07.132974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-4e9f8163-8f25-4428-82ca-9e2d81a77909 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:07.134370 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4e9f8163-8f25-4428-82ca-9e2d81a77909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:07.195936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1359/2692] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:27:07.205159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6223d-25d5-427c-80bf-02f1a2d2b424 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:07.205443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6223d-25d5-427c-80bf-02f1a2d2b424 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:07.205712 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6223d-25d5-427c-80bf-02f1a2d2b424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:07.225035 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-7bf6223d-25d5-427c-80bf-02f1a2d2b424 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:07.226631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7bf6223d-25d5-427c-80bf-02f1a2d2b424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:07.233937 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1334/2693] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:27:07.238027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f8163-8f25-4428-82ca-9e2d81a77909 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:07.247518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f8163-8f25-4428-82ca-9e2d81a77909 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:07.252267 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8e69b-3a71-4aab-89e4-63c591fbae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:07.252907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8e69b-3a71-4aab-89e4-63c591fbae19 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:07.253183 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8e69b-3a71-4aab-89e4-63c591fbae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:07.253452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8e69b-3a71-4aab-89e4-63c591fbae19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:07.254195 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8e69b-3a71-4aab-89e4-63c591fbae19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:27:07.254521 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8e69b-3a71-4aab-89e4-63c591fbae19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:07.256103 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8e69b-3a71-4aab-89e4-63c591fbae19 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:07.268174 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1360/2694] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:27:07.272544 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6223d-25d5-427c-80bf-02f1a2d2b424 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:07.281458 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6223d-25d5-427c-80bf-02f1a2d2b424 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:07.286651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c3d9-79c8-4eda-9598-8f02c832afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:07.287283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c3d9-79c8-4eda-9598-8f02c832afae admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:07.287557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c3d9-79c8-4eda-9598-8f02c832afae admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:07.287824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c3d9-79c8-4eda-9598-8f02c832afae admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:07.288579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395c3d9-79c8-4eda-9598-8f02c832afae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:07.290448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395c3d9-79c8-4eda-9598-8f02c832afae admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:07.314308 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1335/2695] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:27:07 2022] POST /identity/v3/projects => generated 371 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:27:07.318372 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8e69b-3a71-4aab-89e4-63c591fbae19 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:07.327982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8e69b-3a71-4aab-89e4-63c591fbae19 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:07.380859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd515ea0-4fa6-44f8-acc6-0712126e9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:07.381445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd515ea0-4fa6-44f8-acc6-0712126e9ade admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:07.381725 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd515ea0-4fa6-44f8-acc6-0712126e9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:07.381997 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd515ea0-4fa6-44f8-acc6-0712126e9ade admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:07.382665 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd515ea0-4fa6-44f8-acc6-0712126e9ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:07.384583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd515ea0-4fa6-44f8-acc6-0712126e9ade admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:07.404113 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1361/2696] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:27:07 2022] POST /identity/v3/users => generated 286 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:27:07.408946 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c3d9-79c8-4eda-9598-8f02c832afae admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:07.419620 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c3d9-79c8-4eda-9598-8f02c832afae admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:07.430381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82021d48-bd9c-480e-98ce-4d6eb6681d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:07.430381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82021d48-bd9c-480e-98ce-4d6eb6681d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:07.430381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82021d48-bd9c-480e-98ce-4d6eb6681d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:07.430381 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82021d48-bd9c-480e-98ce-4d6eb6681d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:07.430825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82021d48-bd9c-480e-98ce-4d6eb6681d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:07.430825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82021d48-bd9c-480e-98ce-4d6eb6681d35 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:07.438015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1336/2697] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:27:07.443049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd515ea0-4fa6-44f8-acc6-0712126e9ade admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:07.452873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd515ea0-4fa6-44f8-acc6-0712126e9ade admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:07.458041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557ac21-d1e1-4bcd-9f2c-3768679a7d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:07.458678 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ac21-d1e1-4bcd-9f2c-3768679a7d73 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:07.458976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ac21-d1e1-4bcd-9f2c-3768679a7d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:07.459244 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ac21-d1e1-4bcd-9f2c-3768679a7d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:07.459958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557ac21-d1e1-4bcd-9f2c-3768679a7d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:07.461554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557ac21-d1e1-4bcd-9f2c-3768679a7d73 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:07.471578 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1362/2698] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:27:07.475377 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82021d48-bd9c-480e-98ce-4d6eb6681d35 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:07.484961 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82021d48-bd9c-480e-98ce-4d6eb6681d35 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:07.489599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2086a-1275-4236-af6a-22b383bf9413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:07.490457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2086a-1275-4236-af6a-22b383bf9413 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:07.490740 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2086a-1275-4236-af6a-22b383bf9413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:07.491014 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2086a-1275-4236-af6a-22b383bf9413 admin admin] PATH_INFO: `/v3/projects/47aa19e925b34b6e91c11ed0200c31b4/users/cba7a1c788bb4e0c91648b15ee054a82/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:07.506319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2086a-1275-4236-af6a-22b383bf9413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47aa19e925b34b6e91c11ed0200c31b4, user_id=cba7a1c788bb4e0c91648b15ee054a82, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:07.508959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2086a-1275-4236-af6a-22b383bf9413 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:07.521556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1337/2699] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:27:07 2022] PUT /identity/v3/projects/47aa19e925b34b6e91c11ed0200c31b4/users/cba7a1c788bb4e0c91648b15ee054a82/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:27:07.526731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aefb5-1c7c-46c3-957f-1630c79f9e2b None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:07.527016 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aefb5-1c7c-46c3-957f-1630c79f9e2b None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:07.527291 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aefb5-1c7c-46c3-957f-1630c79f9e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:07.543865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-115aefb5-1c7c-46c3-957f-1630c79f9e2b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:07.545081 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-115aefb5-1c7c-46c3-957f-1630c79f9e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:07.599445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1363/2700] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:27:07.608837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2086a-1275-4236-af6a-22b383bf9413 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:07.610543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4aa2086a-1275-4236-af6a-22b383bf9413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:07.665835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2086a-1275-4236-af6a-22b383bf9413 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:07.669680 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d61b9f-0237-40ec-9422-e8609c708a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:07.670309 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d61b9f-0237-40ec-9422-e8609c708a6f service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:07.670587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d61b9f-0237-40ec-9422-e8609c708a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:07.670856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d61b9f-0237-40ec-9422-e8609c708a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:07.679588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d61b9f-0237-40ec-9422-e8609c708a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:07.681030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d61b9f-0237-40ec-9422-e8609c708a6f service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:07.690700 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1338/2701] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:27:08.258908 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc237-16f6-4a57-a399-2ea5c2c39f4c None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:08.259467 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc237-16f6-4a57-a399-2ea5c2c39f4c None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:08.259644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc237-16f6-4a57-a399-2ea5c2c39f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:08.286123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-115dc237-16f6-4a57-a399-2ea5c2c39f4c None None] MFA Rules not processed for user `cba7a1c788bb4e0c91648b15ee054a82`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:08.287332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-115dc237-16f6-4a57-a399-2ea5c2c39f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:08.354024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1364/2702] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:27:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:27:08.362312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d61b9f-0237-40ec-9422-e8609c708a6f service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:08.363846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c0d61b9f-0237-40ec-9422-e8609c708a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:08.418163 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d61b9f-0237-40ec-9422-e8609c708a6f service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:08.421913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed099e-bf05-46bc-b371-13534f5db6b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:08.422549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed099e-bf05-46bc-b371-13534f5db6b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:08.422826 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed099e-bf05-46bc-b371-13534f5db6b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:08.423662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed099e-bf05-46bc-b371-13534f5db6b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:08.432821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed099e-bf05-46bc-b371-13534f5db6b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:08.434250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed099e-bf05-46bc-b371-13534f5db6b2 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:08.442943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1339/2703] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:27:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:27:09.773146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119dd61-c17b-47de-b8aa-9856e852b4dc None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:09.773718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119dd61-c17b-47de-b8aa-9856e852b4dc None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:09.773718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119dd61-c17b-47de-b8aa-9856e852b4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:09.795686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-6119dd61-c17b-47de-b8aa-9856e852b4dc None None] MFA Rules not processed for user `cba7a1c788bb4e0c91648b15ee054a82`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:09.796914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6119dd61-c17b-47de-b8aa-9856e852b4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:09.804266 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1365/2704] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:27:26.092503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28b179-ac47-4447-8358-b867681012a6 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:26.093083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28b179-ac47-4447-8358-b867681012a6 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:26.093204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28b179-ac47-4447-8358-b867681012a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:26.111294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5a28b179-ac47-4447-8358-b867681012a6 None None] MFA Rules not processed for user `cba7a1c788bb4e0c91648b15ee054a82`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:26.112529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5a28b179-ac47-4447-8358-b867681012a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:26.119343 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1340/2705] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:27:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:27:39.717101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119dd61-c17b-47de-b8aa-9856e852b4dc None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:39.718540 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6119dd61-c17b-47de-b8aa-9856e852b4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:39.789619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119dd61-c17b-47de-b8aa-9856e852b4dc None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:39.796240 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04e117-e55a-4895-b76b-ff7f2b1e1939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:39.797049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04e117-e55a-4895-b76b-ff7f2b1e1939 service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:39.797334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04e117-e55a-4895-b76b-ff7f2b1e1939 service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:39.797650 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04e117-e55a-4895-b76b-ff7f2b1e1939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:39.799761 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ab04e117-e55a-4895-b76b-ff7f2b1e1939 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:39.813480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04e117-e55a-4895-b76b-ff7f2b1e1939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:39.815065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04e117-e55a-4895-b76b-ff7f2b1e1939 service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:39.827043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1366/2706] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:27:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:27:46.940080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28b179-ac47-4447-8358-b867681012a6 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:46.941454 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5a28b179-ac47-4447-8358-b867681012a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:46.952861 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28b179-ac47-4447-8358-b867681012a6 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:46.956828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f6cfe-556a-47c4-8a55-340a3dc77e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:46.957447 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f6cfe-556a-47c4-8a55-340a3dc77e54 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:46.957717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f6cfe-556a-47c4-8a55-340a3dc77e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:46.957984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f6cfe-556a-47c4-8a55-340a3dc77e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:46.959626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d81f6cfe-556a-47c4-8a55-340a3dc77e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:46.968892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f6cfe-556a-47c4-8a55-340a3dc77e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:46.970298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f6cfe-556a-47c4-8a55-340a3dc77e54 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:46.978835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1341/2707] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:27:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:27:47.932030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e358ccf-3b75-4d6b-9b9d-29161a31f39d None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:47.932532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e358ccf-3b75-4d6b-9b9d-29161a31f39d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:47.932718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e358ccf-3b75-4d6b-9b9d-29161a31f39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:47.989598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-7e358ccf-3b75-4d6b-9b9d-29161a31f39d None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:27:47.990787 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-7e358ccf-3b75-4d6b-9b9d-29161a31f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:48.051022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1367/2708] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:27:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:27:48.098238 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f6cfe-556a-47c4-8a55-340a3dc77e54 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:27:48.099643 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d81f6cfe-556a-47c4-8a55-340a3dc77e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:27:48.191820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f6cfe-556a-47c4-8a55-340a3dc77e54 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:27:48.196730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3c6e9-42d3-4cb5-82eb-eb3a1b9e335a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:27:48.197368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3c6e9-42d3-4cb5-82eb-eb3a1b9e335a service swift] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:27:48.197646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3c6e9-42d3-4cb5-82eb-eb3a1b9e335a service swift] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:27:48.197918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3c6e9-42d3-4cb5-82eb-eb3a1b9e335a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:27:48.205708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3c6e9-42d3-4cb5-82eb-eb3a1b9e335a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:27:48.207830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3c6e9-42d3-4cb5-82eb-eb3a1b9e335a service swift] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:27:48.215755 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1342/2709] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:27:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:28:03.384518 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842422e-af39-4d4b-9569-035c5ad0fd70 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:03.384976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842422e-af39-4d4b-9569-035c5ad0fd70 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:03.385085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842422e-af39-4d4b-9569-035c5ad0fd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:03.402402 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-8842422e-af39-4d4b-9569-035c5ad0fd70 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:03.403594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8842422e-af39-4d4b-9569-035c5ad0fd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:03.410681 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1368/2710] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 3 09:28:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:03.423058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3c6e9-42d3-4cb5-82eb-eb3a1b9e335a service swift] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:03.433764 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3c6e9-42d3-4cb5-82eb-eb3a1b9e335a service swift] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:03.438903 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e4a50-b7f0-4d40-8fcd-558bcd4d2a1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:03.439610 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e4a50-b7f0-4d40-8fcd-558bcd4d2a1a service swift] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:03.439956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e4a50-b7f0-4d40-8fcd-558bcd4d2a1a service swift] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:03.440330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e4a50-b7f0-4d40-8fcd-558bcd4d2a1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:03.449214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e4a50-b7f0-4d40-8fcd-558bcd4d2a1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:03.450781 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e4a50-b7f0-4d40-8fcd-558bcd4d2a1a service swift] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:03.458942 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1343/2711] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:28:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:28:05.367677 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842422e-af39-4d4b-9569-035c5ad0fd70 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:05.379406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842422e-af39-4d4b-9569-035c5ad0fd70 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:05.383869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac27ac-482d-480b-acd4-6331ffc74e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:05.384778 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac27ac-482d-480b-acd4-6331ffc74e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:05.385058 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac27ac-482d-480b-acd4-6331ffc74e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:05.386121 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac27ac-482d-480b-acd4-6331ffc74e63 admin admin] PATH_INFO: `/v3/users/cba7a1c788bb4e0c91648b15ee054a82` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:05.389948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac27ac-482d-480b-acd4-6331ffc74e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cba7a1c788bb4e0c91648b15ee054a82)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:05.391898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac27ac-482d-480b-acd4-6331ffc74e63 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:05.438082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0aac27ac-482d-480b-acd4-6331ffc74e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cba7a1c788bb4e0c91648b15ee054a82'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:05.445088 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0aac27ac-482d-480b-acd4-6331ffc74e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cba7a1c788bb4e0c91648b15ee054a82'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:05.445745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0aac27ac-482d-480b-acd4-6331ffc74e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cba7a1c788bb4e0c91648b15ee054a82'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:05.446361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0aac27ac-482d-480b-acd4-6331ffc74e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cba7a1c788bb4e0c91648b15ee054a82'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:05.457400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0aac27ac-482d-480b-acd4-6331ffc74e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cba7a1c788bb4e0c91648b15ee054a82'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:05.471201 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1369/2712] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:28:05 2022] DELETE /identity/v3/users/cba7a1c788bb4e0c91648b15ee054a82 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:05.749774 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e4a50-b7f0-4d40-8fcd-558bcd4d2a1a service swift] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:05.761204 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e4a50-b7f0-4d40-8fcd-558bcd4d2a1a service swift] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:05.834972 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21feed-e027-4aa5-a719-7dcf743678fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:05.835830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21feed-e027-4aa5-a719-7dcf743678fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:05.836139 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21feed-e027-4aa5-a719-7dcf743678fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:05.836419 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21feed-e027-4aa5-a719-7dcf743678fb admin admin] PATH_INFO: `/v3/projects/47aa19e925b34b6e91c11ed0200c31b4` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:05.837608 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21feed-e027-4aa5-a719-7dcf743678fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=47aa19e925b34b6e91c11ed0200c31b4)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:05.839495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21feed-e027-4aa5-a719-7dcf743678fb admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:05.883798 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-da21feed-e027-4aa5-a719-7dcf743678fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47aa19e925b34b6e91c11ed0200c31b4', 'request_id': 'req-da21feed-e027-4aa5-a719-7dcf743678fb'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:05.888895 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-da21feed-e027-4aa5-a719-7dcf743678fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47aa19e925b34b6e91c11ed0200c31b4', 'request_id': 'req-da21feed-e027-4aa5-a719-7dcf743678fb'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:05.895587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-da21feed-e027-4aa5-a719-7dcf743678fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47aa19e925b34b6e91c11ed0200c31b4', 'request_id': 'req-da21feed-e027-4aa5-a719-7dcf743678fb'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:05.906407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-da21feed-e027-4aa5-a719-7dcf743678fb admin admin] The token cache is being invalidate because project 47aa19e925b34b6e91c11ed0200c31b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:05.906692 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-da21feed-e027-4aa5-a719-7dcf743678fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:05.907461 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-da21feed-e027-4aa5-a719-7dcf743678fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:05.909383 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1344/2713] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:28:05 2022] DELETE /identity/v3/projects/47aa19e925b34b6e91c11ed0200c31b4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:05.915563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c9fee-4f47-472d-8efb-277042b300ce None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:05.915858 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c9fee-4f47-472d-8efb-277042b300ce None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:05.916175 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c9fee-4f47-472d-8efb-277042b300ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:05.934649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-523c9fee-4f47-472d-8efb-277042b300ce None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:05.935811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-523c9fee-4f47-472d-8efb-277042b300ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:05.998083 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1370/2714] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:28:06.005638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21141b-5117-4260-9872-828e52b74b12 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:06.005929 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21141b-5117-4260-9872-828e52b74b12 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:06.006206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21141b-5117-4260-9872-828e52b74b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:06.023917 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-4e21141b-5117-4260-9872-828e52b74b12 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:06.025119 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4e21141b-5117-4260-9872-828e52b74b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:06.032929 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1345/2715] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:06.037482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c9fee-4f47-472d-8efb-277042b300ce None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:06.047069 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c9fee-4f47-472d-8efb-277042b300ce None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:06.052224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec39e17-2156-4376-b692-8ca5eb66733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:06.052857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec39e17-2156-4376-b692-8ca5eb66733d admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:06.053135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec39e17-2156-4376-b692-8ca5eb66733d admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:06.053403 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec39e17-2156-4376-b692-8ca5eb66733d admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:06.054718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec39e17-2156-4376-b692-8ca5eb66733d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:28:06.055025 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec39e17-2156-4376-b692-8ca5eb66733d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:06.056613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec39e17-2156-4376-b692-8ca5eb66733d admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:06.067425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1371/2716] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:28:06.071549 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21141b-5117-4260-9872-828e52b74b12 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:06.080469 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21141b-5117-4260-9872-828e52b74b12 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:06.085115 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7137-d539-417e-ab87-506d6b69edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:06.085743 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7137-d539-417e-ab87-506d6b69edbe admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:06.086025 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7137-d539-417e-ab87-506d6b69edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:06.086298 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7137-d539-417e-ab87-506d6b69edbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:06.086981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb7137-d539-417e-ab87-506d6b69edbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:06.088885 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb7137-d539-417e-ab87-506d6b69edbe admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:06.113835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1346/2717] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:28:06 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:28:06.118002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec39e17-2156-4376-b692-8ca5eb66733d admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:06.127535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec39e17-2156-4376-b692-8ca5eb66733d admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:06.181030 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3f5ef-191f-448f-b5b9-ec9e2828b3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:06.181689 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3f5ef-191f-448f-b5b9-ec9e2828b3eb admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:06.181975 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3f5ef-191f-448f-b5b9-ec9e2828b3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:06.182255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3f5ef-191f-448f-b5b9-ec9e2828b3eb admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:06.182999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3f5ef-191f-448f-b5b9-ec9e2828b3eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:06.185076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3f5ef-191f-448f-b5b9-ec9e2828b3eb admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:06.205095 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1372/2718] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:28:06 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:28:06.209789 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7137-d539-417e-ab87-506d6b69edbe admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:06.219881 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7137-d539-417e-ab87-506d6b69edbe admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:06.225031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e322a64-dc62-44c1-ad1e-bdd0288bea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:06.225678 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e322a64-dc62-44c1-ad1e-bdd0288bea89 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:06.226448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e322a64-dc62-44c1-ad1e-bdd0288bea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:06.226448 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e322a64-dc62-44c1-ad1e-bdd0288bea89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:06.226956 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e322a64-dc62-44c1-ad1e-bdd0288bea89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:06.228652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e322a64-dc62-44c1-ad1e-bdd0288bea89 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:06.238771 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1347/2719] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:06.242672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3f5ef-191f-448f-b5b9-ec9e2828b3eb admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:06.252369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3f5ef-191f-448f-b5b9-ec9e2828b3eb admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:06.256845 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c5f31-284e-46f6-a4c0-fb21a93d85d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:06.257484 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c5f31-284e-46f6-a4c0-fb21a93d85d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:06.257760 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c5f31-284e-46f6-a4c0-fb21a93d85d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:06.258031 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c5f31-284e-46f6-a4c0-fb21a93d85d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:06.258742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c5f31-284e-46f6-a4c0-fb21a93d85d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:06.260334 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c5f31-284e-46f6-a4c0-fb21a93d85d1 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:06.270316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1373/2720] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:06.274078 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e322a64-dc62-44c1-ad1e-bdd0288bea89 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:06.284099 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e322a64-dc62-44c1-ad1e-bdd0288bea89 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:06.289291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27a741-75c5-4b61-9f7a-c70e4777056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:06.290145 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27a741-75c5-4b61-9f7a-c70e4777056a admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:06.290426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27a741-75c5-4b61-9f7a-c70e4777056a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:06.290699 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27a741-75c5-4b61-9f7a-c70e4777056a admin admin] PATH_INFO: `/v3/projects/71c7c15024c146f091498c3ccaceeca2/users/b4f08f469fdc4cc492f18f85ca0993bd/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:06.304866 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27a741-75c5-4b61-9f7a-c70e4777056a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c7c15024c146f091498c3ccaceeca2, user_id=b4f08f469fdc4cc492f18f85ca0993bd, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:06.307526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27a741-75c5-4b61-9f7a-c70e4777056a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:06.319601 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1348/2721] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:28:06 2022] PUT /identity/v3/projects/71c7c15024c146f091498c3ccaceeca2/users/b4f08f469fdc4cc492f18f85ca0993bd/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:28:06.329972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d80fb-c301-4bc3-b204-044068afc3ea None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:06.330259 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d80fb-c301-4bc3-b204-044068afc3ea None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:06.330532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d80fb-c301-4bc3-b204-044068afc3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:06.356839 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-093d80fb-c301-4bc3-b204-044068afc3ea None None] MFA Rules not processed for user `b4f08f469fdc4cc492f18f85ca0993bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:06.358013 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-093d80fb-c301-4bc3-b204-044068afc3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:06.420900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1374/2722] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:28:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:06.431837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27a741-75c5-4b61-9f7a-c70e4777056a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:06.433545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ed27a741-75c5-4b61-9f7a-c70e4777056a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:06.489365 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27a741-75c5-4b61-9f7a-c70e4777056a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:06.493111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dd45a-a02c-4464-80a5-d3ffb2bc60e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:06.493746 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dd45a-a02c-4464-80a5-d3ffb2bc60e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:06.494027 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dd45a-a02c-4464-80a5-d3ffb2bc60e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:06.494327 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dd45a-a02c-4464-80a5-d3ffb2bc60e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:06.502835 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8dd45a-a02c-4464-80a5-d3ffb2bc60e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:06.504279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8dd45a-a02c-4464-80a5-d3ffb2bc60e3 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:06.512945 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1349/2723] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:28:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:09.040955 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d80fb-c301-4bc3-b204-044068afc3ea None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:09.102169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d80fb-c301-4bc3-b204-044068afc3ea None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:09.106715 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:09.107575 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.107851 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.108148 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] PATH_INFO: `/v3/users/b4f08f469fdc4cc492f18f85ca0993bd` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.109329 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f08f469fdc4cc492f18f85ca0993bd)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:09.111228 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:09.156680 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f08f469fdc4cc492f18f85ca0993bd'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.163199 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f08f469fdc4cc492f18f85ca0993bd'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.163854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f08f469fdc4cc492f18f85ca0993bd'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.164490 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f08f469fdc4cc492f18f85ca0993bd'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.187781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f08f469fdc4cc492f18f85ca0993bd'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.202068 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1375/2724] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:28:09 2022] DELETE /identity/v3/users/b4f08f469fdc4cc492f18f85ca0993bd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:09.207376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a67a3e-b3bc-4fd2-95d2-3eb05cb0680b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.207876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a67a3e-b3bc-4fd2-95d2-3eb05cb0680b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.208064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a67a3e-b3bc-4fd2-95d2-3eb05cb0680b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.224892 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f8a67a3e-b3bc-4fd2-95d2-3eb05cb0680b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:09.226101 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f8a67a3e-b3bc-4fd2-95d2-3eb05cb0680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:09.283630 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1350/2725] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:09.293260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:09.294675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:09.350810 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d08026-2f7f-4219-a213-ed2cafc97793 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:09.354473 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fa8ff-5938-4f47-aa14-f728a11c3353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:09.355107 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fa8ff-5938-4f47-aa14-f728a11c3353 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.355392 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fa8ff-5938-4f47-aa14-f728a11c3353 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.355747 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fa8ff-5938-4f47-aa14-f728a11c3353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.365289 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fa8ff-5938-4f47-aa14-f728a11c3353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:09.366699 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fa8ff-5938-4f47-aa14-f728a11c3353 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:09.376353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1376/2726] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:09.638756 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a67a3e-b3bc-4fd2-95d2-3eb05cb0680b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:09.640288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f8a67a3e-b3bc-4fd2-95d2-3eb05cb0680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:09.652273 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a67a3e-b3bc-4fd2-95d2-3eb05cb0680b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:09.657581 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89026fb-a3ff-467c-9168-060c98c652af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:09.658668 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89026fb-a3ff-467c-9168-060c98c652af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.658953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89026fb-a3ff-467c-9168-060c98c652af admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.659228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89026fb-a3ff-467c-9168-060c98c652af admin admin] PATH_INFO: `/v3/projects/71c7c15024c146f091498c3ccaceeca2` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.661030 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89026fb-a3ff-467c-9168-060c98c652af admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c7c15024c146f091498c3ccaceeca2)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:09.662839 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89026fb-a3ff-467c-9168-060c98c652af admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:09.710687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a89026fb-a3ff-467c-9168-060c98c652af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c7c15024c146f091498c3ccaceeca2', 'request_id': 'req-a89026fb-a3ff-467c-9168-060c98c652af'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.715889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a89026fb-a3ff-467c-9168-060c98c652af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c7c15024c146f091498c3ccaceeca2', 'request_id': 'req-a89026fb-a3ff-467c-9168-060c98c652af'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.723364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a89026fb-a3ff-467c-9168-060c98c652af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c7c15024c146f091498c3ccaceeca2', 'request_id': 'req-a89026fb-a3ff-467c-9168-060c98c652af'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.734147 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a89026fb-a3ff-467c-9168-060c98c652af admin admin] The token cache is being invalidate because project 71c7c15024c146f091498c3ccaceeca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:09.734431 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a89026fb-a3ff-467c-9168-060c98c652af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.735080 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-a89026fb-a3ff-467c-9168-060c98c652af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:09.736652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1351/2727] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:28:09 2022] DELETE /identity/v3/projects/71c7c15024c146f091498c3ccaceeca2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:09.742023 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010e2cb-0a0f-43a4-854b-f58d57d491d6 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.742313 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010e2cb-0a0f-43a4-854b-f58d57d491d6 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.742594 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010e2cb-0a0f-43a4-854b-f58d57d491d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.759564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-d010e2cb-0a0f-43a4-854b-f58d57d491d6 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:09.760781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d010e2cb-0a0f-43a4-854b-f58d57d491d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:09.817001 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1377/2728] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:09.824567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6640fac-7fc6-4dc2-9b2e-e9d42b2425ca None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.824855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6640fac-7fc6-4dc2-9b2e-e9d42b2425ca None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.825129 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6640fac-7fc6-4dc2-9b2e-e9d42b2425ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.842984 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-e6640fac-7fc6-4dc2-9b2e-e9d42b2425ca None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:09.844215 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e6640fac-7fc6-4dc2-9b2e-e9d42b2425ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:09.852568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1352/2729] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:09.856644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010e2cb-0a0f-43a4-854b-f58d57d491d6 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:09.866629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010e2cb-0a0f-43a4-854b-f58d57d491d6 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:09.871307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68399c36-6ea2-4512-8eba-c561368c5877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:09.871954 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68399c36-6ea2-4512-8eba-c561368c5877 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.872276 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68399c36-6ea2-4512-8eba-c561368c5877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.872579 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68399c36-6ea2-4512-8eba-c561368c5877 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.873303 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68399c36-6ea2-4512-8eba-c561368c5877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:28:09.873609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68399c36-6ea2-4512-8eba-c561368c5877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:09.875183 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68399c36-6ea2-4512-8eba-c561368c5877 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:09.886332 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1378/2730] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:28:09.890281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6640fac-7fc6-4dc2-9b2e-e9d42b2425ca None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:09.899140 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6640fac-7fc6-4dc2-9b2e-e9d42b2425ca None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:09.903778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d5d10-3266-46a9-8f59-1c709453e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:09.904434 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d5d10-3266-46a9-8f59-1c709453e2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:09.904718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d5d10-3266-46a9-8f59-1c709453e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:09.904991 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d5d10-3266-46a9-8f59-1c709453e2b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:09.905677 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d5d10-3266-46a9-8f59-1c709453e2b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:09.907580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d5d10-3266-46a9-8f59-1c709453e2b5 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:09.933297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1353/2731] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:28:09 2022] POST /identity/v3/projects => generated 389 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:28:09.936981 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68399c36-6ea2-4512-8eba-c561368c5877 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:09.946638 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68399c36-6ea2-4512-8eba-c561368c5877 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:10.000012 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbd486-7d31-4a7d-8bea-7c5aaf049bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:10.000691 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbd486-7d31-4a7d-8bea-7c5aaf049bfc admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:10.000973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbd486-7d31-4a7d-8bea-7c5aaf049bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:10.001245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbd486-7d31-4a7d-8bea-7c5aaf049bfc admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:10.001930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbd486-7d31-4a7d-8bea-7c5aaf049bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:10.003854 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbd486-7d31-4a7d-8bea-7c5aaf049bfc admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:10.027464 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1379/2732] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:28:09 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:28:10.028693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d5d10-3266-46a9-8f59-1c709453e2b5 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:10.039397 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d5d10-3266-46a9-8f59-1c709453e2b5 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:10.044324 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9179cb-0cc8-4b99-94f5-576e01c8b54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:10.044969 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9179cb-0cc8-4b99-94f5-576e01c8b54a admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:10.045251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9179cb-0cc8-4b99-94f5-576e01c8b54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:10.045523 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9179cb-0cc8-4b99-94f5-576e01c8b54a admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:10.046242 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9179cb-0cc8-4b99-94f5-576e01c8b54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:10.047820 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9179cb-0cc8-4b99-94f5-576e01c8b54a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:10.057797 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1354/2733] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:10.061670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbd486-7d31-4a7d-8bea-7c5aaf049bfc admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:10.071559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbd486-7d31-4a7d-8bea-7c5aaf049bfc admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:10.076710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336fbde-cdf1-41aa-aaf2-4a625fcddc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:10.077363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336fbde-cdf1-41aa-aaf2-4a625fcddc39 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:10.077643 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336fbde-cdf1-41aa-aaf2-4a625fcddc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:10.077917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336fbde-cdf1-41aa-aaf2-4a625fcddc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:10.078633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336fbde-cdf1-41aa-aaf2-4a625fcddc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:10.080265 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336fbde-cdf1-41aa-aaf2-4a625fcddc39 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:10.090474 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1380/2734] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:28:10.094464 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9179cb-0cc8-4b99-94f5-576e01c8b54a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:10.104711 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9179cb-0cc8-4b99-94f5-576e01c8b54a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:10.109190 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faca6d8-3ba2-4f44-a11d-4c472bfa6147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:10.110048 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faca6d8-3ba2-4f44-a11d-4c472bfa6147 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:10.110323 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faca6d8-3ba2-4f44-a11d-4c472bfa6147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:10.110592 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faca6d8-3ba2-4f44-a11d-4c472bfa6147 admin admin] PATH_INFO: `/v3/projects/0751a7c5a98b44a883eb391319813c7e/users/a2f88137dda841eb8a3112c224dd7b8b/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:10.124439 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faca6d8-3ba2-4f44-a11d-4c472bfa6147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0751a7c5a98b44a883eb391319813c7e, user_id=a2f88137dda841eb8a3112c224dd7b8b, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:10.127037 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faca6d8-3ba2-4f44-a11d-4c472bfa6147 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:10.139051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1355/2735] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:28:10 2022] PUT /identity/v3/projects/0751a7c5a98b44a883eb391319813c7e/users/a2f88137dda841eb8a3112c224dd7b8b/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:10.149524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a1d8d-a1a5-425f-b4c6-072545a0244a None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:10.149809 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a1d8d-a1a5-425f-b4c6-072545a0244a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:10.150104 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a1d8d-a1a5-425f-b4c6-072545a0244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:10.176477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-db7a1d8d-a1a5-425f-b4c6-072545a0244a None None] MFA Rules not processed for user `a2f88137dda841eb8a3112c224dd7b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:10.177721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-db7a1d8d-a1a5-425f-b4c6-072545a0244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:10.243513 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1381/2736] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:28:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:10.254228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faca6d8-3ba2-4f44-a11d-4c472bfa6147 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:10.256069 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3faca6d8-3ba2-4f44-a11d-4c472bfa6147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:10.314626 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faca6d8-3ba2-4f44-a11d-4c472bfa6147 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:10.318768 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd39aa-c3cf-4352-aeeb-cb565beb897d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:10.319402 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd39aa-c3cf-4352-aeeb-cb565beb897d service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:10.319680 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd39aa-c3cf-4352-aeeb-cb565beb897d service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:10.319971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd39aa-c3cf-4352-aeeb-cb565beb897d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:10.327953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd39aa-c3cf-4352-aeeb-cb565beb897d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:10.329360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd39aa-c3cf-4352-aeeb-cb565beb897d service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:10.338392 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1356/2737] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:28:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:28.225320 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a1d8d-a1a5-425f-b4c6-072545a0244a None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:28.226842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-db7a1d8d-a1a5-425f-b4c6-072545a0244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:28.285007 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a1d8d-a1a5-425f-b4c6-072545a0244a None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:28.289256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff17313-0fdc-42df-8533-6d4fcd9e32b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:28.289898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17313-0fdc-42df-8533-6d4fcd9e32b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:28.290291 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17313-0fdc-42df-8533-6d4fcd9e32b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:28.290569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17313-0fdc-42df-8533-6d4fcd9e32b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:28.292694 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-eff17313-0fdc-42df-8533-6d4fcd9e32b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:28.356516 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff17313-0fdc-42df-8533-6d4fcd9e32b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:28.358002 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff17313-0fdc-42df-8533-6d4fcd9e32b7 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:28.368147 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1382/2738] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:28:32.762802 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd39aa-c3cf-4352-aeeb-cb565beb897d service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:32.773827 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd39aa-c3cf-4352-aeeb-cb565beb897d service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:32.778384 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:32.779231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:32.779507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:32.779778 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] PATH_INFO: `/v3/users/a2f88137dda841eb8a3112c224dd7b8b` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:32.780985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f88137dda841eb8a3112c224dd7b8b)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:32.782873 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:32.828824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f88137dda841eb8a3112c224dd7b8b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:32.836501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f88137dda841eb8a3112c224dd7b8b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:32.843357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f88137dda841eb8a3112c224dd7b8b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:32.844010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f88137dda841eb8a3112c224dd7b8b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:32.844667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f88137dda841eb8a3112c224dd7b8b'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:32.867572 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1357/2739] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:28:32 2022] DELETE /identity/v3/users/a2f88137dda841eb8a3112c224dd7b8b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:32.872070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c151dcd-cbc8-43b0-9926-3d12ee0f7953 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:32.872605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c151dcd-cbc8-43b0-9926-3d12ee0f7953 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:32.872704 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c151dcd-cbc8-43b0-9926-3d12ee0f7953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:32.892440 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-6c151dcd-cbc8-43b0-9926-3d12ee0f7953 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:32.893978 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6c151dcd-cbc8-43b0-9926-3d12ee0f7953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:32.958651 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1383/2740] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:32.968804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:32.970256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:33.030269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e088a-259b-4620-9c66-505602960ac3 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:33.034579 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c632e4-e31a-4c69-9352-dcbc84c524af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:33.035347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c632e4-e31a-4c69-9352-dcbc84c524af service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:33.035889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c632e4-e31a-4c69-9352-dcbc84c524af service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:33.035889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c632e4-e31a-4c69-9352-dcbc84c524af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:33.045959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c632e4-e31a-4c69-9352-dcbc84c524af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:33.047401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c632e4-e31a-4c69-9352-dcbc84c524af service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:33.057637 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1358/2741] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:33.487116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c151dcd-cbc8-43b0-9926-3d12ee0f7953 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:33.488558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6c151dcd-cbc8-43b0-9926-3d12ee0f7953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:33.500256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c151dcd-cbc8-43b0-9926-3d12ee0f7953 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:33.505471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:33.506224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:33.507150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:33.507430 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] PATH_INFO: `/v3/projects/0751a7c5a98b44a883eb391319813c7e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:33.508644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0751a7c5a98b44a883eb391319813c7e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:33.510709 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:33.563323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0751a7c5a98b44a883eb391319813c7e', 'request_id': 'req-c4f75390-b420-4ef5-a9bc-061ba766f19a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:33.573343 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0751a7c5a98b44a883eb391319813c7e', 'request_id': 'req-c4f75390-b420-4ef5-a9bc-061ba766f19a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:33.580125 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0751a7c5a98b44a883eb391319813c7e', 'request_id': 'req-c4f75390-b420-4ef5-a9bc-061ba766f19a'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:33.592685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] The token cache is being invalidate because project 0751a7c5a98b44a883eb391319813c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:33.592992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:33.593615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:33.595156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1384/2742] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:28:33 2022] DELETE /identity/v3/projects/0751a7c5a98b44a883eb391319813c7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:34.751206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c632e4-e31a-4c69-9352-dcbc84c524af service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:34.752719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-85c632e4-e31a-4c69-9352-dcbc84c524af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:34.829074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c632e4-e31a-4c69-9352-dcbc84c524af service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:34.892767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaff39-f277-4acc-96a4-894d915c00a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:34.892767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaff39-f277-4acc-96a4-894d915c00a7 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:34.892767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaff39-f277-4acc-96a4-894d915c00a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:34.892767 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaff39-f277-4acc-96a4-894d915c00a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:34.893606 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6edaff39-f277-4acc-96a4-894d915c00a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:34.894167 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:34.896209 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:34.955577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaff39-f277-4acc-96a4-894d915c00a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:34.957113 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaff39-f277-4acc-96a4-894d915c00a7 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:34.960778 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75390-b420-4ef5-a9bc-061ba766f19a admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:34.965293 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:34.966149 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:34.966424 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:34.966527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1359/2743] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:28:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:28:34.966712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] PATH_INFO: `/v3/users/bafeedb9a9ad47e4b434b3680f6ccec2` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:34.967857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bafeedb9a9ad47e4b434b3680f6ccec2)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:34.969820 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:35.015419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bafeedb9a9ad47e4b434b3680f6ccec2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.022682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bafeedb9a9ad47e4b434b3680f6ccec2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.023348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bafeedb9a9ad47e4b434b3680f6ccec2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.023942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bafeedb9a9ad47e4b434b3680f6ccec2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.035171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bafeedb9a9ad47e4b434b3680f6ccec2'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.050142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1385/2744] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:28:34 2022] DELETE /identity/v3/users/bafeedb9a9ad47e4b434b3680f6ccec2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:28:35.233368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaff39-f277-4acc-96a4-894d915c00a7 service nova] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:35.265287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaff39-f277-4acc-96a4-894d915c00a7 service nova] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:35.333528 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:35.334599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:35.335509 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:35.335869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] PATH_INFO: `/v3/projects/d92efab60f874aa8a197ab70fc582487` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:35.337239 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92efab60f874aa8a197ab70fc582487)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:35.339425 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:35.387038 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92efab60f874aa8a197ab70fc582487', 'request_id': 'req-5a393112-ed2d-4359-b14f-44501ad5ede2'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.392472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92efab60f874aa8a197ab70fc582487', 'request_id': 'req-5a393112-ed2d-4359-b14f-44501ad5ede2'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.399785 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92efab60f874aa8a197ab70fc582487', 'request_id': 'req-5a393112-ed2d-4359-b14f-44501ad5ede2'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.410880 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] The token cache is being invalidate because project d92efab60f874aa8a197ab70fc582487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:35.411169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.411828 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.413930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1360/2745] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:28:35 2022] DELETE /identity/v3/projects/d92efab60f874aa8a197ab70fc582487 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:35.418352 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:35.419769 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:35.434169 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226d488-9f9a-40da-a23a-ab50d86a8a70 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:35.487550 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5f10b-5e2b-4c04-8ca8-06e9246969e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:35.488373 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5f10b-5e2b-4c04-8ca8-06e9246969e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:35.488657 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5f10b-5e2b-4c04-8ca8-06e9246969e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:35.488933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5f10b-5e2b-4c04-8ca8-06e9246969e6 admin admin] PATH_INFO: `/v3/users/c86712a0c2f8414e98f12ca818b78210` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:35.490106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5f10b-5e2b-4c04-8ca8-06e9246969e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86712a0c2f8414e98f12ca818b78210)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:35.492657 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5f10b-5e2b-4c04-8ca8-06e9246969e6 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:35.537482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-94e5f10b-5e2b-4c04-8ca8-06e9246969e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86712a0c2f8414e98f12ca818b78210'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.546831 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-94e5f10b-5e2b-4c04-8ca8-06e9246969e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86712a0c2f8414e98f12ca818b78210'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.547497 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-94e5f10b-5e2b-4c04-8ca8-06e9246969e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86712a0c2f8414e98f12ca818b78210'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.548109 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-94e5f10b-5e2b-4c04-8ca8-06e9246969e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86712a0c2f8414e98f12ca818b78210'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.562642 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-94e5f10b-5e2b-4c04-8ca8-06e9246969e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86712a0c2f8414e98f12ca818b78210'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.574750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1386/2746] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:28:35 2022] DELETE /identity/v3/users/c86712a0c2f8414e98f12ca818b78210 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:35.739874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:35.741307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:35.755256 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a393112-ed2d-4359-b14f-44501ad5ede2 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:35.812227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:35.813102 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:35.813397 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:35.813660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] PATH_INFO: `/v3/projects/5fda1e1131c447b2bd182e5435d6db65` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:35.814821 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fda1e1131c447b2bd182e5435d6db65)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:35.816730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:35.860803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fda1e1131c447b2bd182e5435d6db65', 'request_id': 'req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.865904 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fda1e1131c447b2bd182e5435d6db65', 'request_id': 'req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.872770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fda1e1131c447b2bd182e5435d6db65', 'request_id': 'req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.883503 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] The token cache is being invalidate because project 5fda1e1131c447b2bd182e5435d6db65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:28:35.883783 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.884406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:28:35.885910 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1361/2747] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:28:35 2022] DELETE /identity/v3/projects/5fda1e1131c447b2bd182e5435d6db65 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:28:50.973794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c48f8-d08f-452c-8eff-ed0e02bc7ee3 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:50.974336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c48f8-d08f-452c-8eff-ed0e02bc7ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:50.974336 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c48f8-d08f-452c-8eff-ed0e02bc7ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:50.992310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f46c48f8-d08f-452c-8eff-ed0e02bc7ee3 None None] MFA Rules not processed for user `d69aad2f908c4f9e98ce80a44193125e`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:28:50.993482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f46c48f8-d08f-452c-8eff-ed0e02bc7ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:51.043966 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1387/2748] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:28:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:28:51.339172 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:28:51.340586 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:51.393614 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d63e9-ce1b-48e8-b8c0-15ed7ab1bbbe admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:28:51.397165 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab291b32-0ebc-4b47-bcbd-7f73f1b2c12f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:28:51.398299 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab291b32-0ebc-4b47-bcbd-7f73f1b2c12f service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:28:51.398576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab291b32-0ebc-4b47-bcbd-7f73f1b2c12f service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:28:51.399000 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab291b32-0ebc-4b47-bcbd-7f73f1b2c12f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:28:51.400731 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ab291b32-0ebc-4b47-bcbd-7f73f1b2c12f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:28:51.409634 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab291b32-0ebc-4b47-bcbd-7f73f1b2c12f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:28:51.410978 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab291b32-0ebc-4b47-bcbd-7f73f1b2c12f service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:28:51.419393 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1362/2749] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:28:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:32.350652 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c48f8-d08f-452c-8eff-ed0e02bc7ee3 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:32.352713 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f46c48f8-d08f-452c-8eff-ed0e02bc7ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:32.450255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c48f8-d08f-452c-8eff-ed0e02bc7ee3 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:32.456656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27945122-f08b-445c-90ad-cc6a20c7ed68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7f2aea3e494546a04e20d8cedccc9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:32.457582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945122-f08b-445c-90ad-cc6a20c7ed68 service placement] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:32.457865 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945122-f08b-445c-90ad-cc6a20c7ed68 service placement] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:32.458148 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945122-f08b-445c-90ad-cc6a20c7ed68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:32.459956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-27945122-f08b-445c-90ad-cc6a20c7ed68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:32.474532 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27945122-f08b-445c-90ad-cc6a20c7ed68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:32.476483 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27945122-f08b-445c-90ad-cc6a20c7ed68 service placement] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:32.492176 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1388/2750] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:30:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:38.116867 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab291b32-0ebc-4b47-bcbd-7f73f1b2c12f service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:38.126283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab291b32-0ebc-4b47-bcbd-7f73f1b2c12f service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:38.130089 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dc7da-761c-4d3c-b7d9-d64180df9ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:38.130730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dc7da-761c-4d3c-b7d9-d64180df9ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:38.131035 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dc7da-761c-4d3c-b7d9-d64180df9ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:38.131314 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dc7da-761c-4d3c-b7d9-d64180df9ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:38.133112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-546dc7da-761c-4d3c-b7d9-d64180df9ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:38.199453 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546dc7da-761c-4d3c-b7d9-d64180df9ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:38.200923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546dc7da-761c-4d3c-b7d9-d64180df9ea6 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:38.212267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1363/2751] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:41.150344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27945122-f08b-445c-90ad-cc6a20c7ed68 service placement] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:41.153197 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-27945122-f08b-445c-90ad-cc6a20c7ed68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:41.171351 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27945122-f08b-445c-90ad-cc6a20c7ed68 service placement] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:41.175976 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3dc2d-edc5-47df-8acc-ac4ff0ead69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:41.176889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3dc2d-edc5-47df-8acc-ac4ff0ead69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:41.177168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3dc2d-edc5-47df-8acc-ac4ff0ead69a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:41.177439 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3dc2d-edc5-47df-8acc-ac4ff0ead69a admin admin] PATH_INFO: `/v3/users/d69aad2f908c4f9e98ce80a44193125e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:41.178626 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3dc2d-edc5-47df-8acc-ac4ff0ead69a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69aad2f908c4f9e98ce80a44193125e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:41.180567 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3dc2d-edc5-47df-8acc-ac4ff0ead69a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:41.231495 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f7a3dc2d-edc5-47df-8acc-ac4ff0ead69a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69aad2f908c4f9e98ce80a44193125e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:41.238296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f7a3dc2d-edc5-47df-8acc-ac4ff0ead69a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69aad2f908c4f9e98ce80a44193125e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:41.238974 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f7a3dc2d-edc5-47df-8acc-ac4ff0ead69a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69aad2f908c4f9e98ce80a44193125e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:41.239569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f7a3dc2d-edc5-47df-8acc-ac4ff0ead69a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69aad2f908c4f9e98ce80a44193125e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:41.251126 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-f7a3dc2d-edc5-47df-8acc-ac4ff0ead69a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69aad2f908c4f9e98ce80a44193125e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:41.263740 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1389/2752] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:30:41 2022] DELETE /identity/v3/users/d69aad2f908c4f9e98ce80a44193125e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:41.436705 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dc7da-761c-4d3c-b7d9-d64180df9ea6 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:41.455867 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dc7da-761c-4d3c-b7d9-d64180df9ea6 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:41.510798 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fce7c-ea0d-4e03-8593-1730f50ce009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:41.511638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fce7c-ea0d-4e03-8593-1730f50ce009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:41.512522 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fce7c-ea0d-4e03-8593-1730f50ce009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:41.512792 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fce7c-ea0d-4e03-8593-1730f50ce009 admin admin] PATH_INFO: `/v3/projects/6506fb00a31e4161b2be9c0c7f82b950` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:41.513959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fce7c-ea0d-4e03-8593-1730f50ce009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6506fb00a31e4161b2be9c0c7f82b950)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:41.515894 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fce7c-ea0d-4e03-8593-1730f50ce009 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:41.559403 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-542fce7c-ea0d-4e03-8593-1730f50ce009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6506fb00a31e4161b2be9c0c7f82b950', 'request_id': 'req-542fce7c-ea0d-4e03-8593-1730f50ce009'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:41.564800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-542fce7c-ea0d-4e03-8593-1730f50ce009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6506fb00a31e4161b2be9c0c7f82b950', 'request_id': 'req-542fce7c-ea0d-4e03-8593-1730f50ce009'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:41.571406 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-542fce7c-ea0d-4e03-8593-1730f50ce009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6506fb00a31e4161b2be9c0c7f82b950', 'request_id': 'req-542fce7c-ea0d-4e03-8593-1730f50ce009'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:41.582640 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-542fce7c-ea0d-4e03-8593-1730f50ce009 admin admin] The token cache is being invalidate because project 6506fb00a31e4161b2be9c0c7f82b950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:30:41.582863 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-542fce7c-ea0d-4e03-8593-1730f50ce009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:41.583486 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-542fce7c-ea0d-4e03-8593-1730f50ce009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:41.585040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1364/2753] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:30:41 2022] DELETE /identity/v3/projects/6506fb00a31e4161b2be9c0c7f82b950 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:30:41.590054 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835cb53-6b5d-4806-af8e-40d9f57b687b None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:41.590371 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835cb53-6b5d-4806-af8e-40d9f57b687b None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:41.590650 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835cb53-6b5d-4806-af8e-40d9f57b687b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:41.608445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-2835cb53-6b5d-4806-af8e-40d9f57b687b None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:41.609670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-2835cb53-6b5d-4806-af8e-40d9f57b687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:41.664528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1390/2754] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:41.673398 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb26f7f-71e2-40e3-81fa-1aea1facb691 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:41.673686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb26f7f-71e2-40e3-81fa-1aea1facb691 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:41.673963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb26f7f-71e2-40e3-81fa-1aea1facb691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:41.692068 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-4cb26f7f-71e2-40e3-81fa-1aea1facb691 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:41.693264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-4cb26f7f-71e2-40e3-81fa-1aea1facb691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:41.700977 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1365/2755] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:41.705082 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835cb53-6b5d-4806-af8e-40d9f57b687b None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:41.714327 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835cb53-6b5d-4806-af8e-40d9f57b687b None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:41.718884 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61d1f2-7121-41c6-8a6f-4b98864141b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:41.719514 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61d1f2-7121-41c6-8a6f-4b98864141b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:41.719792 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61d1f2-7121-41c6-8a6f-4b98864141b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:41.720064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61d1f2-7121-41c6-8a6f-4b98864141b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:41.720806 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61d1f2-7121-41c6-8a6f-4b98864141b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:30:41.721108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61d1f2-7121-41c6-8a6f-4b98864141b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:41.722667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61d1f2-7121-41c6-8a6f-4b98864141b9 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:41.734065 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1391/2756] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:30:41.738067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb26f7f-71e2-40e3-81fa-1aea1facb691 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:41.747614 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb26f7f-71e2-40e3-81fa-1aea1facb691 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:41.752258 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e6247-5599-4395-9051-e1d7a49e9594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:41.752888 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e6247-5599-4395-9051-e1d7a49e9594 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:41.753170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e6247-5599-4395-9051-e1d7a49e9594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:41.753443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e6247-5599-4395-9051-e1d7a49e9594 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:41.754149 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e6247-5599-4395-9051-e1d7a49e9594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:41.756036 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e6247-5599-4395-9051-e1d7a49e9594 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:41.788869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1366/2757] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:30:41 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:30:41.793671 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61d1f2-7121-41c6-8a6f-4b98864141b9 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:41.803120 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61d1f2-7121-41c6-8a6f-4b98864141b9 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:41.857238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdb726-8286-4d71-a0a2-0b2408bab0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:41.857818 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdb726-8286-4d71-a0a2-0b2408bab0ae admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:41.858124 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdb726-8286-4d71-a0a2-0b2408bab0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:41.858397 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdb726-8286-4d71-a0a2-0b2408bab0ae admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:41.859078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdb726-8286-4d71-a0a2-0b2408bab0ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:41.861015 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdb726-8286-4d71-a0a2-0b2408bab0ae admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:41.881361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1392/2758] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:30:41 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:30:41.885380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e6247-5599-4395-9051-e1d7a49e9594 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:41.895938 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e6247-5599-4395-9051-e1d7a49e9594 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:41.900906 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b757a8-e15e-4fc6-a665-8439fc6f4c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:41.901556 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b757a8-e15e-4fc6-a665-8439fc6f4c83 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:41.901830 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b757a8-e15e-4fc6-a665-8439fc6f4c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:41.902095 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b757a8-e15e-4fc6-a665-8439fc6f4c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:41.903011 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b757a8-e15e-4fc6-a665-8439fc6f4c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:41.904868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b757a8-e15e-4fc6-a665-8439fc6f4c83 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:41.915143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1367/2759] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:41.919995 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdb726-8286-4d71-a0a2-0b2408bab0ae admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:41.933212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdb726-8286-4d71-a0a2-0b2408bab0ae admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:41.938652 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706297e-bca5-48fb-b827-af4b0764a2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:41.939306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706297e-bca5-48fb-b827-af4b0764a2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:41.939587 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706297e-bca5-48fb-b827-af4b0764a2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:41.939863 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706297e-bca5-48fb-b827-af4b0764a2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:41.940618 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706297e-bca5-48fb-b827-af4b0764a2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:41.942231 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706297e-bca5-48fb-b827-af4b0764a2b4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:41.953782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1393/2760] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:41.957786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b757a8-e15e-4fc6-a665-8439fc6f4c83 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:41.968580 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b757a8-e15e-4fc6-a665-8439fc6f4c83 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:41.973178 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eccf8-db50-4129-b898-edc3e6541f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:41.974034 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eccf8-db50-4129-b898-edc3e6541f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:41.974312 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eccf8-db50-4129-b898-edc3e6541f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:41.974583 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eccf8-db50-4129-b898-edc3e6541f08 admin admin] PATH_INFO: `/v3/projects/60343efe1c2e4a8a81b0e178e469f2e0/users/e76bc1e8e0d7456abd9a6770f26aa5aa/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:41.989390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9eccf8-db50-4129-b898-edc3e6541f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60343efe1c2e4a8a81b0e178e469f2e0, user_id=e76bc1e8e0d7456abd9a6770f26aa5aa, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:41.991980 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9eccf8-db50-4129-b898-edc3e6541f08 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:42.004720 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1368/2761] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:30:41 2022] PUT /identity/v3/projects/60343efe1c2e4a8a81b0e178e469f2e0/users/e76bc1e8e0d7456abd9a6770f26aa5aa/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:30:42.015381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24883c9d-f98e-4465-bbdf-37575bfde4ef None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:42.015668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24883c9d-f98e-4465-bbdf-37575bfde4ef None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:42.015944 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24883c9d-f98e-4465-bbdf-37575bfde4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:42.041655 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-24883c9d-f98e-4465-bbdf-37575bfde4ef None None] MFA Rules not processed for user `e76bc1e8e0d7456abd9a6770f26aa5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:42.042845 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-24883c9d-f98e-4465-bbdf-37575bfde4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:42.102942 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1394/2762] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:42.114337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eccf8-db50-4129-b898-edc3e6541f08 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:42.115963 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1d9eccf8-db50-4129-b898-edc3e6541f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:42.187109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eccf8-db50-4129-b898-edc3e6541f08 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:42.192660 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355cac4-c5e5-4ef2-a94c-7d541e90a305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:42.193306 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355cac4-c5e5-4ef2-a94c-7d541e90a305 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:42.193588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355cac4-c5e5-4ef2-a94c-7d541e90a305 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:42.193866 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355cac4-c5e5-4ef2-a94c-7d541e90a305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:42.202086 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355cac4-c5e5-4ef2-a94c-7d541e90a305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:42.203724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355cac4-c5e5-4ef2-a94c-7d541e90a305 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:42.215942 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1369/2763] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:30:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:44.856885 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24883c9d-f98e-4465-bbdf-37575bfde4ef None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:44.915119 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24883c9d-f98e-4465-bbdf-37575bfde4ef None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:44.920379 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:44.921254 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:44.921515 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:44.921783 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] PATH_INFO: `/v3/users/e76bc1e8e0d7456abd9a6770f26aa5aa` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:44.922937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76bc1e8e0d7456abd9a6770f26aa5aa)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:44.924842 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:44.967024 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76bc1e8e0d7456abd9a6770f26aa5aa'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:44.973487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76bc1e8e0d7456abd9a6770f26aa5aa'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:44.974133 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76bc1e8e0d7456abd9a6770f26aa5aa'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:44.974730 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76bc1e8e0d7456abd9a6770f26aa5aa'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:44.986248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76bc1e8e0d7456abd9a6770f26aa5aa'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:44.998064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1395/2764] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:30:44 2022] DELETE /identity/v3/users/e76bc1e8e0d7456abd9a6770f26aa5aa => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:45.002675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdf1a2-f058-4643-b0fc-6abddf27c722 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:45.003179 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdf1a2-f058-4643-b0fc-6abddf27c722 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:45.003291 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdf1a2-f058-4643-b0fc-6abddf27c722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:45.019599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-3efdf1a2-f058-4643-b0fc-6abddf27c722 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:45.020808 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3efdf1a2-f058-4643-b0fc-6abddf27c722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:45.078318 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1370/2765] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:45.087950 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:45.089374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:45.144432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016c154-fc50-40af-b5af-0982b892692a admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:45.147956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f417c27-50e2-46aa-9e5b-6871cbe45f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:45.148605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f417c27-50e2-46aa-9e5b-6871cbe45f97 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:45.148883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f417c27-50e2-46aa-9e5b-6871cbe45f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:45.149154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f417c27-50e2-46aa-9e5b-6871cbe45f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:45.157649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f417c27-50e2-46aa-9e5b-6871cbe45f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:45.159045 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f417c27-50e2-46aa-9e5b-6871cbe45f97 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:45.168408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1396/2766] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:45.432288 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdf1a2-f058-4643-b0fc-6abddf27c722 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:45.433770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3efdf1a2-f058-4643-b0fc-6abddf27c722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:45.448817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdf1a2-f058-4643-b0fc-6abddf27c722 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:45.453884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:45.454794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:45.462428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:45.462735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901 admin admin] PATH_INFO: `/v3/projects/60343efe1c2e4a8a81b0e178e469f2e0` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:45.464046 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60343efe1c2e4a8a81b0e178e469f2e0)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:45.466144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:45.517130 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60343efe1c2e4a8a81b0e178e469f2e0', 'request_id': 'req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:45.524094 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60343efe1c2e4a8a81b0e178e469f2e0', 'request_id': 'req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:45.531356 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60343efe1c2e4a8a81b0e178e469f2e0', 'request_id': 'req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:45.542578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901 admin admin] The token cache is being invalidate because project 60343efe1c2e4a8a81b0e178e469f2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:30:45.542858 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:45.543985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-620e88e4-bac4-4ec6-b59f-9ed1c16ab901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:45.545557 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1371/2767] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:30:45 2022] DELETE /identity/v3/projects/60343efe1c2e4a8a81b0e178e469f2e0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:45.550295 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860f55c-ee14-4b67-b85f-910685038323 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:45.550579 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860f55c-ee14-4b67-b85f-910685038323 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:45.550852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860f55c-ee14-4b67-b85f-910685038323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:45.568286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-6860f55c-ee14-4b67-b85f-910685038323 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:45.569453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-6860f55c-ee14-4b67-b85f-910685038323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:45.626816 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1397/2768] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:45.634202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853835-eb73-4453-81e4-d5d87a5961c6 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:45.634485 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853835-eb73-4453-81e4-d5d87a5961c6 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:45.634759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853835-eb73-4453-81e4-d5d87a5961c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:45.653882 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-44853835-eb73-4453-81e4-d5d87a5961c6 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:45.655083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-44853835-eb73-4453-81e4-d5d87a5961c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:45.662937 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1372/2769] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:45.667607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860f55c-ee14-4b67-b85f-910685038323 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:45.677900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860f55c-ee14-4b67-b85f-910685038323 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:45.682349 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b312da-29c7-4d3c-b14a-0ba00df7b273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:45.682985 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b312da-29c7-4d3c-b14a-0ba00df7b273 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:45.683260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b312da-29c7-4d3c-b14a-0ba00df7b273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:45.683531 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b312da-29c7-4d3c-b14a-0ba00df7b273 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:45.684859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b312da-29c7-4d3c-b14a-0ba00df7b273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:30:45.685161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b312da-29c7-4d3c-b14a-0ba00df7b273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:45.686718 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b312da-29c7-4d3c-b14a-0ba00df7b273 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:45.697609 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1398/2770] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:30:45.701691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44853835-eb73-4453-81e4-d5d87a5961c6 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:45.710844 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44853835-eb73-4453-81e4-d5d87a5961c6 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:45.715907 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dbde6-0522-4b34-8d4a-b957e26e3904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:45.716568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dbde6-0522-4b34-8d4a-b957e26e3904 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:45.716843 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dbde6-0522-4b34-8d4a-b957e26e3904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:45.717111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dbde6-0522-4b34-8d4a-b957e26e3904 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:45.717811 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dbde6-0522-4b34-8d4a-b957e26e3904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:45.719666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dbde6-0522-4b34-8d4a-b957e26e3904 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:45.744227 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1373/2771] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:30:45 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:30:45.748181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b312da-29c7-4d3c-b14a-0ba00df7b273 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:45.757846 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b312da-29c7-4d3c-b14a-0ba00df7b273 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:45.818925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35dced-4869-42b7-b90a-14e1df183c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:45.819596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35dced-4869-42b7-b90a-14e1df183c76 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:45.820341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35dced-4869-42b7-b90a-14e1df183c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:45.820341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35dced-4869-42b7-b90a-14e1df183c76 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:45.820857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35dced-4869-42b7-b90a-14e1df183c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:45.822777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35dced-4869-42b7-b90a-14e1df183c76 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:45.844380 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1399/2772] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:30:45 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:30:45.848334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dbde6-0522-4b34-8d4a-b957e26e3904 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:45.858868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dbde6-0522-4b34-8d4a-b957e26e3904 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:45.863487 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549a92e-267a-4517-b4da-3dd900eecf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:45.864166 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549a92e-267a-4517-b4da-3dd900eecf7d admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:45.864450 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549a92e-267a-4517-b4da-3dd900eecf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:45.864724 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549a92e-267a-4517-b4da-3dd900eecf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:45.865445 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549a92e-267a-4517-b4da-3dd900eecf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:45.867026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549a92e-267a-4517-b4da-3dd900eecf7d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:45.878742 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1374/2773] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:45.882838 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35dced-4869-42b7-b90a-14e1df183c76 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:45.892639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35dced-4869-42b7-b90a-14e1df183c76 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:45.897178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe12b6-7663-45ea-b057-140fb56d00ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:45.897815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe12b6-7663-45ea-b057-140fb56d00ac admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:45.898091 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe12b6-7663-45ea-b057-140fb56d00ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:45.898361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe12b6-7663-45ea-b057-140fb56d00ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:45.899072 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe12b6-7663-45ea-b057-140fb56d00ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:45.900667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe12b6-7663-45ea-b057-140fb56d00ac admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:45.911589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1400/2774] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:45.915961 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549a92e-267a-4517-b4da-3dd900eecf7d admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:45.926603 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549a92e-267a-4517-b4da-3dd900eecf7d admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:45.931166 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e8a68-049b-4b8e-a3e0-be06b122e7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:45.932031 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e8a68-049b-4b8e-a3e0-be06b122e7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:45.932339 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e8a68-049b-4b8e-a3e0-be06b122e7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:45.932605 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e8a68-049b-4b8e-a3e0-be06b122e7d8 admin admin] PATH_INFO: `/v3/projects/e723ddf38bb149b28aded325f8d7b2f5/users/51727d28d815403cbdaf564343ac4aba/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:45.946524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e8a68-049b-4b8e-a3e0-be06b122e7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e723ddf38bb149b28aded325f8d7b2f5, user_id=51727d28d815403cbdaf564343ac4aba, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:45.949263 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e8a68-049b-4b8e-a3e0-be06b122e7d8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:45.961276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1375/2775] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:30:45 2022] PUT /identity/v3/projects/e723ddf38bb149b28aded325f8d7b2f5/users/51727d28d815403cbdaf564343ac4aba/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:45.971940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133ad0a-be12-450a-89f0-fd58998edc36 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:45.972350 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133ad0a-be12-450a-89f0-fd58998edc36 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:45.972627 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133ad0a-be12-450a-89f0-fd58998edc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:45.998115 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-8133ad0a-be12-450a-89f0-fd58998edc36 None None] MFA Rules not processed for user `51727d28d815403cbdaf564343ac4aba`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:45.999288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8133ad0a-be12-450a-89f0-fd58998edc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:46.059550 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1401/2776] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:46.064056 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e8a68-049b-4b8e-a3e0-be06b122e7d8 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:46.124446 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e8a68-049b-4b8e-a3e0-be06b122e7d8 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:46.129300 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acc2e8-f41e-48dd-b442-ca1962742ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:46.129881 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc2e8-f41e-48dd-b442-ca1962742ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:46.130161 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc2e8-f41e-48dd-b442-ca1962742ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:46.130433 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc2e8-f41e-48dd-b442-ca1962742ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:46.131115 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acc2e8-f41e-48dd-b442-ca1962742ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:46.133144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acc2e8-f41e-48dd-b442-ca1962742ef2 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:46.157954 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1376/2777] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:30:46 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:30:46.161959 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133ad0a-be12-450a-89f0-fd58998edc36 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:46.172507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133ad0a-be12-450a-89f0-fd58998edc36 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:46.226059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efee5b2-b3e5-45da-978e-c94b10856d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:46.226551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee5b2-b3e5-45da-978e-c94b10856d98 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:46.226827 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee5b2-b3e5-45da-978e-c94b10856d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:46.227095 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee5b2-b3e5-45da-978e-c94b10856d98 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:46.227812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efee5b2-b3e5-45da-978e-c94b10856d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:46.229723 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efee5b2-b3e5-45da-978e-c94b10856d98 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:46.247755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1402/2778] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:30:46 2022] POST /identity/v3/users => generated 297 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:30:46.251909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acc2e8-f41e-48dd-b442-ca1962742ef2 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:46.262577 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acc2e8-f41e-48dd-b442-ca1962742ef2 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:46.267209 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda194d2-9d2f-4e01-b668-bd0791bbbf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:46.267851 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda194d2-9d2f-4e01-b668-bd0791bbbf3d admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:46.268159 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda194d2-9d2f-4e01-b668-bd0791bbbf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:46.268438 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda194d2-9d2f-4e01-b668-bd0791bbbf3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:46.269158 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda194d2-9d2f-4e01-b668-bd0791bbbf3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:46.270734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda194d2-9d2f-4e01-b668-bd0791bbbf3d admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:46.281427 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1377/2779] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:46.285212 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efee5b2-b3e5-45da-978e-c94b10856d98 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:46.294907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efee5b2-b3e5-45da-978e-c94b10856d98 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:46.299432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed503b3-2554-4101-89f8-647c2cfd8e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:46.300316 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed503b3-2554-4101-89f8-647c2cfd8e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:46.300597 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed503b3-2554-4101-89f8-647c2cfd8e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:46.300866 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed503b3-2554-4101-89f8-647c2cfd8e03 admin admin] PATH_INFO: `/v3/projects/8f3cf427aaae41698b35a62642e463da/users/7fe8689505b244a5a6cd71d160d04289/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:46.314487 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed503b3-2554-4101-89f8-647c2cfd8e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3cf427aaae41698b35a62642e463da, user_id=7fe8689505b244a5a6cd71d160d04289, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:46.317139 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed503b3-2554-4101-89f8-647c2cfd8e03 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:46.330792 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1403/2780] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:30:46 2022] PUT /identity/v3/projects/8f3cf427aaae41698b35a62642e463da/users/7fe8689505b244a5a6cd71d160d04289/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:46.334574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda194d2-9d2f-4e01-b668-bd0791bbbf3d admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:46.344989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda194d2-9d2f-4e01-b668-bd0791bbbf3d admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:46.396967 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c1801-ed5e-4f3f-9a62-6aff22378976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:46.397548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c1801-ed5e-4f3f-9a62-6aff22378976 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:46.397824 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c1801-ed5e-4f3f-9a62-6aff22378976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:46.398093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c1801-ed5e-4f3f-9a62-6aff22378976 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:46.398800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c1801-ed5e-4f3f-9a62-6aff22378976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:46.400400 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c1801-ed5e-4f3f-9a62-6aff22378976 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:46.410574 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1378/2781] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:30:46.414544 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed503b3-2554-4101-89f8-647c2cfd8e03 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:46.424683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed503b3-2554-4101-89f8-647c2cfd8e03 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:46.429225 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377cc33-7baf-48fe-9f65-0c104d3e083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:46.430078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377cc33-7baf-48fe-9f65-0c104d3e083c admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:46.430353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377cc33-7baf-48fe-9f65-0c104d3e083c admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:46.430621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377cc33-7baf-48fe-9f65-0c104d3e083c admin admin] PATH_INFO: `/v3/projects/8f3cf427aaae41698b35a62642e463da/users/7fe8689505b244a5a6cd71d160d04289/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:46.432595 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377cc33-7baf-48fe-9f65-0c104d3e083c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3cf427aaae41698b35a62642e463da, user_id=7fe8689505b244a5a6cd71d160d04289, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:46.435781 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377cc33-7baf-48fe-9f65-0c104d3e083c admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:46.445605 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1404/2782] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:30:46 2022] PUT /identity/v3/projects/8f3cf427aaae41698b35a62642e463da/users/7fe8689505b244a5a6cd71d160d04289/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:46.457658 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5921641-32eb-4c92-9c3f-9b3d4dd3abcb None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:46.457947 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5921641-32eb-4c92-9c3f-9b3d4dd3abcb None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:46.458222 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5921641-32eb-4c92-9c3f-9b3d4dd3abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:46.483334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-a5921641-32eb-4c92-9c3f-9b3d4dd3abcb None None] MFA Rules not processed for user `7fe8689505b244a5a6cd71d160d04289`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:46.484568 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-a5921641-32eb-4c92-9c3f-9b3d4dd3abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:46.548482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1379/2783] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:46.561683 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377cc33-7baf-48fe-9f65-0c104d3e083c admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:46.563365 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e377cc33-7baf-48fe-9f65-0c104d3e083c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:46.619123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377cc33-7baf-48fe-9f65-0c104d3e083c admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:46.623269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb72a6-b08c-48ee-87d6-2d728236a433 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:46.623900 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb72a6-b08c-48ee-87d6-2d728236a433 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:46.624228 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb72a6-b08c-48ee-87d6-2d728236a433 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:46.624506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb72a6-b08c-48ee-87d6-2d728236a433 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:46.633273 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb72a6-b08c-48ee-87d6-2d728236a433 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:46.634685 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb72a6-b08c-48ee-87d6-2d728236a433 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:46.644466 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1405/2784] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:30:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:46.936491 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5921641-32eb-4c92-9c3f-9b3d4dd3abcb None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:46.945287 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5921641-32eb-4c92-9c3f-9b3d4dd3abcb None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:46.949801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9a042-01c0-4d33-9f56-aa7d3e34de68 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe8689505b244a5a6cd71d160d04289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f3cf427aaae41698b35a62642e463da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:46.950435 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9a042-01c0-4d33-9f56-aa7d3e34de68 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:46.950714 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9a042-01c0-4d33-9f56-aa7d3e34de68 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:46.950985 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9a042-01c0-4d33-9f56-aa7d3e34de68 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:46.951697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9a042-01c0-4d33-9f56-aa7d3e34de68 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:30:46.951996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9a042-01c0-4d33-9f56-aa7d3e34de68 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:46.953588 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9a042-01c0-4d33-9f56-aa7d3e34de68 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:46.964533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1380/2785] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:30:46.968268 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb72a6-b08c-48ee-87d6-2d728236a433 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:46.977022 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb72a6-b08c-48ee-87d6-2d728236a433 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:46.982038 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee1a6c-4b89-49b0-b95e-f94cbc12d4e7 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe8689505b244a5a6cd71d160d04289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f3cf427aaae41698b35a62642e463da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:46.982674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee1a6c-4b89-49b0-b95e-f94cbc12d4e7 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:46.982956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee1a6c-4b89-49b0-b95e-f94cbc12d4e7 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:46.983230 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee1a6c-4b89-49b0-b95e-f94cbc12d4e7 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:46.983907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee1a6c-4b89-49b0-b95e-f94cbc12d4e7 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:46.985803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee1a6c-4b89-49b0-b95e-f94cbc12d4e7 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:47.010008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1406/2786] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:30:46 2022] POST /identity/v3/projects => generated 353 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:30:47.013918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9a042-01c0-4d33-9f56-aa7d3e34de68 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:47.023610 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9a042-01c0-4d33-9f56-aa7d3e34de68 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:47.077613 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92901e7-78de-4fd8-80f5-cac896d55525 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe8689505b244a5a6cd71d160d04289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f3cf427aaae41698b35a62642e463da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:47.078293 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92901e7-78de-4fd8-80f5-cac896d55525 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:47.078526 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92901e7-78de-4fd8-80f5-cac896d55525 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:47.078800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92901e7-78de-4fd8-80f5-cac896d55525 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:47.079509 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92901e7-78de-4fd8-80f5-cac896d55525 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:30:47.079814 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92901e7-78de-4fd8-80f5-cac896d55525 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:47.081411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92901e7-78de-4fd8-80f5-cac896d55525 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:47.092097 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1381/2787] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:30:47.126999 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee1a6c-4b89-49b0-b95e-f94cbc12d4e7 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:47.137170 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee1a6c-4b89-49b0-b95e-f94cbc12d4e7 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:47.141846 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce71b-ecc3-4fd9-b343-fead29670b2b tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe8689505b244a5a6cd71d160d04289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f3cf427aaae41698b35a62642e463da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:47.142688 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce71b-ecc3-4fd9-b343-fead29670b2b tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:47.142973 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce71b-ecc3-4fd9-b343-fead29670b2b tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:47.143260 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce71b-ecc3-4fd9-b343-fead29670b2b tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] PATH_INFO: `/v3/projects/d66dc02dfc5248bc8794230e3f5bd98a` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:47.144453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce71b-ecc3-4fd9-b343-fead29670b2b tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d66dc02dfc5248bc8794230e3f5bd98a)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:47.146388 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce71b-ecc3-4fd9-b343-fead29670b2b tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:47.191262 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6edce71b-ecc3-4fd9-b343-fead29670b2b tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66dc02dfc5248bc8794230e3f5bd98a', 'request_id': 'req-6edce71b-ecc3-4fd9-b343-fead29670b2b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:47.198142 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6edce71b-ecc3-4fd9-b343-fead29670b2b tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66dc02dfc5248bc8794230e3f5bd98a', 'request_id': 'req-6edce71b-ecc3-4fd9-b343-fead29670b2b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:47.203569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6edce71b-ecc3-4fd9-b343-fead29670b2b tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66dc02dfc5248bc8794230e3f5bd98a', 'request_id': 'req-6edce71b-ecc3-4fd9-b343-fead29670b2b'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:47.214839 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6edce71b-ecc3-4fd9-b343-fead29670b2b tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] The token cache is being invalidate because project d66dc02dfc5248bc8794230e3f5bd98a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:30:47.215625 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6edce71b-ecc3-4fd9-b343-fead29670b2b tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:47.216306 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6edce71b-ecc3-4fd9-b343-fead29670b2b tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:47.217828 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1407/2788] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:30:47 2022] DELETE /identity/v3/projects/d66dc02dfc5248bc8794230e3f5bd98a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:47.402394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92901e7-78de-4fd8-80f5-cac896d55525 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:47.404584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e92901e7-78de-4fd8-80f5-cac896d55525 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:47.466582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92901e7-78de-4fd8-80f5-cac896d55525 tempest-VolumeQuotaClassesTest-2085508007 tempest-VolumeQuotaClassesTest-2085508007-project-admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:47.518382 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:47.519241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:47.519517 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:47.519787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] PATH_INFO: `/v3/users/51727d28d815403cbdaf564343ac4aba` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:47.520982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51727d28d815403cbdaf564343ac4aba)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:47.522855 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:47.567529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51727d28d815403cbdaf564343ac4aba'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:47.578331 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51727d28d815403cbdaf564343ac4aba'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:47.585439 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51727d28d815403cbdaf564343ac4aba'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:47.586056 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51727d28d815403cbdaf564343ac4aba'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:47.586649 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51727d28d815403cbdaf564343ac4aba'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:47.603856 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1382/2789] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:30:47 2022] DELETE /identity/v3/users/51727d28d815403cbdaf564343ac4aba => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:47.608426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d36ae-c4d4-4d93-b9b9-5d819d58eb12 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:47.608710 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d36ae-c4d4-4d93-b9b9-5d819d58eb12 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:47.608984 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d36ae-c4d4-4d93-b9b9-5d819d58eb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:47.625524 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-4e2d36ae-c4d4-4d93-b9b9-5d819d58eb12 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:47.626686 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4e2d36ae-c4d4-4d93-b9b9-5d819d58eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:47.682590 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1408/2790] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:47.692220 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:47.693608 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:47.749812 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eeeaa0-6aad-483d-9447-3b8b17059793 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:47.753360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277cc7-6109-4b0d-8256-bdbad7247919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:47.753986 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277cc7-6109-4b0d-8256-bdbad7247919 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:47.754266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277cc7-6109-4b0d-8256-bdbad7247919 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:47.754542 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277cc7-6109-4b0d-8256-bdbad7247919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:47.763758 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb277cc7-6109-4b0d-8256-bdbad7247919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:47.765206 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb277cc7-6109-4b0d-8256-bdbad7247919 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:47.774357 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1383/2791] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:48.026721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d36ae-c4d4-4d93-b9b9-5d819d58eb12 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:48.029178 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-4e2d36ae-c4d4-4d93-b9b9-5d819d58eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:48.043011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d36ae-c4d4-4d93-b9b9-5d819d58eb12 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:48.048186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:48.049179 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:48.049470 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:48.049837 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] PATH_INFO: `/v3/projects/e723ddf38bb149b28aded325f8d7b2f5` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:48.050987 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e723ddf38bb149b28aded325f8d7b2f5)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:48.052877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:48.096307 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e723ddf38bb149b28aded325f8d7b2f5', 'request_id': 'req-5891c746-62a0-4063-bdbf-405c0727d849'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.103148 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e723ddf38bb149b28aded325f8d7b2f5', 'request_id': 'req-5891c746-62a0-4063-bdbf-405c0727d849'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.109041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e723ddf38bb149b28aded325f8d7b2f5', 'request_id': 'req-5891c746-62a0-4063-bdbf-405c0727d849'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.119361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] The token cache is being invalidate because project e723ddf38bb149b28aded325f8d7b2f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:30:48.119645 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.120293 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.121812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1409/2792] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:30:48 2022] DELETE /identity/v3/projects/e723ddf38bb149b28aded325f8d7b2f5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:48.125859 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277cc7-6109-4b0d-8256-bdbad7247919 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:48.135868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277cc7-6109-4b0d-8256-bdbad7247919 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:48.188860 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1a49-4d9d-404b-8b4f-95e38e99a124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:48.189716 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1a49-4d9d-404b-8b4f-95e38e99a124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:48.189993 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1a49-4d9d-404b-8b4f-95e38e99a124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:48.190259 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1a49-4d9d-404b-8b4f-95e38e99a124 admin admin] PATH_INFO: `/v3/users/7fe8689505b244a5a6cd71d160d04289` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:48.191417 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e1a49-4d9d-404b-8b4f-95e38e99a124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe8689505b244a5a6cd71d160d04289)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:48.193330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e1a49-4d9d-404b-8b4f-95e38e99a124 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:48.238989 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f82e1a49-4d9d-404b-8b4f-95e38e99a124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe8689505b244a5a6cd71d160d04289'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.245388 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f82e1a49-4d9d-404b-8b4f-95e38e99a124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe8689505b244a5a6cd71d160d04289'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.251992 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f82e1a49-4d9d-404b-8b4f-95e38e99a124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe8689505b244a5a6cd71d160d04289'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.252639 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f82e1a49-4d9d-404b-8b4f-95e38e99a124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe8689505b244a5a6cd71d160d04289'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.253241 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-f82e1a49-4d9d-404b-8b4f-95e38e99a124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe8689505b244a5a6cd71d160d04289'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.269295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1384/2793] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:30:48 2022] DELETE /identity/v3/users/7fe8689505b244a5a6cd71d160d04289 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:48.530356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:48.531813 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:48.545361 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891c746-62a0-4063-bdbf-405c0727d849 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:48.600207 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:48.601057 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:48.601341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:48.601619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940 admin admin] PATH_INFO: `/v3/projects/8f3cf427aaae41698b35a62642e463da` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:48.602786 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3cf427aaae41698b35a62642e463da)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:48.604723 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:48.648150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3cf427aaae41698b35a62642e463da', 'request_id': 'req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.655486 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3cf427aaae41698b35a62642e463da', 'request_id': 'req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.660720 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3cf427aaae41698b35a62642e463da', 'request_id': 'req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.671572 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940 admin admin] The token cache is being invalidate because project 8f3cf427aaae41698b35a62642e463da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:30:48.671857 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.672506 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-6ef3fdcb-e7c4-4d31-8d2a-a247ed680940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:48.674056 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1410/2794] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:30:48 2022] DELETE /identity/v3/projects/8f3cf427aaae41698b35a62642e463da => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:48.678853 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce0264-9884-48fd-8bcb-1801a35df95f None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:48.679131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce0264-9884-48fd-8bcb-1801a35df95f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:48.679407 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce0264-9884-48fd-8bcb-1801a35df95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:48.697524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-f5ce0264-9884-48fd-8bcb-1801a35df95f None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:48.698723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f5ce0264-9884-48fd-8bcb-1801a35df95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:48.756702 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1385/2795] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:48.764890 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013bc53-0f56-447b-8de7-aa5085c2f65d None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:48.765183 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013bc53-0f56-447b-8de7-aa5085c2f65d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:48.765459 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013bc53-0f56-447b-8de7-aa5085c2f65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:48.783061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b013bc53-0f56-447b-8de7-aa5085c2f65d None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:48.784217 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b013bc53-0f56-447b-8de7-aa5085c2f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:48.792280 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1411/2796] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:48.796205 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce0264-9884-48fd-8bcb-1801a35df95f None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:48.805409 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce0264-9884-48fd-8bcb-1801a35df95f None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:48.810463 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc0c04-6295-436c-8dd4-e1e018200045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:48.811092 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc0c04-6295-436c-8dd4-e1e018200045 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:48.811368 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc0c04-6295-436c-8dd4-e1e018200045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:48.811639 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc0c04-6295-436c-8dd4-e1e018200045 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:48.813874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc0c04-6295-436c-8dd4-e1e018200045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:30:48.813874 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc0c04-6295-436c-8dd4-e1e018200045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:48.814417 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc0c04-6295-436c-8dd4-e1e018200045 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:48.828607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1386/2797] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:30:48.832992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013bc53-0f56-447b-8de7-aa5085c2f65d None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:48.842745 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013bc53-0f56-447b-8de7-aa5085c2f65d None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:48.847408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c12482-1564-4f0d-a1bf-045c3c52d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:48.848398 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c12482-1564-4f0d-a1bf-045c3c52d915 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:48.848664 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c12482-1564-4f0d-a1bf-045c3c52d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:48.849395 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c12482-1564-4f0d-a1bf-045c3c52d915 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:48.850090 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c12482-1564-4f0d-a1bf-045c3c52d915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:48.851958 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c12482-1564-4f0d-a1bf-045c3c52d915 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:48.876646 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1412/2798] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:30:48 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:30:48.880697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc0c04-6295-436c-8dd4-e1e018200045 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:48.890943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc0c04-6295-436c-8dd4-e1e018200045 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:48.945153 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4eb18-1a49-41f7-8bea-713a18de770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:48.945806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4eb18-1a49-41f7-8bea-713a18de770e admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:48.946083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4eb18-1a49-41f7-8bea-713a18de770e admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:48.946356 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4eb18-1a49-41f7-8bea-713a18de770e admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:48.947043 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4eb18-1a49-41f7-8bea-713a18de770e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:48.948999 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4eb18-1a49-41f7-8bea-713a18de770e admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:48.968266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1387/2799] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:30:48 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:30:48.972323 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c12482-1564-4f0d-a1bf-045c3c52d915 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:48.982292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c12482-1564-4f0d-a1bf-045c3c52d915 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:48.986762 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65988-8785-48e8-85e7-f3429539e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:48.987400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65988-8785-48e8-85e7-f3429539e34a admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:48.987676 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65988-8785-48e8-85e7-f3429539e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:48.987943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65988-8785-48e8-85e7-f3429539e34a admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:48.988701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c65988-8785-48e8-85e7-f3429539e34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:48.990251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c65988-8785-48e8-85e7-f3429539e34a admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:49.000675 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1413/2800] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:49.004283 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4eb18-1a49-41f7-8bea-713a18de770e admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:49.014160 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4eb18-1a49-41f7-8bea-713a18de770e admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:49.018751 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c7242-7bf2-4421-9d42-1d03cd8df204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:49.019380 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c7242-7bf2-4421-9d42-1d03cd8df204 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:49.019657 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c7242-7bf2-4421-9d42-1d03cd8df204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:49.019928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c7242-7bf2-4421-9d42-1d03cd8df204 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:49.020670 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c7242-7bf2-4421-9d42-1d03cd8df204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:49.022247 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c7242-7bf2-4421-9d42-1d03cd8df204 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:49.031746 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1388/2801] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:49.035511 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65988-8785-48e8-85e7-f3429539e34a admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:49.045363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65988-8785-48e8-85e7-f3429539e34a admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:49.049891 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d407c6-e5d8-4a68-b1b7-82b16632a88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:49.050744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d407c6-e5d8-4a68-b1b7-82b16632a88b admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:49.051018 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d407c6-e5d8-4a68-b1b7-82b16632a88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:49.051285 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d407c6-e5d8-4a68-b1b7-82b16632a88b admin admin] PATH_INFO: `/v3/projects/9d81e9955ee74f6080ead6edb92f56d0/users/a738d40247984ffb9fc4162474d2d2a5/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:49.065904 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d407c6-e5d8-4a68-b1b7-82b16632a88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d81e9955ee74f6080ead6edb92f56d0, user_id=a738d40247984ffb9fc4162474d2d2a5, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:49.068596 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d407c6-e5d8-4a68-b1b7-82b16632a88b admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:49.081482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1414/2802] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:30:49 2022] PUT /identity/v3/projects/9d81e9955ee74f6080ead6edb92f56d0/users/a738d40247984ffb9fc4162474d2d2a5/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:49.091727 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50413aa-0283-4cd6-a3e1-c1bad7f57587 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:49.092012 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50413aa-0283-4cd6-a3e1-c1bad7f57587 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:49.092314 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50413aa-0283-4cd6-a3e1-c1bad7f57587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:49.119391 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-d50413aa-0283-4cd6-a3e1-c1bad7f57587 None None] MFA Rules not processed for user `a738d40247984ffb9fc4162474d2d2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:49.120687 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-d50413aa-0283-4cd6-a3e1-c1bad7f57587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:49.182050 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1389/2803] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:49.187087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d407c6-e5d8-4a68-b1b7-82b16632a88b admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:49.245158 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d407c6-e5d8-4a68-b1b7-82b16632a88b admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:49.250452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949dcf7-b31d-49bf-a6d4-ae2aa64c2df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:49.251103 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949dcf7-b31d-49bf-a6d4-ae2aa64c2df9 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:49.251387 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949dcf7-b31d-49bf-a6d4-ae2aa64c2df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:49.251659 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949dcf7-b31d-49bf-a6d4-ae2aa64c2df9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:49.252382 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949dcf7-b31d-49bf-a6d4-ae2aa64c2df9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:49.254256 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949dcf7-b31d-49bf-a6d4-ae2aa64c2df9 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:49.277668 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1415/2804] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:30:49 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:30:49.281721 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50413aa-0283-4cd6-a3e1-c1bad7f57587 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:49.292261 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50413aa-0283-4cd6-a3e1-c1bad7f57587 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:49.347330 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7abf23-4dcb-42b5-9050-f8b9c6105b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:49.347990 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7abf23-4dcb-42b5-9050-f8b9c6105b18 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:49.348322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7abf23-4dcb-42b5-9050-f8b9c6105b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:49.348599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7abf23-4dcb-42b5-9050-f8b9c6105b18 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:49.349297 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7abf23-4dcb-42b5-9050-f8b9c6105b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:49.351201 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7abf23-4dcb-42b5-9050-f8b9c6105b18 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:49.370457 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1390/2805] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:30:49 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:30:49.374956 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949dcf7-b31d-49bf-a6d4-ae2aa64c2df9 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:49.384873 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949dcf7-b31d-49bf-a6d4-ae2aa64c2df9 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:49.389409 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3aaa9c-2e5a-4973-a461-5005c56ca8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:49.390052 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3aaa9c-2e5a-4973-a461-5005c56ca8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:49.390331 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3aaa9c-2e5a-4973-a461-5005c56ca8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:49.390603 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3aaa9c-2e5a-4973-a461-5005c56ca8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:49.391322 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3aaa9c-2e5a-4973-a461-5005c56ca8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:49.392926 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3aaa9c-2e5a-4973-a461-5005c56ca8e8 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:49.402992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1416/2806] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:49.406825 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7abf23-4dcb-42b5-9050-f8b9c6105b18 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:49.416690 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7abf23-4dcb-42b5-9050-f8b9c6105b18 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:49.422413 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966507a4-7b72-4763-9284-c15251295ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:49.423270 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966507a4-7b72-4763-9284-c15251295ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:49.423545 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966507a4-7b72-4763-9284-c15251295ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:49.423817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966507a4-7b72-4763-9284-c15251295ba8 admin admin] PATH_INFO: `/v3/projects/46ae08ef0f104a4dbc134be07f48235f/users/b9792f5bba04468cb93ab529fbedc6b3/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:49.438360 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966507a4-7b72-4763-9284-c15251295ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ae08ef0f104a4dbc134be07f48235f, user_id=b9792f5bba04468cb93ab529fbedc6b3, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:49.441041 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966507a4-7b72-4763-9284-c15251295ba8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:49.453685 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1391/2807] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:30:49 2022] PUT /identity/v3/projects/46ae08ef0f104a4dbc134be07f48235f/users/b9792f5bba04468cb93ab529fbedc6b3/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:49.457586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3aaa9c-2e5a-4973-a461-5005c56ca8e8 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:49.468913 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3aaa9c-2e5a-4973-a461-5005c56ca8e8 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:49.527146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882260c-86a9-4891-abe0-9df8b66eb5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:49.528341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882260c-86a9-4891-abe0-9df8b66eb5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:49.528615 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882260c-86a9-4891-abe0-9df8b66eb5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:49.528935 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882260c-86a9-4891-abe0-9df8b66eb5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:49.529784 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882260c-86a9-4891-abe0-9df8b66eb5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:49.531353 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882260c-86a9-4891-abe0-9df8b66eb5c7 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:49.540963 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1417/2808] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:49.546722 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966507a4-7b72-4763-9284-c15251295ba8 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:49.555733 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966507a4-7b72-4763-9284-c15251295ba8 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:49.560292 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17336ed-5f82-461a-9291-e428cf88c7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:49.561152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17336ed-5f82-461a-9291-e428cf88c7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:49.561426 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17336ed-5f82-461a-9291-e428cf88c7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:49.561691 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17336ed-5f82-461a-9291-e428cf88c7fc admin admin] PATH_INFO: `/v3/projects/46ae08ef0f104a4dbc134be07f48235f/users/b9792f5bba04468cb93ab529fbedc6b3/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:49.563613 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17336ed-5f82-461a-9291-e428cf88c7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ae08ef0f104a4dbc134be07f48235f, user_id=b9792f5bba04468cb93ab529fbedc6b3, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:49.566228 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17336ed-5f82-461a-9291-e428cf88c7fc admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:49.576134 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1392/2809] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:30:49 2022] PUT /identity/v3/projects/46ae08ef0f104a4dbc134be07f48235f/users/b9792f5bba04468cb93ab529fbedc6b3/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:49.587371 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa53c-0c51-4746-909b-e0295c2f5961 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:49.587658 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa53c-0c51-4746-909b-e0295c2f5961 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:49.587936 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa53c-0c51-4746-909b-e0295c2f5961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:49.614222 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-77faa53c-0c51-4746-909b-e0295c2f5961 None None] MFA Rules not processed for user `b9792f5bba04468cb93ab529fbedc6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:49.615413 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-77faa53c-0c51-4746-909b-e0295c2f5961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:49.686135 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1418/2810] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:49.696801 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17336ed-5f82-461a-9291-e428cf88c7fc admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:49.698482 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-f17336ed-5f82-461a-9291-e428cf88c7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:49.753706 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17336ed-5f82-461a-9291-e428cf88c7fc admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:49.757347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a467c-1fc7-4f3b-b636-fecc3709469a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:49.757967 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a467c-1fc7-4f3b-b636-fecc3709469a service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:49.758246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a467c-1fc7-4f3b-b636-fecc3709469a service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:49.758517 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a467c-1fc7-4f3b-b636-fecc3709469a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:49.817087 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a467c-1fc7-4f3b-b636-fecc3709469a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:49.818698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a467c-1fc7-4f3b-b636-fecc3709469a service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:49.828066 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1393/2811] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:30:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:52.310406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa53c-0c51-4746-909b-e0295c2f5961 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:52.367508 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa53c-0c51-4746-909b-e0295c2f5961 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:52.372633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:52.373483 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:52.373755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:52.374020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] PATH_INFO: `/v3/users/a738d40247984ffb9fc4162474d2d2a5` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:52.375173 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a738d40247984ffb9fc4162474d2d2a5)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:52.377088 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:52.419183 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a738d40247984ffb9fc4162474d2d2a5'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:52.425528 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a738d40247984ffb9fc4162474d2d2a5'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:52.426161 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a738d40247984ffb9fc4162474d2d2a5'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:52.426750 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a738d40247984ffb9fc4162474d2d2a5'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:52.438554 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a738d40247984ffb9fc4162474d2d2a5'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:52.450101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1419/2812] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:30:52 2022] DELETE /identity/v3/users/a738d40247984ffb9fc4162474d2d2a5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:52.454719 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c67073-9a0b-4506-a11c-ed8f829dbb2e None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:52.455202 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c67073-9a0b-4506-a11c-ed8f829dbb2e None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:52.455303 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c67073-9a0b-4506-a11c-ed8f829dbb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:52.472189 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-50c67073-9a0b-4506-a11c-ed8f829dbb2e None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:52.473370 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-50c67073-9a0b-4506-a11c-ed8f829dbb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:52.538744 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1394/2813] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:52.549133 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:52.550510 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:52.604832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84e738-9867-4107-a51a-b61083c1aefa admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:52.609229 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a3a1e-7950-472f-80c5-c9e2c996e6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:52.609862 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a3a1e-7950-472f-80c5-c9e2c996e6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:52.610144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a3a1e-7950-472f-80c5-c9e2c996e6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:52.610419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a3a1e-7950-472f-80c5-c9e2c996e6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:52.619153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a3a1e-7950-472f-80c5-c9e2c996e6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:52.620608 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a3a1e-7950-472f-80c5-c9e2c996e6d6 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:52.629793 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1420/2814] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:30:52.887730 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c67073-9a0b-4506-a11c-ed8f829dbb2e None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:52.889152 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-50c67073-9a0b-4506-a11c-ed8f829dbb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:52.900693 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c67073-9a0b-4506-a11c-ed8f829dbb2e None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:52.906043 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:52.906889 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:52.907169 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:52.907441 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] PATH_INFO: `/v3/projects/9d81e9955ee74f6080ead6edb92f56d0` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:52.908642 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d81e9955ee74f6080ead6edb92f56d0)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:52.910525 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:52.956864 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d81e9955ee74f6080ead6edb92f56d0', 'request_id': 'req-379083cd-c61d-43ce-9107-be84ded729ff'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:52.961974 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d81e9955ee74f6080ead6edb92f56d0', 'request_id': 'req-379083cd-c61d-43ce-9107-be84ded729ff'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:52.969062 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d81e9955ee74f6080ead6edb92f56d0', 'request_id': 'req-379083cd-c61d-43ce-9107-be84ded729ff'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:52.979904 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] The token cache is being invalidate because project 9d81e9955ee74f6080ead6edb92f56d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:30:52.980214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:52.980930 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:52.982548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1395/2815] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:30:52 2022] DELETE /identity/v3/projects/9d81e9955ee74f6080ead6edb92f56d0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:52.986400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a3a1e-7950-472f-80c5-c9e2c996e6d6 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:52.995674 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a3a1e-7950-472f-80c5-c9e2c996e6d6 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:53.049430 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dffb00-df42-4154-af3c-abe037f4847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:53.050340 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dffb00-df42-4154-af3c-abe037f4847f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:53.050612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dffb00-df42-4154-af3c-abe037f4847f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:53.050877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dffb00-df42-4154-af3c-abe037f4847f admin admin] PATH_INFO: `/v3/users/b9792f5bba04468cb93ab529fbedc6b3` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:53.052117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dffb00-df42-4154-af3c-abe037f4847f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9792f5bba04468cb93ab529fbedc6b3)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:53.054010 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dffb00-df42-4154-af3c-abe037f4847f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:53.098656 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d2dffb00-df42-4154-af3c-abe037f4847f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9792f5bba04468cb93ab529fbedc6b3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:53.105098 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d2dffb00-df42-4154-af3c-abe037f4847f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9792f5bba04468cb93ab529fbedc6b3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:53.105775 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d2dffb00-df42-4154-af3c-abe037f4847f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9792f5bba04468cb93ab529fbedc6b3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:53.106351 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d2dffb00-df42-4154-af3c-abe037f4847f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9792f5bba04468cb93ab529fbedc6b3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:53.117224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-d2dffb00-df42-4154-af3c-abe037f4847f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9792f5bba04468cb93ab529fbedc6b3'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:53.129187 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1421/2816] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:30:52 2022] DELETE /identity/v3/users/b9792f5bba04468cb93ab529fbedc6b3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:53.389351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:53.390822 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:53.406342 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379083cd-c61d-43ce-9107-be84ded729ff admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:53.462220 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:53.463075 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:53.463355 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:53.463624 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9 admin admin] PATH_INFO: `/v3/projects/46ae08ef0f104a4dbc134be07f48235f` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:53.464800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ae08ef0f104a4dbc134be07f48235f)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:53.466786 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:53.510035 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ae08ef0f104a4dbc134be07f48235f', 'request_id': 'req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:53.515665 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ae08ef0f104a4dbc134be07f48235f', 'request_id': 'req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:53.522456 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ae08ef0f104a4dbc134be07f48235f', 'request_id': 'req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:53.533376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9 admin admin] The token cache is being invalidate because project 46ae08ef0f104a4dbc134be07f48235f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:30:53.533665 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:53.534286 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e5ffbc58-bf41-4068-8f9e-2b781f8eaad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:30:53.535837 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1396/2817] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:30:53 2022] DELETE /identity/v3/projects/46ae08ef0f104a4dbc134be07f48235f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:30:53.540957 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040bf85-c95d-4d6e-b014-c51cbc59d54a None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:53.541449 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040bf85-c95d-4d6e-b014-c51cbc59d54a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:53.541564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040bf85-c95d-4d6e-b014-c51cbc59d54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:53.559738 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-a040bf85-c95d-4d6e-b014-c51cbc59d54a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:53.560963 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a040bf85-c95d-4d6e-b014-c51cbc59d54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:53.617693 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1422/2818] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:53.625929 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591e5c-ac47-426b-96db-05cc0411d437 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:53.626213 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591e5c-ac47-426b-96db-05cc0411d437 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:53.626483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591e5c-ac47-426b-96db-05cc0411d437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:53.643928 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-dd591e5c-ac47-426b-96db-05cc0411d437 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:53.645084 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-dd591e5c-ac47-426b-96db-05cc0411d437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:53.652776 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1397/2819] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:53.656727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040bf85-c95d-4d6e-b014-c51cbc59d54a None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:53.666789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040bf85-c95d-4d6e-b014-c51cbc59d54a None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:53.673061 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8135a9-8e23-453f-b5d5-ec1d8754df67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:53.673705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8135a9-8e23-453f-b5d5-ec1d8754df67 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:53.673992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8135a9-8e23-453f-b5d5-ec1d8754df67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:53.674270 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8135a9-8e23-453f-b5d5-ec1d8754df67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:53.674995 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8135a9-8e23-453f-b5d5-ec1d8754df67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:30:53.675304 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8135a9-8e23-453f-b5d5-ec1d8754df67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:53.677197 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8135a9-8e23-453f-b5d5-ec1d8754df67 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:53.689184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1423/2820] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:30:53.693364 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd591e5c-ac47-426b-96db-05cc0411d437 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:53.702896 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd591e5c-ac47-426b-96db-05cc0411d437 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:53.707546 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d527f2c-67e0-4755-a6a2-34f55a74f298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:53.708214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d527f2c-67e0-4755-a6a2-34f55a74f298 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:53.708495 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d527f2c-67e0-4755-a6a2-34f55a74f298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:53.708766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d527f2c-67e0-4755-a6a2-34f55a74f298 admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:53.709478 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d527f2c-67e0-4755-a6a2-34f55a74f298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:53.711347 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d527f2c-67e0-4755-a6a2-34f55a74f298 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:53.736587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1398/2821] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:30:53 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:30:53.740586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8135a9-8e23-453f-b5d5-ec1d8754df67 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:53.750050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8135a9-8e23-453f-b5d5-ec1d8754df67 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:53.802480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da734c3-f7b2-4955-b0b2-2d66c1cc39b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:53.803117 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da734c3-f7b2-4955-b0b2-2d66c1cc39b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:53.803396 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da734c3-f7b2-4955-b0b2-2d66c1cc39b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:53.803670 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da734c3-f7b2-4955-b0b2-2d66c1cc39b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:53.804363 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da734c3-f7b2-4955-b0b2-2d66c1cc39b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:53.806257 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da734c3-f7b2-4955-b0b2-2d66c1cc39b2 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:53.825754 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1424/2822] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:30:53 2022] POST /identity/v3/users => generated 289 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:30:53.829854 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d527f2c-67e0-4755-a6a2-34f55a74f298 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:53.839890 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d527f2c-67e0-4755-a6a2-34f55a74f298 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:53.845107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b87a5-f4e7-4885-a98e-bd329f07a265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:53.845748 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b87a5-f4e7-4885-a98e-bd329f07a265 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:53.846026 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b87a5-f4e7-4885-a98e-bd329f07a265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:53.846295 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b87a5-f4e7-4885-a98e-bd329f07a265 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:53.847004 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b87a5-f4e7-4885-a98e-bd329f07a265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:53.848615 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b87a5-f4e7-4885-a98e-bd329f07a265 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:53.858529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1399/2823] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:30:53.862461 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da734c3-f7b2-4955-b0b2-2d66c1cc39b2 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:53.872116 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da734c3-f7b2-4955-b0b2-2d66c1cc39b2 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:53.876631 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304760f-191b-4a87-9589-8539e88db440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:53.877271 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304760f-191b-4a87-9589-8539e88db440 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:53.877551 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304760f-191b-4a87-9589-8539e88db440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:53.877827 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304760f-191b-4a87-9589-8539e88db440 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:53.878546 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304760f-191b-4a87-9589-8539e88db440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:53.880156 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304760f-191b-4a87-9589-8539e88db440 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:53.891041 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1425/2824] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:30:53.894865 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b87a5-f4e7-4885-a98e-bd329f07a265 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:53.904884 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b87a5-f4e7-4885-a98e-bd329f07a265 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:53.909454 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba2511-64b8-49e5-83fa-e670a656773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:53.910294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba2511-64b8-49e5-83fa-e670a656773b admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:53.910567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba2511-64b8-49e5-83fa-e670a656773b admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:53.910836 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba2511-64b8-49e5-83fa-e670a656773b admin admin] PATH_INFO: `/v3/projects/6c4342807e714ce48ae78e0ed6adc574/users/d79e83b6b6444fa1b5336de5849edd24/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:53.924981 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba2511-64b8-49e5-83fa-e670a656773b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4342807e714ce48ae78e0ed6adc574, user_id=d79e83b6b6444fa1b5336de5849edd24, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:53.927576 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba2511-64b8-49e5-83fa-e670a656773b admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:53.941362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1400/2825] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:30:53 2022] PUT /identity/v3/projects/6c4342807e714ce48ae78e0ed6adc574/users/d79e83b6b6444fa1b5336de5849edd24/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:30:53.952245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e87006-3cd9-495f-8701-d6ad60e28da6 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:53.952536 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e87006-3cd9-495f-8701-d6ad60e28da6 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:53.952815 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e87006-3cd9-495f-8701-d6ad60e28da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:53.979621 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f3e87006-3cd9-495f-8701-d6ad60e28da6 None None] MFA Rules not processed for user `d79e83b6b6444fa1b5336de5849edd24`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:30:53.980876 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f3e87006-3cd9-495f-8701-d6ad60e28da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:54.041115 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1426/2826] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:30:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:30:54.052022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba2511-64b8-49e5-83fa-e670a656773b admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:30:54.053750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-90ba2511-64b8-49e5-83fa-e670a656773b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:30:54.108175 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba2511-64b8-49e5-83fa-e670a656773b admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:30:54.111782 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8a295-ff35-459f-84f7-9ef7c4ed1a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:30:54.112437 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8a295-ff35-459f-84f7-9ef7c4ed1a54 service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:30:54.112718 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8a295-ff35-459f-84f7-9ef7c4ed1a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:30:54.112991 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8a295-ff35-459f-84f7-9ef7c4ed1a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:30:54.120962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8a295-ff35-459f-84f7-9ef7c4ed1a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:30:54.122913 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8a295-ff35-459f-84f7-9ef7c4ed1a54 service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:30:54.131334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1401/2827] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:30:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:15.583935 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e87006-3cd9-495f-8701-d6ad60e28da6 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:15.642812 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e87006-3cd9-495f-8701-d6ad60e28da6 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:15.647244 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:15.648123 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:15.648408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:15.648682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] PATH_INFO: `/v3/users/d79e83b6b6444fa1b5336de5849edd24` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:15.649852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79e83b6b6444fa1b5336de5849edd24)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:15.651738 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:15.694132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79e83b6b6444fa1b5336de5849edd24'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:15.701236 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79e83b6b6444fa1b5336de5849edd24'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:15.701890 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79e83b6b6444fa1b5336de5849edd24'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:15.702493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79e83b6b6444fa1b5336de5849edd24'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:15.713515 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79e83b6b6444fa1b5336de5849edd24'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:15.725438 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1427/2828] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:31:15 2022] DELETE /identity/v3/users/d79e83b6b6444fa1b5336de5849edd24 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:15.730111 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141bd85-92f2-4ead-b16b-8eb5b323f14f None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:15.730607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141bd85-92f2-4ead-b16b-8eb5b323f14f None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:15.730607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141bd85-92f2-4ead-b16b-8eb5b323f14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:15.747171 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-3141bd85-92f2-4ead-b16b-8eb5b323f14f None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:15.748883 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3141bd85-92f2-4ead-b16b-8eb5b323f14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:15.803753 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1402/2829] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:15.814186 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:15.815589 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:15.870411 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b607d-d240-49c3-812b-edbb9e4aeee6 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:15.874555 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39ba08-49be-47b6-871e-b2548f23bb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:15.875191 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39ba08-49be-47b6-871e-b2548f23bb4e service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:15.875471 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39ba08-49be-47b6-871e-b2548f23bb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:15.875743 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39ba08-49be-47b6-871e-b2548f23bb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:15.884452 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39ba08-49be-47b6-871e-b2548f23bb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:15.885859 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39ba08-49be-47b6-871e-b2548f23bb4e service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:15.896654 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1428/2830] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:16.149612 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141bd85-92f2-4ead-b16b-8eb5b323f14f None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:16.151107 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3141bd85-92f2-4ead-b16b-8eb5b323f14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:16.163600 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141bd85-92f2-4ead-b16b-8eb5b323f14f None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:16.168524 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc7dae-23d4-489c-b15b-1b290bc79793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:16.169941 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc7dae-23d4-489c-b15b-1b290bc79793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.170221 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc7dae-23d4-489c-b15b-1b290bc79793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.170492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc7dae-23d4-489c-b15b-1b290bc79793 admin admin] PATH_INFO: `/v3/projects/6c4342807e714ce48ae78e0ed6adc574` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.171676 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc7dae-23d4-489c-b15b-1b290bc79793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4342807e714ce48ae78e0ed6adc574)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:16.173632 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc7dae-23d4-489c-b15b-1b290bc79793 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:16.217908 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-03bc7dae-23d4-489c-b15b-1b290bc79793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4342807e714ce48ae78e0ed6adc574', 'request_id': 'req-03bc7dae-23d4-489c-b15b-1b290bc79793'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:16.223138 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-03bc7dae-23d4-489c-b15b-1b290bc79793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4342807e714ce48ae78e0ed6adc574', 'request_id': 'req-03bc7dae-23d4-489c-b15b-1b290bc79793'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:16.230492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-03bc7dae-23d4-489c-b15b-1b290bc79793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4342807e714ce48ae78e0ed6adc574', 'request_id': 'req-03bc7dae-23d4-489c-b15b-1b290bc79793'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:16.241698 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-03bc7dae-23d4-489c-b15b-1b290bc79793 admin admin] The token cache is being invalidate because project 6c4342807e714ce48ae78e0ed6adc574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:31:16.241922 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-03bc7dae-23d4-489c-b15b-1b290bc79793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:16.242553 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-03bc7dae-23d4-489c-b15b-1b290bc79793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:16.244062 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1403/2831] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:31:16 2022] DELETE /identity/v3/projects/6c4342807e714ce48ae78e0ed6adc574 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:16.249617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eadf6-5b8f-43ea-a78d-d3d2f9abd469 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.249902 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eadf6-5b8f-43ea-a78d-d3d2f9abd469 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.250177 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eadf6-5b8f-43ea-a78d-d3d2f9abd469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.267509 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-b95eadf6-5b8f-43ea-a78d-d3d2f9abd469 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:16.268742 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-b95eadf6-5b8f-43ea-a78d-d3d2f9abd469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:16.324437 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1429/2832] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:16.332104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61d550-5444-413d-85dc-be47e98ec7ff None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.332390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61d550-5444-413d-85dc-be47e98ec7ff None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.332666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61d550-5444-413d-85dc-be47e98ec7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.350170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-2a61d550-5444-413d-85dc-be47e98ec7ff None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:16.351336 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-2a61d550-5444-413d-85dc-be47e98ec7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:16.359427 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1404/2833] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:16.363288 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eadf6-5b8f-43ea-a78d-d3d2f9abd469 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:16.373190 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eadf6-5b8f-43ea-a78d-d3d2f9abd469 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:16.377700 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efae40-cb36-45a5-aede-823f7b996b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:16.378335 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efae40-cb36-45a5-aede-823f7b996b31 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.378634 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efae40-cb36-45a5-aede-823f7b996b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.378889 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efae40-cb36-45a5-aede-823f7b996b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.379649 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efae40-cb36-45a5-aede-823f7b996b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79902) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:31:16.379935 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efae40-cb36-45a5-aede-823f7b996b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:16.381548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efae40-cb36-45a5-aede-823f7b996b31 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:16.395755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1430/2834] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:31:16.399992 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61d550-5444-413d-85dc-be47e98ec7ff None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:16.409492 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61d550-5444-413d-85dc-be47e98ec7ff None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:16.414118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf589d-7c8b-4377-9c58-d36561fc8cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:16.414749 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf589d-7c8b-4377-9c58-d36561fc8cbc admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.415027 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf589d-7c8b-4377-9c58-d36561fc8cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.415558 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf589d-7c8b-4377-9c58-d36561fc8cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.416278 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf589d-7c8b-4377-9c58-d36561fc8cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:16.418180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf589d-7c8b-4377-9c58-d36561fc8cbc admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:16.442971 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1405/2835] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:31:16 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:31:16.447067 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efae40-cb36-45a5-aede-823f7b996b31 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:16.456759 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efae40-cb36-45a5-aede-823f7b996b31 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:16.509839 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8412c7-08bb-40d6-90cf-ff6b17a8dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:16.510491 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8412c7-08bb-40d6-90cf-ff6b17a8dfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.510768 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8412c7-08bb-40d6-90cf-ff6b17a8dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.511037 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8412c7-08bb-40d6-90cf-ff6b17a8dfc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.511701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8412c7-08bb-40d6-90cf-ff6b17a8dfc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:16.513612 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8412c7-08bb-40d6-90cf-ff6b17a8dfc4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:16.532574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1431/2836] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:31:16 2022] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:31:16.536550 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf589d-7c8b-4377-9c58-d36561fc8cbc admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:16.547104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf589d-7c8b-4377-9c58-d36561fc8cbc admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:16.551591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c50a6-5ef9-43b5-a58f-c55053e18c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:16.552259 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c50a6-5ef9-43b5-a58f-c55053e18c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.552537 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c50a6-5ef9-43b5-a58f-c55053e18c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.552806 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c50a6-5ef9-43b5-a58f-c55053e18c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.553582 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c50a6-5ef9-43b5-a58f-c55053e18c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:16.555143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c50a6-5ef9-43b5-a58f-c55053e18c2a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:16.566104 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1406/2837] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:31:16.569744 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8412c7-08bb-40d6-90cf-ff6b17a8dfc4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:16.579221 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8412c7-08bb-40d6-90cf-ff6b17a8dfc4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:16.583717 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb1f9-992a-41e7-8da4-058c7ecf88fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:16.584381 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb1f9-992a-41e7-8da4-058c7ecf88fb admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.584933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb1f9-992a-41e7-8da4-058c7ecf88fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.584933 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb1f9-992a-41e7-8da4-058c7ecf88fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.585606 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdb1f9-992a-41e7-8da4-058c7ecf88fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:16.587148 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdb1f9-992a-41e7-8da4-058c7ecf88fb admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:16.597085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1432/2838] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:31:16.600996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c50a6-5ef9-43b5-a58f-c55053e18c2a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:16.610805 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c50a6-5ef9-43b5-a58f-c55053e18c2a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:16.615279 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a132764-2562-4388-8bf1-a4dfef673750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:16.616151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a132764-2562-4388-8bf1-a4dfef673750 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.616430 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a132764-2562-4388-8bf1-a4dfef673750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.616701 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a132764-2562-4388-8bf1-a4dfef673750 admin admin] PATH_INFO: `/v3/projects/3a5a8eaa18074b7ebff56bf74d60e627/users/3fb86bb62fed43db8f86026251f3e316/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.630304 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a132764-2562-4388-8bf1-a4dfef673750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5a8eaa18074b7ebff56bf74d60e627, user_id=3fb86bb62fed43db8f86026251f3e316, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:16.632918 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a132764-2562-4388-8bf1-a4dfef673750 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:16.646051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1407/2839] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:31:16 2022] PUT /identity/v3/projects/3a5a8eaa18074b7ebff56bf74d60e627/users/3fb86bb62fed43db8f86026251f3e316/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:16.656883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf096d-9665-43c0-94f6-8148efc47939 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.657171 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf096d-9665-43c0-94f6-8148efc47939 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.657447 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf096d-9665-43c0-94f6-8148efc47939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.684005 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-01bf096d-9665-43c0-94f6-8148efc47939 None None] MFA Rules not processed for user `3fb86bb62fed43db8f86026251f3e316`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:16.685249 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-01bf096d-9665-43c0-94f6-8148efc47939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:16.744907 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1433/2840] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:16.749325 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a132764-2562-4388-8bf1-a4dfef673750 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:16.810846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a132764-2562-4388-8bf1-a4dfef673750 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:16.815365 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccb926-624f-4afe-a956-46b5fa780c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:16.816008 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccb926-624f-4afe-a956-46b5fa780c6a admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.816313 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccb926-624f-4afe-a956-46b5fa780c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.816587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccb926-624f-4afe-a956-46b5fa780c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.817280 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccb926-624f-4afe-a956-46b5fa780c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:16.819151 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccb926-624f-4afe-a956-46b5fa780c6a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:16.843666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1408/2841] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:31:16 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:31:16.847689 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf096d-9665-43c0-94f6-8148efc47939 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:16.858438 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf096d-9665-43c0-94f6-8148efc47939 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:16.913051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d497673-686e-4ad2-bb2a-ef45e86ae25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:16.913712 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d497673-686e-4ad2-bb2a-ef45e86ae25e admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.913989 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d497673-686e-4ad2-bb2a-ef45e86ae25e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.914286 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d497673-686e-4ad2-bb2a-ef45e86ae25e admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.914986 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d497673-686e-4ad2-bb2a-ef45e86ae25e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:16.917315 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d497673-686e-4ad2-bb2a-ef45e86ae25e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:16.936426 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1434/2842] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:31:16 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:31:16.940214 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccb926-624f-4afe-a956-46b5fa780c6a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:16.950186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccb926-624f-4afe-a956-46b5fa780c6a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:16.955442 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4347de4-830b-4b12-b662-3c0e1b21da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:16.956117 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347de4-830b-4b12-b662-3c0e1b21da45 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.956390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347de4-830b-4b12-b662-3c0e1b21da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.956662 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347de4-830b-4b12-b662-3c0e1b21da45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.957390 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4347de4-830b-4b12-b662-3c0e1b21da45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:16.959083 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4347de4-830b-4b12-b662-3c0e1b21da45 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:16.969948 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1409/2843] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:31:16.973595 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d497673-686e-4ad2-bb2a-ef45e86ae25e admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:16.983027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d497673-686e-4ad2-bb2a-ef45e86ae25e admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:16.987580 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd17d22-800f-4630-a56f-6775203cbc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:16.988255 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd17d22-800f-4630-a56f-6775203cbc71 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:16.988538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd17d22-800f-4630-a56f-6775203cbc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:16.988814 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd17d22-800f-4630-a56f-6775203cbc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:16.989535 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd17d22-800f-4630-a56f-6775203cbc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:16.991087 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd17d22-800f-4630-a56f-6775203cbc71 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:17.000453 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1435/2844] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:31:17.004192 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4347de4-830b-4b12-b662-3c0e1b21da45 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:17.014584 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4347de4-830b-4b12-b662-3c0e1b21da45 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:17.018881 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ffcbd-34d4-4804-bec6-6b814776ee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:17.019735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ffcbd-34d4-4804-bec6-6b814776ee94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:17.020015 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ffcbd-34d4-4804-bec6-6b814776ee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:17.020323 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ffcbd-34d4-4804-bec6-6b814776ee94 admin admin] PATH_INFO: `/v3/projects/530bf6da12054a17900a3d27deb8c130/users/02c049fb520e49eab79789be8732d6d1/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:17.034823 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ffcbd-34d4-4804-bec6-6b814776ee94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=530bf6da12054a17900a3d27deb8c130, user_id=02c049fb520e49eab79789be8732d6d1, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:17.037507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ffcbd-34d4-4804-bec6-6b814776ee94 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:17.050052 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1410/2845] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:31:17 2022] PUT /identity/v3/projects/530bf6da12054a17900a3d27deb8c130/users/02c049fb520e49eab79789be8732d6d1/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:17.110504 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c823-9354-45fd-b4e2-68958c5fff3d None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:17.110734 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c823-9354-45fd-b4e2-68958c5fff3d None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:17.110937 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c823-9354-45fd-b4e2-68958c5fff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:17.136757 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f058c823-9354-45fd-b4e2-68958c5fff3d None None] MFA Rules not processed for user `02c049fb520e49eab79789be8732d6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:17.138472 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f058c823-9354-45fd-b4e2-68958c5fff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:17.199220 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1436/2846] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:17.204294 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ffcbd-34d4-4804-bec6-6b814776ee94 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:17.263770 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ffcbd-34d4-4804-bec6-6b814776ee94 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:17.268480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15dad0-779f-4154-b121-a9b1245370cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:17.269133 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15dad0-779f-4154-b121-a9b1245370cc admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:17.269410 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15dad0-779f-4154-b121-a9b1245370cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:17.269697 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15dad0-779f-4154-b121-a9b1245370cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:17.270405 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15dad0-779f-4154-b121-a9b1245370cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:17.272534 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15dad0-779f-4154-b121-a9b1245370cc admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:17.299186 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1411/2847] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:31:17 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:31:17.302600 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058c823-9354-45fd-b4e2-68958c5fff3d None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:17.313414 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058c823-9354-45fd-b4e2-68958c5fff3d None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:17.367716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de2e45-af23-40f8-9abb-655f6a798f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:17.368344 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de2e45-af23-40f8-9abb-655f6a798f62 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:17.368630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de2e45-af23-40f8-9abb-655f6a798f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:17.368918 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de2e45-af23-40f8-9abb-655f6a798f62 admin admin] PATH_INFO: `/v3/users` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:17.369617 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de2e45-af23-40f8-9abb-655f6a798f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:17.371559 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de2e45-af23-40f8-9abb-655f6a798f62 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:17.390558 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1437/2848] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:31:17 2022] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:31:17.394476 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15dad0-779f-4154-b121-a9b1245370cc admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:17.404424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15dad0-779f-4154-b121-a9b1245370cc admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:17.410846 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3065a-a6f7-4cc0-88e3-b45e98b5ceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:17.411507 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3065a-a6f7-4cc0-88e3-b45e98b5ceb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:17.411788 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3065a-a6f7-4cc0-88e3-b45e98b5ceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:17.412060 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3065a-a6f7-4cc0-88e3-b45e98b5ceb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:17.412818 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3065a-a6f7-4cc0-88e3-b45e98b5ceb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:17.416555 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3065a-a6f7-4cc0-88e3-b45e98b5ceb9 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:17.428635 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1412/2849] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:31:17.432749 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de2e45-af23-40f8-9abb-655f6a798f62 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:17.443064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de2e45-af23-40f8-9abb-655f6a798f62 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:17.447671 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae52ce-561b-41d6-95c7-d8a431d10ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:17.448591 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae52ce-561b-41d6-95c7-d8a431d10ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:17.448870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae52ce-561b-41d6-95c7-d8a431d10ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:17.449140 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae52ce-561b-41d6-95c7-d8a431d10ba1 admin admin] PATH_INFO: `/v3/projects/973e1fd380c94898a69dda0ff28cb30f/users/dd8ed76b4ab0496cbab612416e6484f4/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:17.463867 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae52ce-561b-41d6-95c7-d8a431d10ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973e1fd380c94898a69dda0ff28cb30f, user_id=dd8ed76b4ab0496cbab612416e6484f4, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:17.466548 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae52ce-561b-41d6-95c7-d8a431d10ba1 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:17.478610 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1438/2850] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:31:17 2022] PUT /identity/v3/projects/973e1fd380c94898a69dda0ff28cb30f/users/dd8ed76b4ab0496cbab612416e6484f4/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:17.482394 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3065a-a6f7-4cc0-88e3-b45e98b5ceb9 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:17.491905 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3065a-a6f7-4cc0-88e3-b45e98b5ceb9 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:17.545736 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d1f69-ee48-4c4f-bb48-f9f88abedfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:17.546428 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d1f69-ee48-4c4f-bb48-f9f88abedfec admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:17.546708 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d1f69-ee48-4c4f-bb48-f9f88abedfec admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:17.546982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d1f69-ee48-4c4f-bb48-f9f88abedfec admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:17.547703 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d1f69-ee48-4c4f-bb48-f9f88abedfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:17.549362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d1f69-ee48-4c4f-bb48-f9f88abedfec admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:17.558953 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1413/2851] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:31:17.563584 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae52ce-561b-41d6-95c7-d8a431d10ba1 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:17.573684 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae52ce-561b-41d6-95c7-d8a431d10ba1 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:17.578399 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cf542-d190-49d1-ab43-01ee6f523dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:17.579297 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cf542-d190-49d1-ab43-01ee6f523dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:17.579571 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cf542-d190-49d1-ab43-01ee6f523dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:17.579838 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cf542-d190-49d1-ab43-01ee6f523dcd admin admin] PATH_INFO: `/v3/projects/973e1fd380c94898a69dda0ff28cb30f/users/dd8ed76b4ab0496cbab612416e6484f4/roles/dfb05bc227d24cfe80ee68af75de7d1e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:17.583184 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cf542-d190-49d1-ab43-01ee6f523dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=973e1fd380c94898a69dda0ff28cb30f, user_id=dd8ed76b4ab0496cbab612416e6484f4, role_id=dfb05bc227d24cfe80ee68af75de7d1e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:17.585894 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cf542-d190-49d1-ab43-01ee6f523dcd admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:17.596092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1439/2852] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:31:17 2022] PUT /identity/v3/projects/973e1fd380c94898a69dda0ff28cb30f/users/dd8ed76b4ab0496cbab612416e6484f4/roles/dfb05bc227d24cfe80ee68af75de7d1e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:31:17.606180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f005a-7424-4aea-91a5-ec4faf6d017c None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:17.606472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f005a-7424-4aea-91a5-ec4faf6d017c None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:17.607289 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f005a-7424-4aea-91a5-ec4faf6d017c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:17.633075 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-6f5f005a-7424-4aea-91a5-ec4faf6d017c None None] MFA Rules not processed for user `dd8ed76b4ab0496cbab612416e6484f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:17.634212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6f5f005a-7424-4aea-91a5-ec4faf6d017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:17.700521 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1414/2853] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:17.711707 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cf542-d190-49d1-ab43-01ee6f523dcd admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:17.713367 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-c52cf542-d190-49d1-ab43-01ee6f523dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:17.766920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cf542-d190-49d1-ab43-01ee6f523dcd admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:17.770479 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a84260-8118-413a-abe8-0efdfbc0b39a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:17.771094 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a84260-8118-413a-abe8-0efdfbc0b39a service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:17.771371 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a84260-8118-413a-abe8-0efdfbc0b39a service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:17.771640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a84260-8118-413a-abe8-0efdfbc0b39a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:17.826168 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a84260-8118-413a-abe8-0efdfbc0b39a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:17.827577 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a84260-8118-413a-abe8-0efdfbc0b39a service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:17.836025 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1440/2854] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:19.300734 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f005a-7424-4aea-91a5-ec4faf6d017c None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:19.302109 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6f5f005a-7424-4aea-91a5-ec4faf6d017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:19.313599 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f005a-7424-4aea-91a5-ec4faf6d017c None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:19.317096 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0718b-d05a-4caa-a2ad-b63b926ad88f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:19.317721 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0718b-d05a-4caa-a2ad-b63b926ad88f service cinder] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:19.317997 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0718b-d05a-4caa-a2ad-b63b926ad88f service cinder] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:19.318269 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0718b-d05a-4caa-a2ad-b63b926ad88f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:19.372010 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0718b-d05a-4caa-a2ad-b63b926ad88f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:19.373441 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0718b-d05a-4caa-a2ad-b63b926ad88f service cinder] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:19.382016 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1415/2855] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:19.891235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a84260-8118-413a-abe8-0efdfbc0b39a service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:19.899386 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a84260-8118-413a-abe8-0efdfbc0b39a service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:19.902877 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecd2f6-2003-449e-add1-9c530e7e6fcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:19.903494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecd2f6-2003-449e-add1-9c530e7e6fcd service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:19.903770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecd2f6-2003-449e-add1-9c530e7e6fcd service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:19.904037 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecd2f6-2003-449e-add1-9c530e7e6fcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:19.912547 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecd2f6-2003-449e-add1-9c530e7e6fcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:19.913940 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecd2f6-2003-449e-add1-9c530e7e6fcd service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:19.923721 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1441/2856] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:23.714610 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0718b-d05a-4caa-a2ad-b63b926ad88f service cinder] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:23.773276 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0718b-d05a-4caa-a2ad-b63b926ad88f service cinder] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:23.777686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:23.778531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:23.778804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:23.779072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] PATH_INFO: `/v3/users/3fb86bb62fed43db8f86026251f3e316` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:23.780250 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb86bb62fed43db8f86026251f3e316)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:23.782137 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:23.827982 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb86bb62fed43db8f86026251f3e316'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:23.835198 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb86bb62fed43db8f86026251f3e316'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:23.841914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb86bb62fed43db8f86026251f3e316'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:23.842531 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb86bb62fed43db8f86026251f3e316'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:23.843131 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb86bb62fed43db8f86026251f3e316'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:23.859650 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1416/2857] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:31:23 2022] DELETE /identity/v3/users/3fb86bb62fed43db8f86026251f3e316 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:23.864435 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e12f4-feee-431f-aebc-50947c260ffd None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:23.864929 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e12f4-feee-431f-aebc-50947c260ffd None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:23.865043 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e12f4-feee-431f-aebc-50947c260ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:23.882062 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-a20e12f4-feee-431f-aebc-50947c260ffd None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:23.883241 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a20e12f4-feee-431f-aebc-50947c260ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:23.938651 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1442/2858] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:23.948120 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:23.949628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:24.003604 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5ace4-8e95-49c0-854e-6ad340959879 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:24.007170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c68d3-0eeb-4b7e-bb29-4600553f810a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:24.007788 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c68d3-0eeb-4b7e-bb29-4600553f810a service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:24.008065 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c68d3-0eeb-4b7e-bb29-4600553f810a service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:24.008367 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c68d3-0eeb-4b7e-bb29-4600553f810a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:24.017136 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c68d3-0eeb-4b7e-bb29-4600553f810a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:24.018543 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c68d3-0eeb-4b7e-bb29-4600553f810a service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:24.027703 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1417/2859] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:24.288883 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e12f4-feee-431f-aebc-50947c260ffd None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:24.290550 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-a20e12f4-feee-431f-aebc-50947c260ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:24.302108 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e12f4-feee-431f-aebc-50947c260ffd None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:24.307228 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:24.308111 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:24.308507 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:24.308788 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] PATH_INFO: `/v3/projects/3a5a8eaa18074b7ebff56bf74d60e627` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:24.310006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5a8eaa18074b7ebff56bf74d60e627)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:24.311950 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:24.357499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5a8eaa18074b7ebff56bf74d60e627', 'request_id': 'req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.365150 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5a8eaa18074b7ebff56bf74d60e627', 'request_id': 'req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.370556 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5a8eaa18074b7ebff56bf74d60e627', 'request_id': 'req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.381060 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] The token cache is being invalidate because project 3a5a8eaa18074b7ebff56bf74d60e627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:31:24.381348 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.381966 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.383481 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1443/2860] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:31:24 2022] DELETE /identity/v3/projects/3a5a8eaa18074b7ebff56bf74d60e627 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:24.387376 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c68d3-0eeb-4b7e-bb29-4600553f810a service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:24.397267 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c68d3-0eeb-4b7e-bb29-4600553f810a service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:24.449686 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:24.451051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:24.451319 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:24.451587 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] PATH_INFO: `/v3/users/02c049fb520e49eab79789be8732d6d1` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:24.452759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c049fb520e49eab79789be8732d6d1)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:24.454661 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:24.497338 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c049fb520e49eab79789be8732d6d1'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.503977 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c049fb520e49eab79789be8732d6d1'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.510456 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c049fb520e49eab79789be8732d6d1'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.511085 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c049fb520e49eab79789be8732d6d1'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.511672 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c049fb520e49eab79789be8732d6d1'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.529045 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1418/2861] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:31:24 2022] DELETE /identity/v3/users/02c049fb520e49eab79789be8732d6d1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:24.779613 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:24.781070 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:24.793930 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379a2b5-9a3d-4523-a1cf-1c850d3839b4 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:24.847909 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:24.848794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:24.849089 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:24.849383 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] PATH_INFO: `/v3/projects/530bf6da12054a17900a3d27deb8c130` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:24.850607 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=530bf6da12054a17900a3d27deb8c130)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:24.852534 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:24.896277 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530bf6da12054a17900a3d27deb8c130', 'request_id': 'req-70e61377-e26d-40c7-810d-992bbb4dac01'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.903141 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530bf6da12054a17900a3d27deb8c130', 'request_id': 'req-70e61377-e26d-40c7-810d-992bbb4dac01'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.908417 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530bf6da12054a17900a3d27deb8c130', 'request_id': 'req-70e61377-e26d-40c7-810d-992bbb4dac01'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.919073 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] The token cache is being invalidate because project 530bf6da12054a17900a3d27deb8c130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:31:24.919357 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.919972 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:24.921570 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1444/2862] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:31:24 2022] DELETE /identity/v3/projects/530bf6da12054a17900a3d27deb8c130 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:24.925515 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:24.926920 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:24.939794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff5371-96bd-4c52-a567-450504a647db admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:24.992785 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ff115-975d-477a-a653-d75f2ec03edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:24.993641 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ff115-975d-477a-a653-d75f2ec03edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:24.993923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ff115-975d-477a-a653-d75f2ec03edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:24.994196 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ff115-975d-477a-a653-d75f2ec03edf admin admin] PATH_INFO: `/v3/users/dd8ed76b4ab0496cbab612416e6484f4` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:24.995366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ff115-975d-477a-a653-d75f2ec03edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8ed76b4ab0496cbab612416e6484f4)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:24.997817 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ff115-975d-477a-a653-d75f2ec03edf admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:25.042051 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ac5ff115-975d-477a-a653-d75f2ec03edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8ed76b4ab0496cbab612416e6484f4'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:25.049401 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ac5ff115-975d-477a-a653-d75f2ec03edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8ed76b4ab0496cbab612416e6484f4'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:25.056013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ac5ff115-975d-477a-a653-d75f2ec03edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8ed76b4ab0496cbab612416e6484f4'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:25.056667 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ac5ff115-975d-477a-a653-d75f2ec03edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8ed76b4ab0496cbab612416e6484f4'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:25.057281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-ac5ff115-975d-477a-a653-d75f2ec03edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8ed76b4ab0496cbab612416e6484f4'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:25.074354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1419/2863] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:31:24 2022] DELETE /identity/v3/users/dd8ed76b4ab0496cbab612416e6484f4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:25.336176 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:25.337731 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:25.351160 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e61377-e26d-40c7-810d-992bbb4dac01 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:25.407051 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:25.407928 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:25.408224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:25.408616 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e admin admin] PATH_INFO: `/v3/projects/973e1fd380c94898a69dda0ff28cb30f` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:25.409796 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=973e1fd380c94898a69dda0ff28cb30f)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:25.411682 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:25.454629 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973e1fd380c94898a69dda0ff28cb30f', 'request_id': 'req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:25.461251 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973e1fd380c94898a69dda0ff28cb30f', 'request_id': 'req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:25.467145 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973e1fd380c94898a69dda0ff28cb30f', 'request_id': 'req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:25.477789 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e admin admin] The token cache is being invalidate because project 973e1fd380c94898a69dda0ff28cb30f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:31:25.478075 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:25.478701 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-0803a2fc-87b3-4ce6-9f35-438f55d2c80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:25.480269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1445/2864] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:31:25 2022] DELETE /identity/v3/projects/973e1fd380c94898a69dda0ff28cb30f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:25.485646 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa47811-e7f9-40ee-962b-29bdb31b46ba None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:25.485939 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa47811-e7f9-40ee-962b-29bdb31b46ba None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:25.486221 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa47811-e7f9-40ee-962b-29bdb31b46ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:25.503864 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-0aa47811-e7f9-40ee-962b-29bdb31b46ba None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:25.505094 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-0aa47811-e7f9-40ee-962b-29bdb31b46ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:25.561220 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1420/2865] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:25.568614 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b9899-5860-4dff-a91f-d709035010f0 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:25.568898 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b9899-5860-4dff-a91f-d709035010f0 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:25.569173 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b9899-5860-4dff-a91f-d709035010f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:25.586716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-ef4b9899-5860-4dff-a91f-d709035010f0 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:25.587825 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ef4b9899-5860-4dff-a91f-d709035010f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:25.596282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1446/2866] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:25.600275 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa47811-e7f9-40ee-962b-29bdb31b46ba None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:25.613766 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa47811-e7f9-40ee-962b-29bdb31b46ba None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:25.618424 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85832699-47b6-4eec-a0c7-df3dddf72940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:25.619067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85832699-47b6-4eec-a0c7-df3dddf72940 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:25.619439 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85832699-47b6-4eec-a0c7-df3dddf72940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:25.619800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85832699-47b6-4eec-a0c7-df3dddf72940 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:25.620570 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85832699-47b6-4eec-a0c7-df3dddf72940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:31:25.621042 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85832699-47b6-4eec-a0c7-df3dddf72940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:25.622666 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85832699-47b6-4eec-a0c7-df3dddf72940 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:25.633933 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1421/2867] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:31:25.638126 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b9899-5860-4dff-a91f-d709035010f0 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:25.646919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b9899-5860-4dff-a91f-d709035010f0 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:25.651494 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34978e4f-a617-49d3-a194-f88ca77008b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:25.652153 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34978e4f-a617-49d3-a194-f88ca77008b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:25.652434 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34978e4f-a617-49d3-a194-f88ca77008b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:25.652705 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34978e4f-a617-49d3-a194-f88ca77008b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:25.653895 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34978e4f-a617-49d3-a194-f88ca77008b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:25.655746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34978e4f-a617-49d3-a194-f88ca77008b2 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:25.681192 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1447/2868] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:31:25 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:31:25.685359 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85832699-47b6-4eec-a0c7-df3dddf72940 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:25.695043 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85832699-47b6-4eec-a0c7-df3dddf72940 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:25.748146 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3ba83-f99f-4b88-a8f3-d38b2cbd9b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:25.748794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3ba83-f99f-4b88-a8f3-d38b2cbd9b7a admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:25.749074 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3ba83-f99f-4b88-a8f3-d38b2cbd9b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:25.749365 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3ba83-f99f-4b88-a8f3-d38b2cbd9b7a admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:25.750022 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3ba83-f99f-4b88-a8f3-d38b2cbd9b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:25.751908 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3ba83-f99f-4b88-a8f3-d38b2cbd9b7a admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:25.771056 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1422/2869] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:31:25 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:31:25.775143 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34978e4f-a617-49d3-a194-f88ca77008b2 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:25.785619 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34978e4f-a617-49d3-a194-f88ca77008b2 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:25.790369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b20632-80da-4f30-80a5-5806c1d0a392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:25.791006 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b20632-80da-4f30-80a5-5806c1d0a392 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:25.791283 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b20632-80da-4f30-80a5-5806c1d0a392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:25.791549 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b20632-80da-4f30-80a5-5806c1d0a392 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:25.792292 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b20632-80da-4f30-80a5-5806c1d0a392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:25.793850 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b20632-80da-4f30-80a5-5806c1d0a392 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:25.803722 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1448/2870] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:31:25.807337 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3ba83-f99f-4b88-a8f3-d38b2cbd9b7a admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:25.816945 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3ba83-f99f-4b88-a8f3-d38b2cbd9b7a admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:25.821717 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff2786-7860-4ade-a60e-429f54c85525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:25.822358 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff2786-7860-4ade-a60e-429f54c85525 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:25.822636 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff2786-7860-4ade-a60e-429f54c85525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:25.822904 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff2786-7860-4ade-a60e-429f54c85525 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:25.823619 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff2786-7860-4ade-a60e-429f54c85525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:25.825726 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff2786-7860-4ade-a60e-429f54c85525 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:25.835965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1423/2871] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:31:25.839869 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b20632-80da-4f30-80a5-5806c1d0a392 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:25.849982 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b20632-80da-4f30-80a5-5806c1d0a392 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:25.854499 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb072d8-952f-44f3-b4c9-449276a4db33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:25.855356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb072d8-952f-44f3-b4c9-449276a4db33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:25.855633 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb072d8-952f-44f3-b4c9-449276a4db33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:25.855903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb072d8-952f-44f3-b4c9-449276a4db33 admin admin] PATH_INFO: `/v3/projects/c99cc3ccdf8f4afdad74fa3ce2d49b18/users/b46a388e08864d9faaddba6a8ed59e63/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:25.870582 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb072d8-952f-44f3-b4c9-449276a4db33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99cc3ccdf8f4afdad74fa3ce2d49b18, user_id=b46a388e08864d9faaddba6a8ed59e63, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:25.873213 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb072d8-952f-44f3-b4c9-449276a4db33 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:25.885406 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1449/2872] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:31:25 2022] PUT /identity/v3/projects/c99cc3ccdf8f4afdad74fa3ce2d49b18/users/b46a388e08864d9faaddba6a8ed59e63/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:25.895962 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98fee0-7fba-4d9d-a847-e397946e31a5 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:25.896324 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98fee0-7fba-4d9d-a847-e397946e31a5 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:25.896590 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98fee0-7fba-4d9d-a847-e397946e31a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:25.922479 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-7c98fee0-7fba-4d9d-a847-e397946e31a5 None None] MFA Rules not processed for user `b46a388e08864d9faaddba6a8ed59e63`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:25.923672 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-7c98fee0-7fba-4d9d-a847-e397946e31a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:25.983848 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1424/2873] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:25.994240 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb072d8-952f-44f3-b4c9-449276a4db33 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:25.995903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-0eb072d8-952f-44f3-b4c9-449276a4db33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:26.049925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb072d8-952f-44f3-b4c9-449276a4db33 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:26.053493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7a5c1-70cd-4745-b25e-24db7a5b6c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:26.054122 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7a5c1-70cd-4745-b25e-24db7a5b6c40 service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:26.054400 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7a5c1-70cd-4745-b25e-24db7a5b6c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:26.054667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7a5c1-70cd-4745-b25e-24db7a5b6c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:26.062681 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7a5c1-70cd-4745-b25e-24db7a5b6c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:26.064077 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7a5c1-70cd-4745-b25e-24db7a5b6c40 service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:26.072543 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1450/2874] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:27.398395 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2c68a-58a5-42a3-b898-abc62f005471 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:27.398876 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2c68a-58a5-42a3-b898-abc62f005471 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:27.399003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2c68a-58a5-42a3-b898-abc62f005471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:27.417307 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-6cb2c68a-58a5-42a3-b898-abc62f005471 None None] MFA Rules not processed for user `b46a388e08864d9faaddba6a8ed59e63`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:27.418488 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6cb2c68a-58a5-42a3-b898-abc62f005471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:27.425795 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1425/2875] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:27.459101 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7a5c1-70cd-4745-b25e-24db7a5b6c40 service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:27.460480 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-2ce7a5c1-70cd-4745-b25e-24db7a5b6c40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:27.532569 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7a5c1-70cd-4745-b25e-24db7a5b6c40 service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:27.536152 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03239f-b994-4d35-a222-0c0f1ca2f6fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1848679bce324613b4a92de808165ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:27.536771 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03239f-b994-4d35-a222-0c0f1ca2f6fe service glance] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:27.537049 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03239f-b994-4d35-a222-0c0f1ca2f6fe service glance] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:27.537314 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03239f-b994-4d35-a222-0c0f1ca2f6fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:27.538992 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ce03239f-b994-4d35-a222-0c0f1ca2f6fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:27.604921 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03239f-b994-4d35-a222-0c0f1ca2f6fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:27.606896 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03239f-b994-4d35-a222-0c0f1ca2f6fe service glance] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:27.617564 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1451/2876] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:28.040713 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2c68a-58a5-42a3-b898-abc62f005471 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:28.042144 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-6cb2c68a-58a5-42a3-b898-abc62f005471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:28.050583 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03239f-b994-4d35-a222-0c0f1ca2f6fe service glance] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:28.051948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-ce03239f-b994-4d35-a222-0c0f1ca2f6fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:28.106832 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03239f-b994-4d35-a222-0c0f1ca2f6fe service glance] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:28.110181 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2c68a-58a5-42a3-b898-abc62f005471 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:28.110462 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9c8b0-463f-4ba9-9f34-b095dbc5bfdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:28.111088 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9c8b0-463f-4ba9-9f34-b095dbc5bfdf service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:28.111364 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9c8b0-463f-4ba9-9f34-b095dbc5bfdf service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:28.111657 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9c8b0-463f-4ba9-9f34-b095dbc5bfdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:28.113443 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-cbe9c8b0-463f-4ba9-9f34-b095dbc5bfdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:28.115140 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d3562-733e-4986-9077-1a99ca1077e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7f2aea3e494546a04e20d8cedccc9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:28.115773 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3562-733e-4986-9077-1a99ca1077e0 service placement] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:28.116058 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3562-733e-4986-9077-1a99ca1077e0 service placement] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:28.116366 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3562-733e-4986-9077-1a99ca1077e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:28.118098 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-747d3562-733e-4986-9077-1a99ca1077e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:28.126432 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9c8b0-463f-4ba9-9f34-b095dbc5bfdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:28.127943 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9c8b0-463f-4ba9-9f34-b095dbc5bfdf service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:28.129304 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d3562-733e-4986-9077-1a99ca1077e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:28.130869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d3562-733e-4986-9077-1a99ca1077e0 service placement] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:28.138988 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1452/2877] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:31:28.141170 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1426/2878] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:37.675296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9c8b0-463f-4ba9-9f34-b095dbc5bfdf service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:37.677080 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-cbe9c8b0-463f-4ba9-9f34-b095dbc5bfdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:37.692347 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9c8b0-463f-4ba9-9f34-b095dbc5bfdf service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:37.697746 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdcad2-f4c9-494f-8fc4-ad5ed5cb415f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:37.698374 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdcad2-f4c9-494f-8fc4-ad5ed5cb415f service nova] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:37.698650 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdcad2-f4c9-494f-8fc4-ad5ed5cb415f service nova] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:37.698920 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdcad2-f4c9-494f-8fc4-ad5ed5cb415f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:37.700640 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8cbdcad2-f4c9-494f-8fc4-ad5ed5cb415f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:37.712493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdcad2-f4c9-494f-8fc4-ad5ed5cb415f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:37.714068 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdcad2-f4c9-494f-8fc4-ad5ed5cb415f service nova] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:37.725105 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1453/2879] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:43.520049 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d16646-7ee4-422d-ad5e-d7266b1229f6 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:43.520532 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d16646-7ee4-422d-ad5e-d7266b1229f6 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:43.520627 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d16646-7ee4-422d-ad5e-d7266b1229f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:43.537973 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-50d16646-7ee4-422d-ad5e-d7266b1229f6 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:43.539143 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-50d16646-7ee4-422d-ad5e-d7266b1229f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:43.591591 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1427/2880] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:31:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:43.641707 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdcad2-f4c9-494f-8fc4-ad5ed5cb415f service nova] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:43.643093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8cbdcad2-f4c9-494f-8fc4-ad5ed5cb415f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:43.710238 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdcad2-f4c9-494f-8fc4-ad5ed5cb415f service nova] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:43.715154 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d1604-d06d-4564-b6fc-bb4c13e4749c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:43.715811 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d1604-d06d-4564-b6fc-bb4c13e4749c service swift] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:43.716106 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d1604-d06d-4564-b6fc-bb4c13e4749c service swift] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:43.716408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d1604-d06d-4564-b6fc-bb4c13e4749c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:43.724235 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d1604-d06d-4564-b6fc-bb4c13e4749c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:43.725777 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d1604-d06d-4564-b6fc-bb4c13e4749c service swift] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:43.733538 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1454/2881] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:31:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:31:44.221157 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14767332-d835-491a-ab4a-c01d5a40f9a8 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:44.221157 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14767332-d835-491a-ab4a-c01d5a40f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:44.222223 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14767332-d835-491a-ab4a-c01d5a40f9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:44.240842 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-14767332-d835-491a-ab4a-c01d5a40f9a8 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:44.241959 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-14767332-d835-491a-ab4a-c01d5a40f9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:44.248987 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1428/2882] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 3 09:31:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:44.260948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d1604-d06d-4564-b6fc-bb4c13e4749c service swift] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:44.271376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d1604-d06d-4564-b6fc-bb4c13e4749c service swift] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:44.276371 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70076f50-2743-4a93-89e1-3272d0236f3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:44.277032 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70076f50-2743-4a93-89e1-3272d0236f3e service swift] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:44.277308 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70076f50-2743-4a93-89e1-3272d0236f3e service swift] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:44.277574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70076f50-2743-4a93-89e1-3272d0236f3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:44.286059 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70076f50-2743-4a93-89e1-3272d0236f3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:44.287598 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70076f50-2743-4a93-89e1-3272d0236f3e service swift] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:44.296356 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1455/2883] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:31:44.475157 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c0062-8dc5-46f6-95b7-4ee6f22692d9 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:44.475443 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c0062-8dc5-46f6-95b7-4ee6f22692d9 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:44.475721 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c0062-8dc5-46f6-95b7-4ee6f22692d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:44.493631 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-330c0062-8dc5-46f6-95b7-4ee6f22692d9 None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:44.494728 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-330c0062-8dc5-46f6-95b7-4ee6f22692d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:44.502264 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1429/2884] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 09:31:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:44.514520 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70076f50-2743-4a93-89e1-3272d0236f3e service swift] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:44.525019 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70076f50-2743-4a93-89e1-3272d0236f3e service swift] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:44.530843 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29beedcf-7d79-48a9-82f4-b88801179dc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:44.531475 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29beedcf-7d79-48a9-82f4-b88801179dc1 service swift] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:44.531755 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29beedcf-7d79-48a9-82f4-b88801179dc1 service swift] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:44.532027 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29beedcf-7d79-48a9-82f4-b88801179dc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:44.540714 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29beedcf-7d79-48a9-82f4-b88801179dc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:44.542310 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29beedcf-7d79-48a9-82f4-b88801179dc1 service swift] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:44.550089 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1456/2885] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:31:44.853578 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c7e29-6e95-4c96-b1aa-73615c85308b None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:44.854067 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c7e29-6e95-4c96-b1aa-73615c85308b None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:44.854180 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c7e29-6e95-4c96-b1aa-73615c85308b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:44.871212 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-871c7e29-6e95-4c96-b1aa-73615c85308b None None] MFA Rules not processed for user `14cf4626439e4b689a036f47a0023ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:44.872943 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-871c7e29-6e95-4c96-b1aa-73615c85308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:44.879927 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1430/2886] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 3 09:31:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:44.892342 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29beedcf-7d79-48a9-82f4-b88801179dc1 service swift] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:44.902525 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29beedcf-7d79-48a9-82f4-b88801179dc1 service swift] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:44.907482 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0786b-74db-459b-94e1-50fe936d6793 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2360e3a110b042a8839c45aa50a39724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:44.908248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0786b-74db-459b-94e1-50fe936d6793 service swift] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:44.908408 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0786b-74db-459b-94e1-50fe936d6793 service swift] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:44.908803 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0786b-74db-459b-94e1-50fe936d6793 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:44.916876 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0786b-74db-459b-94e1-50fe936d6793 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:44.918425 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0786b-74db-459b-94e1-50fe936d6793 service swift] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:44.926314 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1457/2887] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 09:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:31:46.936112 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c7e29-6e95-4c96-b1aa-73615c85308b None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:46.996309 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c7e29-6e95-4c96-b1aa-73615c85308b None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:47.002480 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:47.003334 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.003607 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.003875 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] PATH_INFO: `/v3/users/b46a388e08864d9faaddba6a8ed59e63` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.005064 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46a388e08864d9faaddba6a8ed59e63)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:47.006965 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:47.051489 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46a388e08864d9faaddba6a8ed59e63'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:47.057788 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46a388e08864d9faaddba6a8ed59e63'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:47.064554 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46a388e08864d9faaddba6a8ed59e63'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:47.065168 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46a388e08864d9faaddba6a8ed59e63'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:47.065761 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46a388e08864d9faaddba6a8ed59e63'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:47.082118 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1431/2888] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:31:46 2022] DELETE /identity/v3/users/b46a388e08864d9faaddba6a8ed59e63 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:47.086727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee81d47-e9ae-432c-b6d0-0a8bbf13fa28 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.087248 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee81d47-e9ae-432c-b6d0-0a8bbf13fa28 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.087362 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee81d47-e9ae-432c-b6d0-0a8bbf13fa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.104912 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-8ee81d47-e9ae-432c-b6d0-0a8bbf13fa28 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:47.106093 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8ee81d47-e9ae-432c-b6d0-0a8bbf13fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:47.161375 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1458/2889] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:47.171326 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:47.175896 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:47.235073 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176cfb4-4393-45c3-ad41-6f4a8829ffa4 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:47.238735 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e6fe-1128-4bcf-93f9-1b8c6990f7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:47.239373 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e6fe-1128-4bcf-93f9-1b8c6990f7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.239652 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e6fe-1128-4bcf-93f9-1b8c6990f7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.239925 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e6fe-1128-4bcf-93f9-1b8c6990f7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.249533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e6fe-1128-4bcf-93f9-1b8c6990f7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:47.251536 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e6fe-1128-4bcf-93f9-1b8c6990f7e9 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:47.261529 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1432/2890] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:47.427376 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee81d47-e9ae-432c-b6d0-0a8bbf13fa28 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:47.428782 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-8ee81d47-e9ae-432c-b6d0-0a8bbf13fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:47.441339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee81d47-e9ae-432c-b6d0-0a8bbf13fa28 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:47.445915 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a1332-fcf8-4821-8bbf-db05748bc130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:47.446770 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a1332-fcf8-4821-8bbf-db05748bc130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.447050 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a1332-fcf8-4821-8bbf-db05748bc130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.447324 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a1332-fcf8-4821-8bbf-db05748bc130 admin admin] PATH_INFO: `/v3/projects/c99cc3ccdf8f4afdad74fa3ce2d49b18` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.448574 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a1332-fcf8-4821-8bbf-db05748bc130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99cc3ccdf8f4afdad74fa3ce2d49b18)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:47.450451 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a1332-fcf8-4821-8bbf-db05748bc130 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:47.498144 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-8d7a1332-fcf8-4821-8bbf-db05748bc130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99cc3ccdf8f4afdad74fa3ce2d49b18', 'request_id': 'req-8d7a1332-fcf8-4821-8bbf-db05748bc130'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:47.505064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-8d7a1332-fcf8-4821-8bbf-db05748bc130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99cc3ccdf8f4afdad74fa3ce2d49b18', 'request_id': 'req-8d7a1332-fcf8-4821-8bbf-db05748bc130'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:47.510644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-8d7a1332-fcf8-4821-8bbf-db05748bc130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99cc3ccdf8f4afdad74fa3ce2d49b18', 'request_id': 'req-8d7a1332-fcf8-4821-8bbf-db05748bc130'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:47.521897 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-8d7a1332-fcf8-4821-8bbf-db05748bc130 admin admin] The token cache is being invalidate because project c99cc3ccdf8f4afdad74fa3ce2d49b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79902) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:31:47.522185 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-8d7a1332-fcf8-4821-8bbf-db05748bc130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:47.522813 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-8d7a1332-fcf8-4821-8bbf-db05748bc130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:31:47.524477 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1459/2891] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:31:47 2022] DELETE /identity/v3/projects/c99cc3ccdf8f4afdad74fa3ce2d49b18 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:47.529356 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cdc2a-471e-4020-a0ce-ced23b53e917 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.529647 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cdc2a-471e-4020-a0ce-ced23b53e917 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.529923 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cdc2a-471e-4020-a0ce-ced23b53e917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.547750 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-5d1cdc2a-471e-4020-a0ce-ced23b53e917 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:47.548970 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-5d1cdc2a-471e-4020-a0ce-ced23b53e917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:47.606533 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1433/2892] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:31:47.614639 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5856d52-c272-41b1-9dcf-6db7cdd9100a None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.614931 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5856d52-c272-41b1-9dcf-6db7cdd9100a None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.615214 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5856d52-c272-41b1-9dcf-6db7cdd9100a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.633727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-f5856d52-c272-41b1-9dcf-6db7cdd9100a None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:47.634914 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-f5856d52-c272-41b1-9dcf-6db7cdd9100a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:47.642919 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1460/2893] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:47.646601 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cdc2a-471e-4020-a0ce-ced23b53e917 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:47.655790 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cdc2a-471e-4020-a0ce-ced23b53e917 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:47.660362 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfca04-5a32-4e58-9428-e7c50cf15874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:47.660996 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfca04-5a32-4e58-9428-e7c50cf15874 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.661277 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfca04-5a32-4e58-9428-e7c50cf15874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.661552 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfca04-5a32-4e58-9428-e7c50cf15874 admin admin] PATH_INFO: `/v3/domains` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.662268 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfca04-5a32-4e58-9428-e7c50cf15874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79901) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:31:47.662575 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfca04-5a32-4e58-9428-e7c50cf15874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:47.664178 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfca04-5a32-4e58-9428-e7c50cf15874 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:47.679651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1434/2894] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 09:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:31:47.680817 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5856d52-c272-41b1-9dcf-6db7cdd9100a None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:47.693416 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5856d52-c272-41b1-9dcf-6db7cdd9100a None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:47.698146 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab691cd-968c-4d24-8d94-758f18c0f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:47.698794 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab691cd-968c-4d24-8d94-758f18c0f3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.699079 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab691cd-968c-4d24-8d94-758f18c0f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.699358 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab691cd-968c-4d24-8d94-758f18c0f3a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.700053 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab691cd-968c-4d24-8d94-758f18c0f3a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:47.702008 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab691cd-968c-4d24-8d94-758f18c0f3a3 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:47.729296 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1461/2895] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 09:31:47 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:31:47.733914 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfca04-5a32-4e58-9428-e7c50cf15874 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:47.743520 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfca04-5a32-4e58-9428-e7c50cf15874 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:47.796365 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe75f27-b6aa-4f56-b662-d50e57948b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:47.797006 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe75f27-b6aa-4f56-b662-d50e57948b69 admin admin] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.797281 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe75f27-b6aa-4f56-b662-d50e57948b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.797548 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe75f27-b6aa-4f56-b662-d50e57948b69 admin admin] PATH_INFO: `/v3/users` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.798225 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe75f27-b6aa-4f56-b662-d50e57948b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:47.800259 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe75f27-b6aa-4f56-b662-d50e57948b69 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:47.819249 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1435/2896] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 09:31:47 2022] POST /identity/v3/users => generated 291 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:31:47.823339 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab691cd-968c-4d24-8d94-758f18c0f3a3 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:47.833451 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab691cd-968c-4d24-8d94-758f18c0f3a3 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:47.838131 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaca17-a522-45b8-9f34-99d3161c53c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:47.838779 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaca17-a522-45b8-9f34-99d3161c53c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.839064 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaca17-a522-45b8-9f34-99d3161c53c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.839341 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaca17-a522-45b8-9f34-99d3161c53c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.840066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaca17-a522-45b8-9f34-99d3161c53c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:47.841672 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaca17-a522-45b8-9f34-99d3161c53c0 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:47.851651 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1462/2897] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:31:47.855233 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe75f27-b6aa-4f56-b662-d50e57948b69 admin admin] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:47.865354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe75f27-b6aa-4f56-b662-d50e57948b69 admin admin] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:47.869897 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811c93d-eaa5-49be-8148-cfb1d4b710d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:47.870527 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811c93d-eaa5-49be-8148-cfb1d4b710d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.870804 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811c93d-eaa5-49be-8148-cfb1d4b710d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.871072 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811c93d-eaa5-49be-8148-cfb1d4b710d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.871777 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811c93d-eaa5-49be-8148-cfb1d4b710d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:47.873909 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811c93d-eaa5-49be-8148-cfb1d4b710d8 admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:47.885003 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1436/2898] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 09:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:31:47.888887 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaca17-a522-45b8-9f34-99d3161c53c0 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:47.898309 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaca17-a522-45b8-9f34-99d3161c53c0 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:47.902774 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb4d33-1c47-45c6-9e5f-13d623ccd51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:47.904132 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb4d33-1c47-45c6-9e5f-13d623ccd51f admin admin] REQUEST_METHOD: `PUT` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.904592 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb4d33-1c47-45c6-9e5f-13d623ccd51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.904864 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb4d33-1c47-45c6-9e5f-13d623ccd51f admin admin] PATH_INFO: `/v3/projects/495750e1d06341f08c722d34f37b7c4d/users/f65fe6065cd14657b260e7c85a24409e/roles/e67ab18ce1304dc28ac4e134bba5f8be` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.918727 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb4d33-1c47-45c6-9e5f-13d623ccd51f admin admin] RBAC: Authorizing `identity:create_grant(project_id=495750e1d06341f08c722d34f37b7c4d, user_id=f65fe6065cd14657b260e7c85a24409e, role_id=e67ab18ce1304dc28ac4e134bba5f8be)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:47.921948 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb4d33-1c47-45c6-9e5f-13d623ccd51f admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:47.933903 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1463/2899] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 09:31:47 2022] PUT /identity/v3/projects/495750e1d06341f08c722d34f37b7c4d/users/f65fe6065cd14657b260e7c85a24409e/roles/e67ab18ce1304dc28ac4e134bba5f8be => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:31:47.939013 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7437d91-931b-4195-95d9-e0d0902e42b2 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:47.939501 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7437d91-931b-4195-95d9-e0d0902e42b2 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:47.939638 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7437d91-931b-4195-95d9-e0d0902e42b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:47.956251 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-c7437d91-931b-4195-95d9-e0d0902e42b2 None None] MFA Rules not processed for user `1486f7b27bfb4a6a89f2d831ec8cd6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:47.957477 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-c7437d91-931b-4195-95d9-e0d0902e42b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:48.014141 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1437/2900] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:48.023493 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb4d33-1c47-45c6-9e5f-13d623ccd51f admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:48.025309 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-d1bb4d33-1c47-45c6-9e5f-13d623ccd51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:48.079925 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb4d33-1c47-45c6-9e5f-13d623ccd51f admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:48.083455 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066bc62-cbe8-447b-8d05-a475c0cefe05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:48.084078 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066bc62-cbe8-447b-8d05-a475c0cefe05 service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:48.084445 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066bc62-cbe8-447b-8d05-a475c0cefe05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:48.084716 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066bc62-cbe8-447b-8d05-a475c0cefe05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:48.093879 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066bc62-cbe8-447b-8d05-a475c0cefe05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:48.095282 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066bc62-cbe8-447b-8d05-a475c0cefe05 service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:48.104309 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1464/2901] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:48.676567 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f0d25-ef31-4390-b159-c0c51b8a20e5 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:48.676924 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f0d25-ef31-4390-b159-c0c51b8a20e5 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:48.677266 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f0d25-ef31-4390-b159-c0c51b8a20e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:48.704452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-ad7f0d25-ef31-4390-b159-c0c51b8a20e5 None None] MFA Rules not processed for user `f65fe6065cd14657b260e7c85a24409e`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:48.705675 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ad7f0d25-ef31-4390-b159-c0c51b8a20e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:48.773759 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1438/2902] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:48.784793 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066bc62-cbe8-447b-8d05-a475c0cefe05 service neutron] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:48.786312 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-9066bc62-cbe8-447b-8d05-a475c0cefe05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:48.841245 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066bc62-cbe8-447b-8d05-a475c0cefe05 service neutron] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:48.845085 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b067d72-e57b-4719-a3d7-a5775b639c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e1e2dc0a0a45f4a36d1369edcc6e5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:48.845807 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b067d72-e57b-4719-a3d7-a5775b639c7f service cinder] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:48.846092 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b067d72-e57b-4719-a3d7-a5775b639c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:48.846369 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b067d72-e57b-4719-a3d7-a5775b639c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:48.854824 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b067d72-e57b-4719-a3d7-a5775b639c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:48.856281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b067d72-e57b-4719-a3d7-a5775b639c7f service cinder] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:48.864852 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1465/2903] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:31:50.194648 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe2093-c47f-45a1-b8f2-c14a2a408341 None None] REQUEST_METHOD: `POST` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:50.195185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe2093-c47f-45a1-b8f2-c14a2a408341 None None] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:50.195185 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe2093-c47f-45a1-b8f2-c14a2a408341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:50.212816 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.auth.core [None req-3ebe2093-c47f-45a1-b8f2-c14a2a408341 None None] MFA Rules not processed for user `f65fe6065cd14657b260e7c85a24409e`. Rule list: `[]` (Enabled: `True`). {{(pid=79901) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:31:50.213993 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3ebe2093-c47f-45a1-b8f2-c14a2a408341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:50.220723 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1439/2904] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:31:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:31:50.443269 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b067d72-e57b-4719-a3d7-a5775b639c7f service cinder] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:31:50.453055 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b067d72-e57b-4719-a3d7-a5775b639c7f service cinder] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:31:50.456563 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982c61b-c48b-4eb7-bdc0-5d4f35ca8c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:31:50.457182 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982c61b-c48b-4eb7-bdc0-5d4f35ca8c6c service neutron] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:31:50.457456 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982c61b-c48b-4eb7-bdc0-5d4f35ca8c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:31:50.457724 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982c61b-c48b-4eb7-bdc0-5d4f35ca8c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:31:50.459441 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-e982c61b-c48b-4eb7-bdc0-5d4f35ca8c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:31:50.468530 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982c61b-c48b-4eb7-bdc0-5d4f35ca8c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:31:50.469917 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982c61b-c48b-4eb7-bdc0-5d4f35ca8c6c service neutron] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:31:50.477515 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1466/2905] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:31:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:32:53.518680 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe2093-c47f-45a1-b8f2-c14a2a408341 None None] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:32:53.520246 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-3ebe2093-c47f-45a1-b8f2-c14a2a408341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:32:53.593093 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe2093-c47f-45a1-b8f2-c14a2a408341 None None] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:32:53.600684 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e4c85-8b81-47d5-aab2-e3f2076a9321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b863628035e4767b08fb5efc5c80958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:32:53.601327 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e4c85-8b81-47d5-aab2-e3f2076a9321 service nova] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:32:53.601606 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e4c85-8b81-47d5-aab2-e3f2076a9321 service nova] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:32:53.601878 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e4c85-8b81-47d5-aab2-e3f2076a9321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:32:53.603794 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ae1e4c85-8b81-47d5-aab2-e3f2076a9321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:32:53.616210 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e4c85-8b81-47d5-aab2-e3f2076a9321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:32:53.617803 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e4c85-8b81-47d5-aab2-e3f2076a9321 service nova] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:32:53.628322 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1440/2906] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:32:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:33:04.273394 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3561-bb22-4910-8ede-5bbd943ce5a5 None None] REQUEST_METHOD: `POST` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:04.273909 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3561-bb22-4910-8ede-5bbd943ce5a5 None None] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:04.274023 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3561-bb22-4910-8ede-5bbd943ce5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:04.290667 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.auth.core [None req-7afa3561-bb22-4910-8ede-5bbd943ce5a5 None None] MFA Rules not processed for user `f65fe6065cd14657b260e7c85a24409e`. Rule list: `[]` (Enabled: `True`). {{(pid=79902) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:33:04.291845 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-7afa3561-bb22-4910-8ede-5bbd943ce5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:04.298586 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1467/2907] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 09:33:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:33:06.438411 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e4c85-8b81-47d5-aab2-e3f2076a9321 service nova] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:33:06.439869 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-ae1e4c85-8b81-47d5-aab2-e3f2076a9321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:06.451191 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e4c85-8b81-47d5-aab2-e3f2076a9321 service nova] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:33:06.454833 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815422-461d-40b0-8be6-267a98fee1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418178b7e70f47d291e239a1297ccf0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:33:06.455459 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815422-461d-40b0-8be6-267a98fee1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:33:06.455741 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815422-461d-40b0-8be6-267a98fee1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:33:06.456040 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815422-461d-40b0-8be6-267a98fee1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:33:06.457787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.fernet_utils [None req-33815422-461d-40b0-8be6-267a98fee1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79901) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:33:06.467472 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33815422-461d-40b0-8be6-267a98fee1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:33:06.468940 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33815422-461d-40b0-8be6-267a98fee1b6 service neutron] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:33:06.477224 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1441/2908] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:33:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:34:08.540076 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3561-bb22-4910-8ede-5bbd943ce5a5 None None] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:08.574660 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3561-bb22-4910-8ede-5bbd943ce5a5 None None] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:08.579181 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:08.580047 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:08.580355 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:08.580630 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] PATH_INFO: `/v3/users/f65fe6065cd14657b260e7c85a24409e` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:08.581829 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65fe6065cd14657b260e7c85a24409e)` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:08.584488 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:08.626870 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65fe6065cd14657b260e7c85a24409e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:08.633979 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65fe6065cd14657b260e7c85a24409e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:08.634623 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65fe6065cd14657b260e7c85a24409e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:08.635224 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65fe6065cd14657b260e7c85a24409e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:08.646644 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.notifications [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65fe6065cd14657b260e7c85a24409e'} {{(pid=79902) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:08.659066 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1468/2909] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 09:34:08 2022] DELETE /identity/v3/users/f65fe6065cd14657b260e7c85a24409e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:34:08.824231 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815422-461d-40b0-8be6-267a98fee1b6 service neutron] Authenticating user token {{(pid=79901) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:34:08.841316 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815422-461d-40b0-8be6-267a98fee1b6 service neutron] Validating token access rules against request {{(pid=79901) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:34:08.894644 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1486f7b27bfb4a6a89f2d831ec8cd6c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25541cb90a5a4ec5b739da2d1d1355bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79901) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:34:08.895483 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:34:08.896354 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:34:08.896628 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f admin admin] PATH_INFO: `/v3/projects/495750e1d06341f08c722d34f37b7c4d` {{(pid=79901) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:34:08.897787 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=495750e1d06341f08c722d34f37b7c4d)` {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:34:08.899651 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f admin admin] RBAC: Authorization granted {{(pid=79901) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:34:08.942184 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495750e1d06341f08c722d34f37b7c4d', 'request_id': 'req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:08.947800 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495750e1d06341f08c722d34f37b7c4d', 'request_id': 'req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:08.954475 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495750e1d06341f08c722d34f37b7c4d', 'request_id': 'req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f'} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:08.965452 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f admin admin] The token cache is being invalidate because project 495750e1d06341f08c722d34f37b7c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79901) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:34:08.965740 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:08.966351 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: DEBUG keystone.notifications [None req-5e0ca11a-95b7-4e79-9290-b8e8a5fdd97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79901) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:34:08.967868 dv-cinder-840279-1-iscsi devstack@keystone.service[79901]: [pid: 79901|app: 0|req: 1442/2910] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 09:34:08 2022] DELETE /identity/v3/projects/495750e1d06341f08c722d34f37b7c4d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:35:49.835622 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] Authenticating user token {{(pid=79902) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:35:49.837020 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:35:49.947419 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a64c8c-9f8c-4c3f-9639-f10ef0d637f6 admin admin] Validating token access rules against request {{(pid=79902) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:35:50.006090 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd23897-38b9-4e63-a2f5-b32f2a88abe1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7f2aea3e494546a04e20d8cedccc9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '250761bd5a9e48e0b26fedcf65d88a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79902) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:35:50.006726 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd23897-38b9-4e63-a2f5-b32f2a88abe1 service placement] REQUEST_METHOD: `GET` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:35:50.007011 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd23897-38b9-4e63-a2f5-b32f2a88abe1 service placement] SCRIPT_NAME: `/identity` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:35:50.007281 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd23897-38b9-4e63-a2f5-b32f2a88abe1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79902) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:35:50.009114 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.fernet_utils [None req-afd23897-38b9-4e63-a2f5-b32f2a88abe1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79902) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:35:50.019824 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd23897-38b9-4e63-a2f5-b32f2a88abe1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:35:50.022021 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd23897-38b9-4e63-a2f5-b32f2a88abe1 service placement] RBAC: Authorization granted {{(pid=79902) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:35:50.031427 dv-cinder-840279-1-iscsi devstack@keystone.service[79902]: [pid: 79902|app: 0|req: 1469/2911] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 09:35:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)